AI-102 Question 281
Single answerYou are developing a customer support chatbot for a retail company using Azure OpenAI Service. The chatbot must use a pre-trained language model to respond to user inquiries. You need to integrate the language model into your client application. Which step is required to consume the language model from your application?
- A
Use the Azure OpenAI SDK or REST API to send text prompts to the language model endpoint.
- B
Deploy the language model to an Azure Kubernetes Service (AKS) cluster before consumption.
- C
Download the language model locally and reference it in your application code.
- D
Enable the language model in Azure Cognitive Services and directly call the service endpoint.
Show answer and explanation
Correct answer: A
Explanation
To consume a language model from Azure OpenAI Service, you use the Azure OpenAI SDK or REST API to interact with the managed service. Pre-trained models are hosted in Azure, and you communicate with the service endpoint by sending text prompts and receiving responses. Deployment or local download of the model is not required, as the service abstracts these complexities for the user.
- A. Correct.
This is correct. To consume a language model, you use Azure OpenAI SDK or REST API to send text prompts to the endpoint and receive responses.
- B. Incorrect.
This is incorrect. Pre-trained language models in Azure OpenAI Service are hosted as managed services, so deployment to AKS is not required.
- C. Incorrect.
This is incorrect. Azure OpenAI Service hosts the language models in the cloud, and downloading the model locally is not supported.
- D. Incorrect.
This is incorrect. Azure OpenAI Service is separate from Azure Cognitive Services, and enabling it in Azure Cognitive Services is not a valid step.