AI-102 Question 313
Select 2You are working on a customer support AI solution that uses Azure Cognitive Services QnA Maker to create a knowledge base. After importing a FAQ document into the knowledge base, you need to test the model to ensure it provides accurate responses before deploying it. Which of the following actions should you perform to properly test the knowledge base?
- A
Use the 'Test' feature in the QnA Maker portal to submit sample queries.
- B
Deploy the knowledge base to production immediately and gather user feedback for testing.
- C
Manually review the imported FAQ document to ensure it contains no errors.
- D
Submit test queries in the 'Test' pane and review the confidence score for each response.
- E
Export the knowledge base and test it in a local environment using a custom script.
Show answer and explanation
Correct answers: A, D
Explanation
To properly test an Azure QnA Maker knowledge base, you should use the built-in 'Test' feature in the QnA Maker portal. This allows you to simulate user queries and evaluate the model's responses, including reviewing the confidence scores. These steps ensure the knowledge base is accurate and reliable before deploying it to production.
- A. Correct.
This is correct. The 'Test' feature in the QnA Maker portal allows you to simulate queries and verify the responses from the knowledge base without deploying it to production.
- B. Incorrect.
This is incorrect. Deploying to production without prior testing can result in poor user experience and incorrect responses being served live, which is not a best practice.
- C. Incorrect.
This is incorrect. While manually reviewing the FAQ document is important during the creation phase, it is not sufficient for testing the knowledge base's performance once it has been trained.
- D. Correct.
This is correct. Analyzing the confidence scores for test queries helps you evaluate how well the model matches user intents and whether further training or tuning is needed.
- E. Incorrect.
This is incorrect. Exporting the knowledge base and testing it in a local environment is not a standard or recommended practice for testing QnA Maker knowledge bases.