Databricks Generative AI Engineer Associate Question 113
Select 3You are tasked with evaluating the responses of a generative AI model designed to assist customer service agents. During testing, you notice that the model sometimes provides incomplete answers, makes unfounded claims, or generates responses that could lead to user confusion. Which of the following issues would you need to prioritize addressing when qualitatively assessing the model's responses?
- A
Accuracy of the information provided in the responses
- B
Completeness and relevance of the responses
- C
The speed at which the responses are generated
- D
Detection and mitigation of harmful or unsafe content
- E
Grammar and spelling errors in the responses
Show answer and explanation
Correct answers: A, B, D
Explanation
When qualitatively assessing a generative AI model, it is critical to focus on the accuracy, completeness, and relevance of responses, as well as ensuring they are free from harmful or unsafe content. These factors directly impact the quality and safety of the model's outputs, which are key priorities over secondary considerations like grammar or response speed.
- A. Correct.
Accuracy is crucial to ensure that the responses are factually correct and do not mislead users.
- B. Correct.
Completeness and relevance are important to ensure the model responds effectively to user queries and provides useful information.
- C. Incorrect.
While response speed is important, it is not the primary focus when assessing the quality or safety of model outputs.
- D. Correct.
Detecting and mitigating harmful or unsafe content is essential to ensure the model does not produce responses that could harm users or violate ethical guidelines.
- E. Incorrect.
Grammar and spelling errors, while important for user experience, are less critical compared to issues like accuracy, relevance, and safety.