MLA-C01 Question 224
Select 3You are implementing SageMaker Clarify to evaluate your binary classification model and its training dataset. Which of the following metrics provided by SageMaker Clarify can help you identify potential bias in your training data and model predictions?
- A
Demographic parity difference
- B
Class imbalance ratio
- C
Equal opportunity difference
- D
Model accuracy
- E
Disparate impact
Show answer and explanation
Correct answers: A, C, E
Explanation
SageMaker Clarify provides metrics such as demographic parity difference, equal opportunity difference, and disparate impact to assess potential bias in training data and model predictions. These metrics are crucial for identifying fairness issues, unlike general performance metrics like accuracy or unrelated concepts like class imbalance ratio.
- A. Correct.
Demographic parity difference is a bias metric provided by SageMaker Clarify that evaluates whether positive outcomes are distributed equally across groups, making it relevant for bias detection.
- B. Incorrect.
Class imbalance ratio is not a specific metric provided by SageMaker Clarify. While class imbalance may indirectly affect bias, it is not explicitly evaluated by Clarify.
- C. Correct.
Equal opportunity difference is a SageMaker Clarify bias metric that measures whether a model's true positive rates are similar across different groups, helping to detect fairness issues.
- D. Incorrect.
Model accuracy is not a bias metric. It evaluates overall performance of the model, but it does not provide insights into fairness or bias.
- E. Correct.
Disparate impact is a SageMaker Clarify metric that compares the ratio of positive outcomes between groups, helping identify potential bias in the model's predictions.