AIF-C01 Guidelines for Responsible AI Practice Question
A data scientist wants to detect potential bias in a binary classification model before deployment. Which AWS service can analyze the model's predictions across different demographic groups?
⚠ Common exam trap
It's easy for candidates to confuse SageMaker Model Monitor (which monitors for drift and quality) with SageMaker Clarify (which specifically handles bias detection), as both involve monitoring model behavior but serve different purposes.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Amazon SageMaker Clarify
Amazon SageMaker Clarify is the correct service because it is specifically designed to detect bias in machine learning models by analyzing predictions across demographic groups. It provides pre-training and post-training bias metrics, such as disparate impact and difference in positive proportions, enabling data scientists to evaluate fairness before deployment.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Amazon SageMaker Ground Truth
Why it's wrong here
Ground Truth builds labelled datasets through human annotation; it does not compute bias metrics on model predictions. It is tempting because it processes data for machine learning, and would be correct when you need labelled training data or human review of predictions, not demographic fairness analysis, which SageMaker Clarify provides.
- ✗
Amazon CloudWatch Logs Insights
Why it's wrong here
CloudWatch Logs Insights queries log data, so it can surface prediction counts per demographic group only if you first write and maintain custom logging. It cannot compute bias metrics such as disparate impact or equal opportunity. It is intended for operational troubleshooting and log analytics, and would suit diagnosing latency or error spikes in deployed applications.
- ✓
Amazon SageMaker Clarify
Why this is correct
SageMaker Clarify runs bias detection on trained models, computing metrics such as disparate impact and demographic parity across facets like age or gender. It reports imbalances in predicted outcomes before deployment, satisfying the requirement to analyse predictions across demographic groups.
- ✗
Amazon SageMaker Model Monitor
Why it's wrong here
Model Monitor detects data and model drift in deployed endpoints by comparing live traffic against baselines; it does not compute bias metrics across demographic groups. It is the right choice for ongoing production drift monitoring, not pre-deployment bias analysis.
Go deeper
Related to this question
About these practice questions
One of 862 original AIF-C01 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AIF-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AIF-C01 exam.