mediumMultiple SelectObjective-mapped
MLA-C01 Practice Question: Which TWO options are recommended best practices…
Which TWO options are recommended best practices for monitoring model performance in production on SageMaker? (Choose 2.)
⚠ Common exam trap
Watch out — candidates often confuse operational metrics (like invocation count or latency) with model performance monitoring, leading them to select CloudWatch alarms on Invocations instead of the specialized drift and bias detection tools.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Use SageMaker Clarify for bias monitoring and feature importance drift.
SageMaker Clarify is a recommended best practice for monitoring model performance because it provides automated bias detection and feature importance drift analysis, helping to identify when model predictions become unfair or when the relationships between features and predictions change over time. This is critical for maintaining model integrity and compliance in production.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Retrain the model daily based on recent data without evaluation.
Why it's wrong here
Retraining without monitoring may reduce quality if data changes.
- ✓
Use SageMaker Clarify for bias monitoring and feature importance drift.
Why this is correct
Clarify can monitor bias and explainability over time.
- ✓
Enable SageMaker Model Monitor to capture data drift and model quality metrics.
Why this is correct
Model Monitor provides automated monitoring for production endpoints.
- ✗
Set up a CloudWatch alarm on the endpoint's Invocations metric.
Why it's wrong here
Invocations metric tracks request count, not model performance degradation.
- ✗
Manually compare prediction distributions weekly.
Why it's wrong here
Manual comparison is error-prone and not automated.
Go deeper
Related to this question
About these practice questions
Courseiva writes every MLA-C01 question from scratch — 835 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This MLA-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the MLA-C01 exam.