mediumMultiple ChoiceObjective-mapped
MLA-C01 Practice Question: A team uses SageMaker Model Monitor to track data…
A team uses SageMaker Model Monitor to track data quality. They notice that the monitor's constraint violations are increasing but the model performance remains good. What should they do?
⚠ Common exam trap
Candidates often assume increasing constraint violations always mean the model is failing, leading them to choose retraining (Option C) or threshold relaxation (Option B), when the correct first step is to investigate the specific features to distinguish benign drift from harmful drift.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Investigate the specific features that are violating constraints to see if they are still relevant.
Increasing constraint violations in SageMaker Model Monitor do not necessarily indicate model degradation; they may reflect benign data drift where feature distributions shift but the model's predictive performance remains intact. Investigating specific violating features allows the team to determine whether the drift is meaningful (e.g., due to a real-world change that the model should adapt to) or irrelevant (e.g., a feature that is no longer used in the inference pipeline). This aligns with the monitoring best practice of separating data quality alerts from model performance metrics to avoid unnecessary retraining or threshold tuning.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Disable the monitor because it is not affecting performance.
Why it's wrong here
Disabling the monitor could miss future degradation; the violations should be understood first.
- ✗
Relax the constraint thresholds to reduce alerts.
Why it's wrong here
Relaxing constraint thresholds would mask the increasing violations without addressing the underlying data drift, which could eventually degrade model performance. This is tempting because threshold tuning is a standard method to reduce noise from benign fluctuations in production data. It would be correct only if the violations were false positives caused by overly sensitive static rules, not genuine drift.
- ✗
Retrain the model using the latest data.
Why it's wrong here
Retraining is not yet warranted if performance is still good; it may be unnecessary.
- ✓
Investigate the specific features that are violating constraints to see if they are still relevant.
Why this is correct
Feature distributions may have naturally shifted without harming model performance; investigating helps decide if constraints need updating.
Go deeper
Related to this question
About these practice questions
Courseiva writes every MLA-C01 question from scratch — 835 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This MLA-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the MLA-C01 exam.