easyMultiple Choice
How to Monitor Data Drift with Amazon SageMaker Model Monitor
A data science team deploys a real-time inference endpoint on Amazon SageMaker. They want to monitor for data drift in the input features over time. Which AWS service should they use to capture and analyze the input data distribution?
Quick Answer
The answer is Amazon SageMaker Model Monitor. This service is specifically designed to detect data drift by continuously capturing and analyzing the statistical distribution of input features at the endpoint, comparing them against a baseline to flag significant deviations. On the AWS Certified Machine Learning Engineer Associate MLA-C01 exam, this question tests your ability to distinguish between monitoring services: CloudWatch Logs handles raw log storage, CloudTrail audits API calls, and Athena queries data in S3, but only Model Monitor automates the statistical comparison of live inference data against a training baseline. A common trap is confusing CloudWatch for drift detection, but remember that CloudWatch is for operational metrics, not feature distribution analysis. Memory tip: think “Model Monitor = Model’s Input Monitor” to recall its focus on input feature distributions rather than infrastructure logs.
⚠ Common exam trap
Many candidates confuse general logging and monitoring services (CloudWatch Logs, CloudTrail) with the specialized model monitoring service, overlooking that SageMaker Model Monitor provides built-in statistical drift detection rather than just raw log storage.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Amazon SageMaker Model Monitor
Amazon SageMaker Model Monitor is the correct service because it is specifically designed to continuously monitor machine learning models in production for data drift and quality issues. It automatically captures input data distributions from real-time inference endpoints and compares them against a baseline to detect statistical changes, alerting the team when drift occurs.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Amazon Athena
Why it's wrong here
Athena queries data already stored in S3; it cannot capture live endpoint traffic, so no input distribution reaches it. SageMaker Model Monitor collects the endpoint's inference data and writes it to S3 for drift analysis. Athena is tempting because it analyses S3 data with SQL, and would be correct for querying exported monitoring reports after capture.
- ✗
AWS CloudTrail
Why it's wrong here
CloudTrail records AWS API activity for audit and governance, not the feature values sent to an endpoint, so it cannot capture input distributions. It tempts because it is a ubiquitous logging service and drift detection sounds like monitoring. SageMaker Model Monitor, using its data capture configuration, is the service built for this.
- ✓
Amazon SageMaker Model Monitor
Why this is correct
Amazon SageMaker Model Monitor captures endpoint request data and compares its distribution against a baseline, detecting drift in input features. It satisfies the requirement for continuous, automated data drift monitoring on a live real-time inference endpoint, publishing violations to Amazon CloudWatch with configurable thresholds.
- ✗
Amazon CloudWatch Logs
Why it's wrong here
CloudWatch Logs stores text logs, not the feature vectors Model Monitor needs for distribution comparison, and provides no drift baseline or statistics. It is tempting because endpoints emit logs and CloudWatch alarms on metrics, which suits operational monitoring such as latency or error rates rather than data drift.
Go deeper
Related to this question
About these practice questions
One of 665 original MLA-C01 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
Same concept, more angles
2 more ways this is tested on MLA-C01
These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.
Variation 1. A data science team deploys a machine learning model to a SageMaker endpoint for real-time inference. They need to monitor the model for feature distribution drift over time to ensure the model's predictions remain accurate. Which AWS service should they use?
easy- A.Amazon CloudWatch Evidently
- B.AWS Glue DataBrew
- C.SageMaker Clarify
- ✓ D.SageMaker Model Monitor
- E.SageMaker Debugger
Why D: SageMaker Model Monitor is the correct service because it is specifically designed to continuously monitor machine learning models deployed to SageMaker endpoints for data quality issues, including feature distribution drift. It automatically captures inference data, computes statistics against a baseline, and triggers alerts when drift is detected, ensuring the model's predictions remain accurate over time.
Variation 2. A team deploys a model with SageMaker and notices that the model returns inconsistent results during inference. They suspect a mismatch in feature transformation between the training pipeline and the inference pipeline. Which SageMaker feature can help compare the feature distributions?
medium- ✓ A.Amazon SageMaker Model Monitor
- B.Amazon SageMaker Autopilot
- C.Amazon SageMaker Clarify
- D.Amazon SageMaker Debugger
Why A: Amazon SageMaker Model Monitor is the correct choice because it continuously monitors the quality of deployed models by capturing inference data and comparing its distribution against the baseline training data distribution. When a mismatch in feature transformations occurs between training and inference pipelines, Model Monitor can detect data drift or feature attribution drift, alerting the team to the inconsistency. This allows them to identify and rectify the transformation discrepancy before it degrades model performance.
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This MLA-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the MLA-C01 exam.