Question 309 of 1,000
ML Solution Monitoring, Maintenance and SecuritymediumMultiple SelectObjective-mapped

AWS Services for SageMaker Model Data Drift and Quality Monitoring

This MLA-C01 practice question tests your understanding of ml solution monitoring, maintenance and security. Match the stated requirement to the specific cloud service, access model, or configuration option — many options are valid in isolation but not for this scenario. A key principle to apply: amazon SageMaker Model Monitor. Once you have made your selection, read the full explanation to reinforce the concept and understand why each distractor is designed to mislead on exam day.

A team deploys a machine learning model using an Amazon SageMaker endpoint. They need to monitor for data drift and model quality issues. Which AWS services or features should they use? (Choose THREE.)

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

Amazon SageMaker Clarify

Amazon SageMaker Clarify is correct because it provides bias detection and model explainability, which are important for monitoring model fairness and understanding feature importance. However, for data drift and model quality, the primary service is Amazon SageMaker Model Monitor, which continuously monitors deployed models for data drift, feature attribution drift, and model quality degradation by comparing live inference data against a baseline. Amazon CloudWatch Logs and Metrics are used to collect and visualize endpoint performance metrics such as latency, error rates, and invocation counts, as well as to set alarms for operational issues. Together, Clarify, Model Monitor, and CloudWatch provide comprehensive monitoring for both technical performance and model integrity.

Key principle: Amazon SageMaker Model Monitor

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

  • AWS Glue DataBrew

    Why it's wrong here

    Data preparation service.

  • Amazon SageMaker Clarify

    Why this is correct

    Provides bias and explainability monitoring.

    Related concept

    Amazon SageMaker Model Monitor

  • Amazon SageMaker Ground Truth

    Why it's wrong here

    Used for data labeling.

  • Amazon CloudWatch Logs and Metrics

    Why this is correct

    For storing monitoring outputs and setting alarms.

    Related concept

    Amazon SageMaker Model Monitor

  • Amazon SageMaker Model Monitor

    Why this is correct

    Provides data drift and model quality monitoring.

    Related concept

    Amazon SageMaker Model Monitor

Common exam traps

Common exam trap: answer the scenario, not the keyword

The trap is confusing SageMaker Clarify (bias/explainability) with SageMaker Model Monitor (data drift/quality), as both involve analyzing data distributions, but Clarify focuses on bias and attributions, while Model Monitor handles drift detection.

Detailed technical explanation

How to think about this question

SageMaker Clarify uses SHAP (SHapley Additive exPlanations) values to compute feature importance and can run scheduled analyses comparing baseline constraints (e.g., mean, variance, quantiles) against live endpoint traffic. Under the hood, it leverages SageMaker Processing jobs to execute the analysis, and results are published to CloudWatch for alerting. In a real-world scenario, a model predicting loan approvals might see a sudden shift in income distribution due to economic changes, and Clarify would flag this as data drift.

KKey Concepts to Remember

  • Amazon SageMaker Model Monitor
  • Amazon SageMaker Clarify
  • Amazon CloudWatch Logs and Metrics

TExam Day Tips

  • Watch for words such as best, first, most likely and least administrative effort.
  • Review why wrong options are wrong, not only why the correct option is correct.

Key takeaway

Amazon SageMaker Model Monitor

Real-world example

How this comes up in practice

A cloud solutions architect for a retail company is evaluating services for a new workload. The correct answer here reflects best practice for the specific scenario described — not a general cloud recommendation. Amazon SageMaker Model Monitor Cloud exam questions reward reading the constraint carefully: the same technology can be right or wrong depending on the use case.

What to study next

Got this wrong? Here's your next step.

Review amazon SageMaker Model Monitor, then practise related MLA-C01 questions on the same topic to reinforce the concept.

Related practice questions

Related MLA-C01 practice-question pages

Use these pages to review the topic behind this question. This is how one missed question becomes focused revision.

Practice this exam

Start a free MLA-C01 practice session

Short sessions build daily habit. Longer sessions build exam-day stamina. Try a timed session to simulate real conditions.

FAQ

Questions learners often ask

What does this MLA-C01 question test?

ML Solution Monitoring, Maintenance and Security — This question tests ML Solution Monitoring, Maintenance and Security — Amazon SageMaker Model Monitor.

What is the correct answer to this question?

The correct answer is: Amazon SageMaker Clarify — Amazon SageMaker Clarify is correct because it provides bias detection and model explainability, which are important for monitoring model fairness and understanding feature importance. However, for data drift and model quality, the primary service is Amazon SageMaker Model Monitor, which continuously monitors deployed models for data drift, feature attribution drift, and model quality degradation by comparing live inference data against a baseline. Amazon CloudWatch Logs and Metrics are used to collect and visualize endpoint performance metrics such as latency, error rates, and invocation counts, as well as to set alarms for operational issues. Together, Clarify, Model Monitor, and CloudWatch provide comprehensive monitoring for both technical performance and model integrity.

What should I do if I get this MLA-C01 question wrong?

Review amazon SageMaker Model Monitor, then practise related MLA-C01 questions on the same topic to reinforce the concept.

What is the key concept behind this question?

Amazon SageMaker Model Monitor

About these practice questions

Courseiva creates original exam-style practice questions with explanations and wrong-answer analysis. It does not publish real exam questions, exam dumps, or protected exam content. Learn why practice questions differ from exam dumps →

How Courseiva writes practice questions · Editorial policy

Same concept, more angles

3 more ways this is tested on MLA-C01

These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.

Variation 1. A company wants to monitor its Amazon SageMaker real-time endpoint for data quality issues. Which TWO actions should the company take?

easy
  • A.Create a baseline from the training data to compare against live data.
  • B.Use SageMaker Debugger to analyze training jobs.
  • C.Set up an AWS Lambda function to preprocess incoming requests.
  • D.Configure Amazon S3 bucket notifications for model artifacts.
  • E.Enable data capture on the SageMaker endpoint.

Why A: Option A is correct because creating a baseline from the training data establishes a statistical profile (e.g., mean, standard deviation, distribution) of expected input features. SageMaker Model Monitor then compares live endpoint data against this baseline to detect data quality drift, such as missing values or feature distribution shifts. Option E is correct because enabling data capture on the SageMaker endpoint is a prerequisite for Model Monitor to collect and analyze the live inference data. Without data capture, there is no live data to compare against the baseline, making monitoring impossible. Therefore, both actions are required together for effective data quality monitoring.

Variation 2. A data science team is using Amazon SageMaker to train and deploy a binary classification model. They want to continuously monitor the model for data drift in production. Which combination of AWS services and SageMaker features should they use to implement automated drift detection with minimal operational overhead?

medium
  • A.SageMaker Debugger and Amazon SNS
  • B.SageMaker Pipelines and AWS Lambda
  • C.SageMaker Clarify and AWS Config
  • D.SageMaker Model Monitor and Amazon CloudWatch

Why D: SageMaker Model Monitor is the native SageMaker feature designed specifically for continuously monitoring deployed models for data drift, bias drift, and feature attribution drift. It automatically captures inference requests and responses, computes statistics, and publishes metrics to Amazon CloudWatch, which can trigger alarms for drift detection. This combination provides automated drift detection with minimal operational overhead because it requires no custom infrastructure or manual scheduling.

Variation 3. A machine learning team has deployed a model using Amazon SageMaker and wants to set up continuous monitoring for data drift. Which TWO actions are essential for ongoing data drift detection?

easy
  • A.Set up Amazon CloudWatch alarms on the endpoint's invocation latency metric.
  • B.Enable data capture on the SageMaker endpoint to store inference data in Amazon S3.
  • C.Configure Amazon SageMaker Model Monitor to run hourly monitoring schedules.
  • D.Deploy a shadow endpoint to compare predictions from the current model and a challenger model.
  • E.Create a baseline from the training data to serve as a reference distribution.

Why B: Option B is correct because enabling data capture on the SageMaker endpoint is essential to store the actual inference requests and responses in Amazon S3. Without this captured data, there is no production data to compare against the baseline for drift detection. Option C is correct because SageMaker Model Monitor must be configured with a monitoring schedule (e.g., hourly) to automatically run statistical tests comparing the captured inference data against the baseline distribution, triggering alerts when drift is detected.

Keep practising

More MLA-C01 practice questions

Last reviewed: Jul 4, 2026

Question Discussion

Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.

Loading comments…

Sign in to join the discussion.

This MLA-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the MLA-C01 exam.