mediumMultiple Choice
MLA-C01 Practice Question: A data scientist is training a deep learning…
A data scientist is training a deep learning model on Amazon SageMaker and notices that the training loss decreases but the validation loss starts increasing after a certain number of epochs. The model is likely overfitting. Which SageMaker feature can they use to detect and diagnose this issue during training?
⚠ Common exam trap
It's easy for candidates to confuse SageMaker Debugger's real-time training diagnostics with SageMaker Model Monitor's post-deployment monitoring, or assume that hyperparameter tuning (Automatic Model Tuning) inherently addresses overfitting, when in fact it only searches for optimal hyperparameters without detecting the overfitting condition during a specific training run.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
SageMaker Debugger
SageMaker Debugger is the correct choice because it provides real-time monitoring of training metrics, including loss values, and can automatically detect anomalies such as overfitting (where training loss decreases but validation loss increases). It allows you to set rules (e.g., `OverfitRule`) that trigger alerts or stop training when overfitting is detected, enabling proactive diagnosis during the training job.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
SageMaker Model Monitor
Why it's wrong here
Model Monitor detects data drift and quality deviations in deployed endpoints, not training-time loss curves. It is tempting because it watches model behaviour, but it operates post-deployment against baseline statistics. Diagnosing overfitting during training requires Debugger, which captures loss curves and tensor data per epoch.
- ✗
SageMaker Automatic Model Tuning
Why it's wrong here
Automatic Model Tuning searches hyperparameter combinations to optimise a chosen objective metric; it does not surface per-epoch training versus validation loss divergence. It is tempting because it improves generalisation, but it tunes rather than diagnoses. Debugger's built-in overfitting rule is what flags the diverging curves during training.
- ✗
SageMaker Experiments
Why it's wrong here
Experiments tracks and compares runs, parameters and metrics across trials, but it does not compute training-time rules that detect overfitting. It is tempting because it stores metric history, yet analysis is retrospective and manual. Debugger captures per-epoch loss and emits an overfitting insight automatically while training runs.
- ✓
SageMaker Debugger
Why this is correct
SageMaker Debugger captures tensor-level metrics such as training and validation loss throughout the job and applies built-in rules that flag divergence between them. This directly detects the overfitting pattern described, where validation loss rises while training loss keeps falling.
Go deeper
Related to this question
About these practice questions
This MLA-C01 question is part of Courseiva's 665-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This MLA-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the MLA-C01 exam.