hardMultiple ChoiceObjective-mapped
MLA-C01 Practice Question: A financial services company operates a real-time…
A financial services company operates a real-time inference endpoint for a fraud detection model on Amazon SageMaker. The model was trained on historical transaction data from 2023. Over the past month, the model's precision has dropped from 92% to 78%, while recall remains high at 95%. The data science team suspects data drift and has already enabled SageMaker Model Monitor with data capture and a baseline from the training data. The latest monitoring report indicates no statistically significant drift in any of the input features. The team also verified that the inference code and model artifact have not changed. Despite the stable feature distributions, the model is misclassifying an increasing number of legitimate transactions as fraudulent (false positives). The business is concerned about the impact on customer experience. What is the best course of action?
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Investigate recent ground truth labels to check for label drift or changes in the fraud definition.
The scenario describes a drop in precision without feature drift, which indicates label drift – the relationship between features and labels has changed. The most effective next step is to collect and analyze recent ground truth labels to confirm label drift. Retraining on recent data without addressing the root cause may not help if the new labels are also stale or incorrect. Increasing data capture rate will not diagnose the issue. Changing the algorithm is unlikely to help without understanding the cause.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Replace the model with a more complex algorithm such as a gradient-boosted tree.
Why it's wrong here
Algorithm change is a premature solution; the model's performance drop is likely due to data changes, not model capacity.
- ✗
Retrain the model using the most recent 30 days of transaction data with automated retraining pipelines.
Why it's wrong here
Retraining without understanding the cause may still use incorrect labels or miss a shift in the label distribution; it's better to first investigate ground truth.
- ✗
Increase the data capture sampling percentage from 10% to 100% for more detailed analysis.
Why it's wrong here
Increasing data capture will provide more data but does not address the need for ground truth labels to diagnose the degradation.
- ✓
Investigate recent ground truth labels to check for label drift or changes in the fraud definition.
Why this is correct
Label drift occurs when the underlying relationship between features and labels changes. Collecting and analyzing recent labels can confirm if the fraud criteria have shifted.
Go deeper
Related to this question
About these practice questions
This MLA-C01 question is part of Courseiva's 835-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This MLA-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the MLA-C01 exam.