AI0-001 Machine Learning and Deep Learning Practice Question
A company deploys a machine learning model that makes predictions on streaming data. Over time, the data distribution shifts, causing model performance to degrade. Which monitoring strategy is most appropriate to detect this drift?
⚠ Common exam trap
CompTIA often tests the distinction between monitoring for drift (which requires tracking performance on a fixed baseline) versus retraining or comparing input distributions, leading candidates to mistakenly choose Option A or C.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Track the model's accuracy on a fixed validation set over time
Tracking the model's accuracy on a fixed validation set over time directly measures performance degradation caused by data drift. As the streaming data distribution shifts, the model's predictions on the static validation set will become less accurate, providing a clear signal that drift has occurred. This is a standard monitoring approach in production ML systems for detecting concept drift.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Compare the distribution of predictions to the training set
Why it's wrong here
Prediction distribution comparison can indicate shift but is less reliable than performance metrics.
- ✗
Monitor the model's training loss
Why it's wrong here
Training loss can stay low even if the underlying data distribution changes.
- ✗
Retrain the model daily on new data
Why it's wrong here
Retraining is a remedy, not a monitoring method for detecting drift.
- ✓
Track the model's accuracy on a fixed validation set over time
Why this is correct
Accuracy drop on a static validation set indicates concept drift.
About these practice questions
Courseiva writes every AI0-001 question from scratch — 962 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.