AI0-001 AI Implementation and Operations Practice Question
A data science team deployed a model for real-time predictions. After two weeks, the model's accuracy dropped from 92% to 80%. The monitoring system shows no data drift in features, but the target variable distribution has shifted. Which approach should the team use to detect this issue?
⚠ Common exam trap
CompTIA often tests the distinction between data drift and concept drift, trapping candidates who assume that monitoring input features (Option D) is sufficient to detect all performance degradation.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Monitor the distribution of the predicted target variable over time
Monitoring the distribution of the predicted target variable directly detects concept drift, which occurs when the relationship between features and the target changes. Since the monitoring system shows no data drift in features, the accuracy drop is likely due to a shift in the target variable's distribution, and tracking predictions over time reveals this shift. This approach aligns with MLOps best practices for detecting concept drift without requiring immediate retraining.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Schedule manual weekly reviews of model predictions
Why it's wrong here
Manual reviews are not scalable or proactive.
- ✓
Monitor the distribution of the predicted target variable over time
Why this is correct
This detects target drift, which indicates concept drift.
- ✗
Retrain the model immediately with new data
Why it's wrong here
Retraining without detection may not address the drift cause.
- ✗
Monitor input feature distributions using a KS test
Why it's wrong here
This detects data drift, not concept drift.
About these practice questions
Courseiva writes every AI0-001 question from scratch — 754 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.