AI0-001 AI Models and Data Engineering Practice Question
A logistics company uses a machine learning model to predict delivery times based on historical data. The model was performing well, but recently it started making inaccurate predictions, especially for routes that have experienced new traffic patterns and road closures. The data engineering team receives an alert that the model's accuracy has dropped by 15% over the last week. They suspect data drift. The team has access to the original training data and a continuous stream of new data. What is the most appropriate first step for the team to take?
⚠ Common exam trap
CompTIA often tests the misconception that the immediate response to a performance drop should be retraining or rollback, rather than first diagnosing the type of drift (data drift vs. concept drift) through distribution comparison.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Compare the distributions of key features between the training data and the recent data to quantify data drift.
The first step in diagnosing a suspected data drift is to statistically compare the distributions of key features between the training data and the recent streaming data. This quantifies whether the input data distribution has changed, which directly explains the accuracy drop. Without this analysis, any corrective action (like retraining or rollback) would be premature and could mask the root cause.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Roll back the model to the previous stable version and schedule a full audit of the data pipeline.
Why it's wrong here
Rolling back may lose the adaptation to new patterns, and a full audit is time-consuming and may not be necessary yet.
- ✓
Compare the distributions of key features between the training data and the recent data to quantify data drift.
Why this is correct
Identifying drift by comparing distributions is the standard first step to diagnose the problem before taking corrective action.
- ✗
Immediately retrain the model using the most recent data to adapt to the new patterns.
Why it's wrong here
Retraining without first understanding the cause could be premature; if drift is temporary, retraining might be unnecessary and costly.
- ✗
Add more features to the model to capture the new traffic patterns and road closures.
Why it's wrong here
Adding features without understanding the drift may introduce noise and does not address the root cause of performance degradation.
About these practice questions
Courseiva writes every AI0-001 question from scratch — 754 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.