AI0-001 AI Implementation and Operations Practice Question
You are an AI engineer at a financial services firm. The company has deployed a gradient boosting model to predict loan default risk. The model takes features such as credit score, debt-to-income ratio, loan amount, and employment length. In production, the model processes about 10,000 predictions per day with an average latency of 50ms. Recently, the accuracy has dropped from 92% to 85%. You also notice that the average credit score of applicants has increased significantly because the marketing team launched a campaign targeting prime borrowers. The model was originally trained on data from the past three years, which included a mix of prime and subprime borrowers. You need to restore model performance while minimizing downtime and retraining cost. Which action should you take first?
⚠ Common exam trap
CompTIA often tests the misconception that model performance degradation is always due to model architecture or hyperparameters, rather than recognizing data drift as the primary cause, leading candidates to choose complex solutions like ensembles or threshold adjustments instead of retraining on recent data.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Retrain the model using the last three months of production data with labels.
The drop in accuracy is due to data drift—the production data now has a different distribution (higher credit scores) than the training data. Retraining on the most recent three months of production data with labels directly addresses this shift by adapting the model to the new population, and it minimizes downtime because it uses existing infrastructure and avoids complex architectural changes.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Add a regularization term to penalize high credit scores.
Why it's wrong here
Penalizing high credit scores is arbitrary and likely to degrade performance on the new prime borrower segment.
- ✗
Deploy an ensemble of the original model and a neural network.
Why it's wrong here
Ensembling may improve robustness but does not fix the distribution shift and increases operational complexity.
- ✗
Reject all predictions where the confidence score is below 0.9.
Why it's wrong here
This reduces false positives but does not adapt the model to the new data distribution; many correct predictions may be discarded.
- ✓
Retrain the model using the last three months of production data with labels.
Why this is correct
Retraining with recent data realigns the model with the current applicant pool, directly addressing the covariate shift.
About these practice questions
Courseiva writes every AI0-001 question from scratch — 754 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.