AI0-001 Implementing AI Solutions Practice Question
A retail bank has deployed a credit-risk scoring model as a REST endpoint behind an API gateway. The model was trained on data from 2019–2023. Compliance now requires the bank to detect when input feature distributions drift away from the training baseline and to trigger retraining before approval rates degrade. Which approach should the bank implement FIRST?
⚠ Common exam trap
The trap here is assuming that any monitoring on a deployed model, such as latency or throughput dashboards, counts as drift detection when only distribution-comparison metrics actually measure data drift.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Enable population stability index (PSI) monitoring on each input feature against the stored training distribution and alert when PSI exceeds a set threshold.
Covariate drift is detected by comparing live inference feature distributions with the training baseline, and population stability index is the established metric for tabular models. It operates without ground-truth labels, so it fires early, before approval-rate decay confirms the problem. Fine-tuning on unlabeled traffic, autoscaling, or threshold manipulation all fail to measure distributional change and therefore cannot satisfy the compliance requirement to trigger retraining.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Lower the classification threshold from 0.50 to 0.40 so more applicants are approved and the approval rate stays stable.
Why it's wrong here
Manipulating the decision threshold masks the symptom by mechanically admitting more applicants, including higher-risk ones, without any understanding of why inputs changed. It worsens credit losses and hides drift from monitoring, so retraining is never triggered. Threshold tuning is a business trade-off knob, not a drift detection mechanism, and would fail an audit.
- ✗
Continuously fine-tune the deployed model on every new loan application that arrives at the endpoint.
Why it's wrong here
Fine-tuning on unlabeled incoming applications teaches the model to reproduce its own predictions rather than learn from ground-truth defaults, causing feedback-loop collapse. It also destroys the frozen baseline needed for drift comparison and violates model governance because no validation gates the update. Retraining must be triggered by detected drift and use labeled outcomes, not raw inference traffic.
- ✓
Enable population stability index (PSI) monitoring on each input feature against the stored training distribution and alert when PSI exceeds a set threshold.
Why this is correct
PSI compares the live feature distribution to the training baseline per feature, which directly surfaces covariate drift in the scoring inputs. Because it is computed on inference payloads, it needs no labels and can trigger retraining before approval-rate degradation becomes visible. This is the standard first-line control for tabular credit models in regulated environments.
- ✗
Increase the API gateway rate limit and add horizontal replicas so the endpoint can absorb higher application volume.
Why it's wrong here
Scaling replicas addresses throughput and latency, not distributional drift. The model's learned decision boundary remains fixed regardless of how many instances serve it, so approval rates would still degrade silently. Compliance asked for drift detection and retraining triggers, which autoscaling does not provide; it solves a capacity problem that was never described.
About these practice questions
This AI0-001 question is part of Courseiva's 962-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written and reviewed by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
Last reviewed September 2026 · checked against the official CompTIA exam blueprint
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.