AI0-001 AI Implementation and Operations Practice Question
A retail bank runs a batch credit-limit model that scores the entire customer base nightly. The model consumes 40 features, several of which are aggregates computed from transaction history. Downstream systems report that scores for some customers change dramatically between consecutive nights even though nothing about those customers changed. The team needs to make the nightly pipeline reproducible and explainable. Which action should the team take FIRST?
⚠ Common exam trap
The trap here is jumping to a modeling or feature-engineering change when the immediate need is provenance, because without a recorded feature snapshot the anomalous scores cannot be reproduced or explained at all.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Capture the exact feature values and pipeline code version used for each nightly scoring run so any score can be reproduced and compared.
Score changes with no corresponding customer change indicate the feature pipeline is producing different values on different nights. Capturing a per-run feature snapshot alongside the pipeline code version makes each score reproducible, which is the only way to identify the unstable aggregate and satisfy explainability obligations before attempting any fix.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✓
Capture the exact feature values and pipeline code version used for each nightly scoring run so any score can be reproduced and compared.
Why this is correct
Unexplained night-to-night swings with unchanged customer behavior usually come from nondeterministic or time-dependent feature computation. Recording the feature snapshot, pipeline code version, and parameters for every run lets the team replay a specific score and diff it against the prior night, isolating the offending aggregate. This is the prerequisite for every later fix and for regulatory explainability.
- ✗
Increase the batch window so the nightly job has more time to compute the aggregate features.
Why it's wrong here
Runtime is not the reported problem; scores are changing when customer behavior does not. A longer window does not make an aggregate deterministic and could even widen the drift if the window boundary moves. The team would spend operational budget without gaining the provenance needed to explain or reproduce any individual score.
- ✗
Add a post-processing step that clamps each customer's score change to a fixed maximum per night.
Why it's wrong here
Clamping masks the instability instead of resolving it and silently alters the model's decisions, which is a serious governance and fair-lending problem. Scores would no longer reflect the model's actual output, and auditors could not reconstruct why a limit changed. The underlying nondeterministic feature computation would remain and could still corrupt other reports.
- ✗
Replace the aggregated transaction features with raw transaction counts to eliminate the variability.
Why it's wrong here
Swapping features changes the model's inputs and invalidates its validation, and it discards predictive signal the bank approved. It also treats a symptom rather than diagnosing which aggregate is unstable. The team would still be unable to reproduce the anomalous scores, and the model would need full revalidation before it could legally score customers again.
About these practice questions
One of 962 original AI0-001 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written and reviewed by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
Last reviewed September 2026 · checked against the official CompTIA exam blueprint
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.