AI0-001 AI Implementation and Operations Practice Question
An AI operations team is designing a rollback strategy for a fraud-detection model served behind a feature flag. A new model version shows degraded precision after release. The team wants to restore the previous behavior within minutes without redeploying code or losing the ability to collect data on the new version. Which approach best meets these requirements?
⚠ Common exam trap
The trap here is equating rollback with redeploying a previous container image, when a feature flag can redirect live traffic in seconds with no code deployment at all.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Route traffic back to the prior model version by toggling the feature flag, while continuing shadow-mode evaluation of the new version
A feature flag allows instant switching between model versions without touching application code, and shadow mode lets the suspect version keep receiving copied traffic for evaluation while customers are served by the proven model. Redeployment is too slow, threshold tuning does not restore validated behavior, and retraining cannot act within minutes while labels accumulate.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✓
Route traffic back to the prior model version by toggling the feature flag, while continuing shadow-mode evaluation of the new version
Why this is correct
Feature flags decouple model selection from code deployment, so toggling the flag instantly shifts live traffic to the previous artifact. Running the new version in shadow mode preserves data collection and evaluation without exposing customers to degraded precision, satisfying both the fast-rollback and continued-learning requirements without a redeploy.
- ✗
Lower the model's decision threshold so fewer transactions are flagged as fraudulent
Why it's wrong here
Adjusting the threshold changes the precision-recall tradeoff but does not restore the previously validated model behavior, and it can mask the underlying regression. It also alters the operating point the business approved, and it provides no mechanism to continue evaluating the new version, so it fails the stated requirements.
- ✗
Keep the new model live and immediately retrain it on the most recent labeled fraud cases
Why it's wrong here
Retraining takes time to gather labels, train, and validate, so degraded precision would persist in the interim. Keeping the flawed version live exposes the business to continued harm and violates the minutes-level recovery goal. Retraining is a follow-up action, not a substitute for immediate traffic rollback.
- ✗
Rebuild the container image with the prior model artifact and redeploy through the CI/CD pipeline
Why it's wrong here
Rebuilding and redeploying through CI/CD takes far longer than the minutes-long requirement, and it discards the ability to keep evaluating the new version in production. The scenario explicitly asks to avoid code redeployment, so this slower path fails the recovery-time objective even though it would eventually restore prior behavior.
About these practice questions
This AI0-001 question is part of Courseiva's 962-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written and reviewed by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
Last reviewed September 2026 · checked against the official CompTIA exam blueprint
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.