Generative AI Leader Practice Question: Business Strategies for Generative AI Solutions
A large insurance company is using generative AI to automate claims processing. They have deployed a custom fine-tuned model on Vertex AI that reads claim documents and extracts key information. Recently, they noticed that the model’s performance degrades over time for certain claim types, leading to incorrect payouts. The team needs to detect and address model drift with minimal manual intervention. They have a data pipeline that captures incoming claims and user feedback on predictions. Which approach should they take?
⚠ Common exam trap
Google Cloud often tests the misconception that periodic manual retraining (Option D) is sufficient, but the trap here is that it ignores the need for real-time drift detection and automated response, which is essential for production systems handling high-stakes financial decisions.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Set up continuous evaluation with automated retraining pipelines based on performance metrics
It establishes a closed-loop MLOps pipeline where continuous evaluation of performance metrics (e.g., precision, recall, or F1-score on streaming data) triggers automated retraining when drift is detected. This minimizes manual intervention while ensuring the model adapts to distribution shifts in claim types, which is critical for maintaining accurate payouts in production.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Implement a human review process for all claims the model processes
Why it's wrong here
Does not scale to large volumes and delays processing.
- ✓
Set up continuous evaluation with automated retraining pipelines based on performance metrics
Why this is correct
Automates drift detection and model updates with minimal manual intervention.
- ✗
Switch to a simpler rule-based system to avoid drift
Why it's wrong here
Rule-based systems are less accurate and still require maintenance.
- ✗
Manually retrain the model monthly using a snapshot of recent claims
Why it's wrong here
Monthly retraining may be too infrequent to catch drift timely.
Go deeper
Related to this question
About these practice questions
This Generative AI Leader question is part of Courseiva's 683-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This Generative AI Leader practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the Generative AI Leader exam.