mediumMultiple Choice
Detecting Training-Serving Skew in Vertex AI Model Monitoring
A company deploys a classification model on Vertex AI for loan approval. After a month, they notice the precision has dropped significantly. What should they do first?
⚠ Common exam trap
Google Cloud often tests the misconception that any performance degradation should be immediately fixed by retraining or rolling back, rather than first diagnosing the cause through monitoring tools like Vertex AI Model Monitoring.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Check for data drift using Vertex AI Model Monitoring
A sudden drop in precision indicates that the model's predictions are no longer aligning with the ground truth, which is a classic symptom of data drift. Vertex AI Model Monitoring can automatically detect drift in feature distributions or prediction output compared to a baseline, allowing you to identify the root cause before taking corrective action. Retraining or reverting without first diagnosing the drift could waste resources or mask the underlying issue.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Retrain the model with more data
Why it's wrong here
Retraining is a remediation step, not diagnosis; without first confirming data drift or label changes, new data may reproduce the same precision loss. Retraining would be correct once analysis identifies the cause, for example confirmed feature drift or concept drift in recent loan outcomes.
- ✗
Increase the number of prediction nodes
Why it's wrong here
Adding prediction nodes raises serving throughput and reduces latency; it cannot restore precision, which is a model-quality metric unaffected by horizontal scaling. Node scaling would be correct if the symptom were timeouts or queueing under increased request volume, not a drop in classification accuracy.
- ✓
Check for data drift using Vertex AI Model Monitoring
Why this is correct
Precision degradation after deployment typically stems from the input distribution shifting away from training data. Vertex AI Model Monitoring computes drift against the training baseline, so checking it first identifies whether feature distributions have moved, directly addressing the drop in precision before retraining or tuning.
- ✗
Revert to the previous model version
Why it's wrong here
Reverting restores prior behaviour but discards the cause; if drift is ongoing, the old model will also degrade, and rollback may breach audit requirements. Reverting would be correct when a recent deployment introduced the regression and the previous version remains valid for current data.
Go deeper
Related to this question
About these practice questions
Courseiva writes every PMLE question from scratch — 775 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
Same concept, more angles
1 more way this is tested on PMLE
These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.
Variation 1. A data science team has deployed a model on Vertex AI and wants to automatically detect when the distribution of a specific feature shifts significantly from the training data. Which service should they use?
easy- A.Cloud Data Loss Prevention
- ✓ B.Vertex AI Model Monitoring
- C.Vertex AI Explainable AI
- D.Cloud Composer
Why B: Vertex AI Model Monitoring is the correct service because it is specifically designed to detect feature distribution drift (skew) between training and serving data for deployed models. It continuously monitors the input features and alerts when statistical metrics like the Jensen-Shannon divergence or the L-infinity distance exceed a configured threshold, enabling proactive model retraining.
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This PMLE practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the PMLE exam.