easyMultiple ChoiceObjective-mapped
Detecting Training-Serving Skew in Vertex AI Model Monitoring
A data scientist trained a model on historical data from 2020-2022 and deployed it in January 2023. In February 2023, the model's accuracy drops significantly. Which monitoring metric would most likely indicate the root cause?
Quick Answer
The answer is Vertex AI Model Monitoring’s training-serving skew detection. This is correct because training-serving skew occurs when the distribution of input features at serving time diverges from the training data distribution—exactly what happens when a model trained on 2020–2022 data encounters real-world shifts in February 2023, such as seasonal patterns or new user behaviors. On the Google Professional Machine Learning Engineer exam, this scenario tests your understanding of monitoring metrics that diagnose root causes of accuracy drops, distinguishing skew from drift or data quality issues. A common trap is confusing training-serving skew with concept drift; remember that skew compares serving data to the training set, while drift compares current serving data to a reference window. For a quick memory tip: think “skew = serving vs. training,” and if your model’s accuracy tanks after deployment, always check the input distribution first.
⚠ Common exam trap
Google Cloud often tests the distinction between model performance metrics (accuracy, precision) and operational metrics (latency, throughput, user count), and the trap here is that candidates may confuse a drop in accuracy with a system-level issue like latency or missing values, rather than recognizing that accuracy degradation is most directly linked to data distribution shifts (skew).
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Training-serving skew detected by Vertex AI Model Monitoring.
Vertex AI Model Monitoring specifically detects training-serving skew, which occurs when the distribution of input features at serving time differs from the training data distribution. Since the model was trained on 2020-2022 data and deployed in January 2023, a significant accuracy drop in February 2023 likely indicates that the real-world data distribution has shifted (e.g., seasonal patterns, new user behavior), causing the model to encounter unseen patterns. This skew is a common root cause of performance degradation and is directly monitored by Vertex AI's skew detection feature.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Number of unique users calling the endpoint.
Why it's wrong here
User count unrelated to accuracy.
- ✗
Prediction latency p99.
Why it's wrong here
Latency does not explain accuracy drop.
- ✗
Number of missing feature values in requests.
Why it's wrong here
Missing values might cause errors, not accuracy drop.
- ✓
Training-serving skew detected by Vertex AI Model Monitoring.
Why this is correct
Skew indicates that serving data distribution differs from training data, likely causing accuracy drop.
Go deeper
Related to this question
About these practice questions
Courseiva writes every PMLE question from scratch — 990 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
Same concept, more angles
2 more ways this is tested on PMLE
These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.
Variation 1. A data science team has deployed a model on Vertex AI and wants to automatically detect when the distribution of a specific feature shifts significantly from the training data. Which service should they use?
easy- A.Cloud Data Loss Prevention
- ✓ B.Vertex AI Model Monitoring
- C.Vertex AI Explainable AI
- D.Cloud Composer
Why B: Vertex AI Model Monitoring is the correct service because it is specifically designed to detect feature distribution drift (skew) between training and serving data for deployed models. It continuously monitors the input features and alerts when statistical metrics like the Jensen-Shannon divergence or the L-infinity distance exceed a configured threshold, enabling proactive model retraining.
Variation 2. A company deploys a classification model on Vertex AI for loan approval. After a month, they notice the precision has dropped significantly. What should they do first?
medium- A.Retrain the model with more data
- B.Increase the number of prediction nodes
- ✓ C.Check for data drift using Vertex AI Model Monitoring
- D.Revert to the previous model version
Why C: A sudden drop in precision indicates that the model's predictions are no longer aligning with the ground truth, which is a classic symptom of data drift. Vertex AI Model Monitoring can automatically detect drift in feature distributions or prediction output compared to a baseline, allowing you to identify the root cause before taking corrective action. Retraining or reverting without first diagnosing the drift could waste resources or mask the underlying issue.
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This PMLE practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the PMLE exam.