hardMultiple Select
PMLE Practice Question: A company uses Vertex AI Model Monitoring to…
A company uses Vertex AI Model Monitoring to detect training-serving skew. They have a categorical feature 'product_category' with high cardinality. The monitoring job alerts for skew, but the data scientists believe the model performance is still acceptable. Which THREE actions should the team take to investigate and resolve the alert?
⚠ Common exam trap
Google Cloud often tests the misconception that a model's aggregate performance metrics (e.g., AUC) are sufficient to dismiss drift alerts, but the trap is that drift can be localized to specific segments without affecting overall metrics, requiring per-segment evaluation.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Examine which categories have the largest distribution changes to understand the nature of the shift.
Examining which categories have the largest distribution changes allows the team to pinpoint the root cause of the training-serving skew. In Vertex AI Model Monitoring, the skew alert is based on statistical distance metrics (e.g., Jensen-Shannon divergence) between training and serving distributions. By drilling down into the specific categories driving the divergence, the team can assess whether the shift is benign (e.g., seasonal) or problematic, rather than relying on aggregate model performance alone.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✓
Examine which categories have the largest distribution changes to understand the nature of the shift.
Why this is correct
Identifying specific categories helps assess whether the drift is due to seasonal effects or other benign causes.
- ✓
Adjust the alerting threshold based on historical drift patterns to reduce noise.
Why this is correct
Tuning thresholds helps filter out inconsequential drift.
- ✓
Compare model performance metrics (e.g., AUC) on the drifted segment vs. the non-drifted segment.
Why this is correct
Segment-level performance analysis determines if drift is actually harmful.
- ✗
Remove the drifted categories from the feature set to eliminate the alert.
Why it's wrong here
Removing categories reduces model information and could degrade performance.
- ✗
Ignore the alert because the model is performing well; monitoring alerts are often false positives.
Why it's wrong here
Ignoring alerts is not recommended; the team should investigate to confirm it's a false positive.
Visual reference
Go deeper
Related to this question
About these practice questions
Courseiva writes every PMLE question from scratch — 775 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This PMLE practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the PMLE exam.