hardMultiple Choice
PMLE Practice Question: A team is monitoring a production ML system that…
A team is monitoring a production ML system that includes multiple models and data processing pipelines. They want to set up a comprehensive alerting strategy that minimizes false positives while ensuring critical issues are promptly addressed. Which approach is the most effective?
⚠ Common exam trap
Candidates often choose static thresholds (Option B) because they seem simpler and more predictable, but they fail to recognize that production ML systems require adaptive thresholds to handle dynamic data distributions and avoid alert fatigue.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Use AIOps with anomaly detection to dynamically adjust thresholds
AIOps with anomaly detection uses machine learning to dynamically adjust alert thresholds based on real-time system behavior, reducing false positives while ensuring critical issues are detected promptly. This approach adapts to changing data distributions and traffic patterns, unlike static thresholds that require manual tuning and often miss subtle anomalies. It is the most effective strategy for complex ML production systems where multiple models and pipelines interact, as it can correlate signals across components to identify genuine incidents.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Set up alerts for all possible error conditions
Why it's wrong here
Alerting on every possible error condition floods responders with non-actionable notifications, so genuine critical failures are buried and false positives rise sharply. It is tempting because exhaustive coverage feels thorough. Effective strategies alert on symptoms tied to user-facing SLOs, reserving pages for conditions requiring immediate human action.
- ✗
Use static thresholds based on historical data
Why it's wrong here
Static thresholds cannot track seasonal traffic, retraining cycles or gradual drift, so they fire during normal variation and stay silent as baselines shift. They suit stable, well-understood metrics with fixed limits. The stem's multiple models and pipelines need adaptive baselines or anomaly detection to separate real incidents from expected fluctuation.
- ✗
Rely on manual monitoring during business hours
Why it's wrong here
Manual business-hours monitoring leaves overnight and weekend failures undetected, directly contradicting the requirement that critical issues be addressed promptly. It is tempting because it avoids alert fatigue and needs no tooling. Automated alerting routed to on-call responders covers the full week and catches pipeline or model degradation as it occurs.
- ✓
Use AIOps with anomaly detection to dynamically adjust thresholds
Why this is correct
AIOps anomaly detection learns normal metric behaviour per model and pipeline, dynamically adjusting thresholds rather than relying on static values, which reduces false positives while still surfacing genuine deviations promptly across the many monitored signals.
Go deeper
Related to this question
About these practice questions
Courseiva writes every PMLE question from scratch — 775 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This PMLE practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the PMLE exam.