The correct answer is to switch to GPU instances like n1-standard-4 with T4 and set min replicas=2 with autoscaling up to 10. This solves the traffic spike bottleneck because deep learning inference for product recommendations is compute-intensive and parallelizable; GPUs dramatically reduce per-request latency by offloading matrix operations from the CPU, while raising the minimum replica count ensures warm instances are always available, preventing the cold-start delays that caused autoscaling to trigger too slowly. On the Google Professional Machine Learning Engineer exam, this scenario tests your understanding of Vertex AI Prediction’s autoscaling behavior under sudden load—a common trap is assuming that simply increasing max replicas or raising CPU thresholds will fix latency, when the real issue is the inference hardware itself. Remember the memory tip: “GPU for heavy inference, min replicas for instant defense”—the combination of hardware acceleration and pre-warmed capacity is what handles Black Friday spikes without timeout.
PMLE Serving and scaling models Practice Question
This PMLE practice question tests your understanding of serving and scaling models. Read the scenario carefully and evaluate each option against the stated constraints before committing to an answer. After answering, compare your reasoning against the explanation and wrong-answer breakdown below. Once you have made your selection, read the full explanation to reinforce the concept and understand why each distractor is designed to mislead on exam day.
You are an ML engineer at a global e-commerce company. Your team has developed a deep learning model for product recommendation that runs on Vertex AI Prediction. The model is deployed on a single n1-highmem-2 instance (CPU only) with autoscaling enabled (min replicas=1, max replicas=10). During Black Friday, traffic spikes to 1000 requests per second (QPS), and you observe that latency increases from 50ms to over 5000ms, and many requests time out. You check the monitoring dashboard and see that CPU utilization is at 100% on the single instance, and autoscaling is not triggering quickly enough. The team has a budget for this service and wants to handle the spike without compromising latency. What should you do?
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Switch to GPU instances (e.g., n1-standard-4 with T4) and set min replicas=2 with autoscaling up to 10
Option A is correct because switching to GPU instances (n1-standard-4 with T4) offloads compute-intensive recommendation model inference to GPUs, significantly reducing per-request latency. Setting min replicas=2 ensures that at least two instances are always warm, reducing cold-start delays and allowing autoscaling to handle traffic spikes more responsively. This combination addresses both the CPU bottleneck and the slow scaling trigger, keeping latency under 50ms even at 1000 QPS.
Key principle: Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
✓
Switch to GPU instances (e.g., n1-standard-4 with T4) and set min replicas=2 with autoscaling up to 10
Read the scenario before looking for a memorised answer.
✗
Increase min replicas to 5 to keep warm instances
Why it's wrong here
Without improving per-instance throughput, warm instances may still be insufficient.
✗
Set min replicas=1 and max replicas=5 to control cost
Why it's wrong here
Limiting max replicas may not handle the spike.
✗
Increase max replicas to 20 and keep CPU instances
Why it's wrong here
CPU instances have high latency per request; more replicas may not reduce latency enough.
Common exam traps
Common exam trap: answer the scenario, not the keyword
Google Cloud often tests the misconception that simply increasing the number of CPU instances or adjusting autoscaling parameters can solve a CPU-bound latency problem, when the real fix is to change the compute architecture (e.g., GPU) to match the workload's computational profile.
Detailed technical explanation
How to think about this question
GPU instances like n1-standard-4 with T4 leverage CUDA cores for parallel matrix operations common in deep learning inference, achieving 10-100x speedup over CPU for models like transformers or embeddings. Autoscaling in Vertex AI uses CPU utilization as a default metric; with GPU offloading, CPU utilization drops, allowing the autoscaler to react more quickly and accurately to traffic spikes. In practice, setting min replicas=2 ensures that the autoscaler does not scale down to zero, avoiding the cold-start penalty that can add seconds of latency when a new instance spins up.
KKey Concepts to Remember
Read the scenario before looking for a memorised answer.
Find the constraint that changes the correct option.
Eliminate answers that are true in general but not in this case.
TExam Day Tips
→Watch for words such as best, first, most likely and least administrative effort.
→Review why wrong options are wrong, not only why the correct option is correct.
Key takeaway
Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Real-world example
How this comes up in practice
A startup's cloud architect reviews their monthly bill and notices costs are higher than expected for a long-running batch job. Switching from on-demand instances to Reserved Instances — or using Spot/Preemptible VMs — can reduce compute costs by up to 72 %. Questions like this test whether you understand the tradeoffs between commitment, flexibility, and cost across cloud pricing models.
What to study next
Got this wrong? Here's your next step.
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
Serving and scaling models — This question tests Serving and scaling models — Read the scenario before looking for a memorised answer..
What is the correct answer to this question?
The correct answer is: Switch to GPU instances (e.g., n1-standard-4 with T4) and set min replicas=2 with autoscaling up to 10 — Option A is correct because switching to GPU instances (n1-standard-4 with T4) offloads compute-intensive recommendation model inference to GPUs, significantly reducing per-request latency. Setting min replicas=2 ensures that at least two instances are always warm, reducing cold-start delays and allowing autoscaling to handle traffic spikes more responsively. This combination addresses both the CPU bottleneck and the slow scaling trigger, keeping latency under 50ms even at 1000 QPS.
What should I do if I get this PMLE question wrong?
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
What is the key concept behind this question?
Read the scenario before looking for a memorised answer.
About these practice questions
Courseiva creates original exam-style practice questions with explanations and wrong-answer analysis. It does not publish real exam questions, exam dumps, or protected exam content. Learn why practice questions differ from exam dumps →
These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.
Variation 1. You need to serve a TensorFlow model that has a cold start latency of 20 seconds. The model is used for a real-time application with unpredictable traffic, but occasional bursts require immediate responses. What is the best deployment strategy to minimize both cold start impact and cost?
easy
✓ A.Set min_replica_count to 1 to keep at least one instance always warm.
B.Use a larger machine type to reduce cold start time.
C.Set min_replica_count to 0 and rely on autoscaling to handle bursts.
D.Enable serving on Cloud Run for faster cold start.
Why A: Setting a minimum number of replicas (min_replica_count) ensures that some instances are always warm, avoiding cold start for the first requests. This balances cost and latency. Prewarming requests or increasing target utilization wouldn't help directly.
Variation 2. A company is serving a model for their e-commerce website. They expect traffic to be low at night and very high during flash sales. They want to minimize costs while ensuring availability during spikes. Which autoscaling configuration should they use?
Why B: Setting a high max_replica_count allows scaling to handle spikes, while a low min_replica_count saves cost during low traffic. CPU utilization target of 60% is reasonable.
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
This PMLE practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the PMLE exam.
Question Discussion
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
Sign in to join the discussion.