← PDE·Google Cloud

Question 297 of 499

Operationalizing machine learning models →hardMultiple ChoiceObjective-mapped

PDE Operationalizing machine learning models Practice Question

This PDE practice question tests your understanding of operationalizing machine learning models. Read the scenario carefully and evaluate each option against the stated constraints before committing to an answer. After answering, compare your reasoning against the explanation and wrong-answer breakdown below. Once you have made your selection, read the full explanation to reinforce the concept and understand why each distractor is designed to mislead on exam day.

Your Vertex AI model deployed on an endpoint is experiencing high tail latency during online predictions. The model uses a large embedding layer, and the input size varies. You have enabled automatic scaling with a minimum of 2 replicas and maximum of 10. What is the most likely cause of the latency spikes and the best first step to diagnose?

Clue words in this question

Noticing these words before you look at the options changes how you read each choice.

Clue: "best"
Why it matters: Signals that multiple options may be partially correct. Choose the option that most directly solves the exact problem described, not the one that sounds most complete.
Clue: "first"
Why it matters: Order matters here. You are being tested on which action comes before the others — not which action is generally useful.
Clue: "most likely"
Why it matters: Probability qualifier — the question wants the most probable cause or outcome, not a guaranteed one. Eliminate low-probability options.
Clue: "minimum / minimize"
Why it matters: Asks for the least resource use — fewest addresses, smallest subnet, lowest overhead. Eliminate over-provisioned options even if they would technically work.

Question 1hardmultiple choice

Full question →

A
The model's SavedModel is too large due to the embedding layer; reduce embedding dimensions to lower latency.
Why wrong: Model size affects latency but not necessarily tail spikes; scaling issue is more likely.
B
The endpoint's target CPU utilization might be set too low, causing rapid scale-down and cold starts. Check Cloud Logging for scaling events.
If target utilization is low, replicas scale down quickly; cold starts on new requests cause latency. Logs show scaling.
C
The model uses a custom prediction routine that is not optimized; use tf.function to improve performance.
Why wrong: Custom routines can add overhead but would need profiling first; scaling behavior is more probable.
D
Enable model monitoring for online prediction and add a buffer to the endpoint's machine type.
Why wrong: Model monitoring isn't diagnostic for latency; buffering may mask but not resolve cold starts.

Full breakdown with real-world context →

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

✓

The endpoint's target CPU utilization might be set too low, causing rapid scale-down and cold starts. Check Cloud Logging for scaling events.

High tail latency with variable input sizes and a large embedding layer often points to cold starts from aggressive scaling. When the target CPU utilization is set too low, the endpoint scales down quickly during lulls, and a subsequent burst of requests forces new replicas to spin up, causing latency spikes. Checking Cloud Logging for scaling events is the best first step because it directly reveals whether the endpoint is scaling down and then experiencing cold starts.

Key principle: Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

✗
The model's SavedModel is too large due to the embedding layer; reduce embedding dimensions to lower latency.
Why it's wrong here
Model size affects latency but not necessarily tail spikes; scaling issue is more likely.
✓
The endpoint's target CPU utilization might be set too low, causing rapid scale-down and cold starts. Check Cloud Logging for scaling events.
Why this is correct
If target utilization is low, replicas scale down quickly; cold starts on new requests cause latency. Logs show scaling.
Clue confirmation
The clue words "best", "first", "most likely", "minimum / minimize" in the question point toward this answer.
Related concept
Read the scenario before looking for a memorised answer.
✗
The model uses a custom prediction routine that is not optimized; use tf.function to improve performance.
Why it's wrong here
Custom routines can add overhead but would need profiling first; scaling behavior is more probable.
✗
Enable model monitoring for online prediction and add a buffer to the endpoint's machine type.
Why it's wrong here
Model monitoring isn't diagnostic for latency; buffering may mask but not resolve cold starts.

Common exam traps

Common exam trap: answer the scenario, not the keyword

Google Cloud often tests the misconception that high tail latency is always due to model size or inference optimization, when in fact the most common cause in managed serving environments is autoscaling misconfiguration leading to cold starts.

Detailed technical explanation

How to think about this question

Vertex AI endpoints use autoscaling based on the target CPU utilization metric (default 60%). When utilization drops below the target, the system scales down replicas, and a subsequent spike in requests triggers scale-up, which can take 30–60 seconds for model loading and container initialization. The large embedding layer exacerbates this because loading the model weights from Cloud Storage into memory is I/O-bound, making cold starts particularly slow. Checking Cloud Logging for 'scaling' or 'container' events under the endpoint's logs reveals the exact timing of scale-down and scale-up actions.

KKey Concepts to Remember

Read the scenario before looking for a memorised answer.
Find the constraint that changes the correct option.
Eliminate answers that are true in general but not in this case.

TExam Day Tips

Watch for words such as best, first, most likely and least administrative effort.
Review why wrong options are wrong, not only why the correct option is correct.

Key takeaway

Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.

Real-world example

How this comes up in practice

An e-commerce site experiences heavy traffic on Black Friday and near-zero traffic during off-peak weeks. Rather than provisioning permanent large VMs, the team uses auto-scaling groups that add capacity automatically under load and reduce it overnight. Questions like this test whether you understand elasticity, availability zones, and cloud compute scaling patterns.

What to study next

Got this wrong? Here's your next step.

Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.

Related PDE practice-question pages

Use these pages to review the topic behind this question. This is how one missed question becomes focused revision.

Designing data processing systems practice questions

Practise PDE questions linked to Designing data processing systems.

Building and operationalizing data processing systems practice questions

Practise PDE questions linked to Building and operationalizing data processing systems.

Operationalizing machine learning models practice questions

Practise PDE questions linked to Operationalizing machine learning models.

Ensuring solution quality practice questions

Practise PDE questions linked to Ensuring solution quality.

PDE fundamentals practice questions

Practise PDE questions linked to PDE fundamentals.

PDE scenario practice questions

Practise PDE questions linked to PDE scenario.

PDE troubleshooting practice questions

Practise PDE questions linked to PDE troubleshooting.

Practice this exam

Start a free PDE practice session

Short sessions build daily habit. Longer sessions build exam-day stamina. Try a timed session to simulate real conditions.

10 questions 20 questions 30 questions 50 questions Timed 30

PDE practice-test guide →Study guide →Browse all practice tests

FAQ

Questions learners often ask

What does this PDE question test?

Operationalizing machine learning models — This question tests Operationalizing machine learning models — Read the scenario before looking for a memorised answer..

What is the correct answer to this question?

The correct answer is: The endpoint's target CPU utilization might be set too low, causing rapid scale-down and cold starts. Check Cloud Logging for scaling events. — High tail latency with variable input sizes and a large embedding layer often points to cold starts from aggressive scaling. When the target CPU utilization is set too low, the endpoint scales down quickly during lulls, and a subsequent burst of requests forces new replicas to spin up, causing latency spikes. Checking Cloud Logging for scaling events is the best first step because it directly reveals whether the endpoint is scaling down and then experiencing cold starts.

What should I do if I get this PDE question wrong?

Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.

Are there clue words in this question I should notice?

Yes — watch for: "best", "first", "most likely", "minimum / minimize". Signals that multiple options may be partially correct. Choose the option that most directly solves the exact problem described, not the one that sounds most complete.

What is the key concept behind this question?

Read the scenario before looking for a memorised answer.

About these practice questions

Courseiva creates original exam-style practice questions with explanations and wrong-answer analysis. It does not publish real exam questions, exam dumps, or protected exam content. Learn why practice questions differ from exam dumps →

How Courseiva writes practice questions · Editorial policy

Keep practising

Question Discussion

Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.

Loading comments…

This PDE practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the PDE exam.