The answer is that the worker machine type has insufficient memory for the message size and throughput. This is the most likely cause of a Dataflow out-of-memory error because each worker’s JVM heap must accommodate all in-flight data during processing, including elements held for windowing, shuffling, and stateful operations. When messages are large or the throughput is high, the memory required to buffer these elements exceeds the worker’s allocated heap, triggering an OOM error. On the Google Professional Data Engineer exam, this scenario tests your understanding of pipeline resource sizing and the trade-off between worker count and machine type; a common trap is to assume that increasing the number of workers alone will solve memory issues, but if each worker’s memory is too small for the data volume, OOM errors persist. For a quick memory tip, remember “Big data needs big workers”—always match the worker machine type’s memory to the peak message size and throughput, not just the total data volume.
PDE Designing data processing systems Practice Question
This PDE practice question tests your understanding of designing data processing systems. Read the scenario carefully and evaluate each option against the stated constraints before committing to an answer. After answering, compare your reasoning against the explanation and wrong-answer breakdown below. Once you have made your selection, read the full explanation to reinforce the concept and understand why each distractor is designed to mislead on exam day.
Exhibit
Refer to the exhibit.
```
# Dataflow pipeline error log:
Workflow failed. Causes: S02:ReadPubSub/Read+Transform/ParDo(ExtractTimestamps)+ ... (4b9c3d2e)
The job failed because a worker experienced a "out of memory" error.
```
Pipeline configuration:
- Streaming engine: disabled
- Worker machine type: n1-standard-4 (4 vCPU, 15 GB memory)
- Number of workers: 2 (autoscaling enabled, max 10)
- Input: Pub/Sub topic with 1000 messages/sec, each message ~50 KB
- Transform: Parse JSON, enrich with external API call, window into 1-minute fixed windows, write to BigQuery
Based on the exhibit, what is the most likely cause of the out-of-memory error?
Clue words in this question
Noticing these words before you look at the options changes how you read each choice.
Clue: "most likely"
Why it matters: Probability qualifier — the question wants the most probable cause or outcome, not a guaranteed one. Eliminate low-probability options.
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
The worker machine type has insufficient memory for the message size and throughput.
The out-of-memory error in a Dataflow pipeline is most likely caused by the worker machine type having insufficient memory for the message size and throughput. When messages are large or the throughput is high, each worker must hold data in memory for processing, windowing, and shuffling. If the worker's memory is too small, the JVM heap runs out of memory, leading to an OOM error.
Key principle: Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
✗
The BigQuery output table schema does not match the transformed data, causing write failures.
Why it's wrong here
Schema mismatches cause errors but not OOM; they would be caught earlier.
✗
The Pub/Sub subscription is not acknowledging messages quickly enough, causing a backlog.
Why it's wrong here
A backlog would cause latency, but OOM is more likely due to memory pressure from large messages.
✓
The worker machine type has insufficient memory for the message size and throughput.
Why this is correct
Large messages (50 KB) and high throughput (1000/sec) require more memory; n1-standard-4 may be undersized.
Clue confirmation
The clue word "most likely" in the question point toward this answer.
Related concept
Read the scenario before looking for a memorised answer.
✗
The fixed window duration of 1 minute is too short, causing excessive state overhead.
Why it's wrong here
Shorter windows actually reduce state size; the issue is per-message memory, not windowed state.
Common exam traps
Common exam trap: answer the scenario, not the keyword
Google Cloud often tests the misconception that OOM errors are caused by schema mismatches or Pub/Sub backlogs, but the real cause is almost always insufficient worker memory for the data volume.
Detailed technical explanation
How to think about this question
In Apache Beam (used by Dataflow), each worker runs a JVM that allocates heap memory for processing elements, windowing, and shuffle operations. When the total data in flight exceeds the worker's memory capacity, the JVM throws an OutOfMemoryError. This is often mitigated by choosing a machine type with more memory (e.g., n1-highmem) or by enabling autoscaling and adjusting the max worker count. The error typically appears in the worker logs as 'java.lang.OutOfMemoryError: Java heap space'.
KKey Concepts to Remember
Read the scenario before looking for a memorised answer.
Find the constraint that changes the correct option.
Eliminate answers that are true in general but not in this case.
TExam Day Tips
→Watch for words such as best, first, most likely and least administrative effort.
→Review why wrong options are wrong, not only why the correct option is correct.
Key takeaway
Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Real-world example
How this comes up in practice
An e-commerce site experiences heavy traffic on Black Friday and near-zero traffic during off-peak weeks. Rather than provisioning permanent large VMs, the team uses auto-scaling groups that add capacity automatically under load and reduce it overnight. Questions like this test whether you understand elasticity, availability zones, and cloud compute scaling patterns.
What to study next
Got this wrong? Here's your next step.
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
Designing data processing systems — This question tests Designing data processing systems — Read the scenario before looking for a memorised answer..
What is the correct answer to this question?
The correct answer is: The worker machine type has insufficient memory for the message size and throughput. — The out-of-memory error in a Dataflow pipeline is most likely caused by the worker machine type having insufficient memory for the message size and throughput. When messages are large or the throughput is high, each worker must hold data in memory for processing, windowing, and shuffling. If the worker's memory is too small, the JVM heap runs out of memory, leading to an OOM error.
What should I do if I get this PDE question wrong?
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
Are there clue words in this question I should notice?
Yes — watch for: "most likely". Probability qualifier — the question wants the most probable cause or outcome, not a guaranteed one. Eliminate low-probability options.
What is the key concept behind this question?
Read the scenario before looking for a memorised answer.
About these practice questions
Courseiva creates original exam-style practice questions with explanations and wrong-answer analysis. It does not publish real exam questions, exam dumps, or protected exam content. Learn why practice questions differ from exam dumps →
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
This PDE practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the PDE exam.
Question Discussion
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
Sign in to join the discussion.