The answer is too large window accumulation in streaming mode, but for a batch job the most common cause is a hot key in a GroupByKey operation. This occurs because Dataflow’s SDK buffers all values for a single key into memory on one worker before emitting the grouped result; when that key’s associated data exceeds the worker’s available heap, an OutOfMemoryError is thrown. On the Google Professional Data Engineer exam, this scenario tests your understanding of how data skew and memory pressure interact in Beam’s batch execution model—a common trap is confusing streaming window accumulation with batch-side hot keys, since both can cause OOM but through different mechanisms. Remember the memory tip: “Hot key, cold memory” — a single oversized key can freeze your pipeline.
PDE Practice Question: Building and operationalizing data processing systems
This PDE practice question tests your understanding of building and operationalizing data processing systems. The scenario asks you to isolate a root cause — eliminate options that address a different problem before choosing. After answering, compare your reasoning against the explanation and wrong-answer breakdown below. Once you have made your selection, read the full explanation to reinforce the concept and understand why each distractor is designed to mislead on exam day.
A Dataflow batch job frequently fails with 'OutOfMemoryError'. Which THREE are common causes? (Choose 3)
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Inefficient GroupByKey with hot keys
Option B is correct because a hot key in a GroupByKey operation causes all values for that key to be processed by a single worker, leading to memory exhaustion when the key's associated data exceeds the worker's memory capacity. This is a common cause of OutOfMemoryError in Dataflow batch jobs, as the SDK buffers all values for a key before emitting the result.
Key principle: Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
✗
Too many parallel workers
Why it's wrong here
More workers distribute work and reduce memory per worker, not a direct cause of OOM.
✓
Inefficient GroupByKey with hot keys
Why this is correct
Hot keys cause all values to be processed by a single worker, leading to memory exhaustion.
Related concept
Read the scenario before looking for a memorised answer.
✓
Too many side inputs
Why this is correct
Large or numerous side inputs can be broadcast to all workers, exhausting memory.
Related concept
Read the scenario before looking for a memorised answer.
✓
Too large window accumulation in streaming mode
Why this is correct
Accumulating large windows (e.g., global window) can cause unbounded state growth, leading to OOM.
Related concept
Read the scenario before looking for a memorised answer.
✗
Using Dataflow Shuffle
Why it's wrong here
Dataflow Shuffle offloads shuffle operations to a managed service, reducing memory usage on workers.
Common exam traps
Common exam trap: answer the scenario, not the keyword
Google Cloud often tests the misconception that increasing parallelism (Option A) always reduces memory errors, but in Dataflow, hot keys cause memory issues regardless of worker count because the hot key's data is processed by a single worker.
Detailed technical explanation
How to think about this question
Under the hood, GroupByKey uses a hash-based partitioning scheme; when a hot key exists, all elements with that key are routed to the same worker and must be held in memory until the grouping completes. In batch mode, this can trigger OutOfMemoryError even with moderate data sizes if the key skew is severe, as the SDK does not spill to disk for in-memory grouping by default. Real-world scenarios include log aggregation where a single user ID generates millions of events.
KKey Concepts to Remember
Read the scenario before looking for a memorised answer.
Find the constraint that changes the correct option.
Eliminate answers that are true in general but not in this case.
TExam Day Tips
→Watch for words such as best, first, most likely and least administrative effort.
→Review why wrong options are wrong, not only why the correct option is correct.
Key takeaway
Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Real-world example
How this comes up in practice
A company's IT admin needs to give a contractor read-only access to production logs without sharing account credentials. Using role-based access control (RBAC) and temporary scoped permissions — not a permanent shared password — is the correct pattern. Questions like this test whether you can apply least-privilege access across cloud identity services.
What to study next
Got this wrong? Here's your next step.
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
Building and operationalizing data processing systems — This question tests Building and operationalizing data processing systems — Read the scenario before looking for a memorised answer..
What is the correct answer to this question?
The correct answer is: Inefficient GroupByKey with hot keys — Option B is correct because a hot key in a GroupByKey operation causes all values for that key to be processed by a single worker, leading to memory exhaustion when the key's associated data exceeds the worker's memory capacity. This is a common cause of OutOfMemoryError in Dataflow batch jobs, as the SDK buffers all values for a key before emitting the result.
What should I do if I get this PDE question wrong?
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
What is the key concept behind this question?
Read the scenario before looking for a memorised answer.
About these practice questions
Courseiva creates original exam-style practice questions with explanations and wrong-answer analysis. It does not publish real exam questions, exam dumps, or protected exam content. Learn why practice questions differ from exam dumps →
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
This PDE practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the PDE exam.
Question Discussion
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
Sign in to join the discussion.