PDE Designing Data Processing Systems Practice Question
Your data engineering team needs to process a continuous stream of clickstream events from a website and update a real-time dashboard showing user activity over the last hour. The pipeline should have minimal operational overhead and support exactly-once processing semantics. Which Google Cloud service should you use?
⚠ Common exam trap
The trap is equating 'streaming' with any managed service — candidates pick Dataproc or Pub/Sub Lite because they sound real-time, but only Dataflow provides managed exactly-once stream processing with windowing.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Cloud Dataflow with Apache Beam
Cloud Dataflow with Apache Beam is Google's fully managed, serverless stream and batch processing service, and Beam provides built-in exactly-once semantics for streaming pipelines. It integrates natively with Pub/Sub for ingestion and supports windowing, triggers, and state for real-time aggregations like a rolling 1-hour user activity view. Because Dataflow is fully managed, it meets the 'minimal operational overhead' requirement without cluster management.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Cloud Dataproc with Apache Spark Streaming
Why it's wrong here
Dataproc requires you to provision and tune clusters, so operational overhead is not minimal, and Spark Streaming's exactly-once guarantees need extra checkpointing configuration. It is tempting because it runs Apache Spark workloads, and would be correct for migrating existing Spark jobs or batch and ML processing needing cluster control.
- ✗
Cloud Data Fusion with batch pipelines
Why it's wrong here
Data Fusion batch pipelines run on scheduled or triggered executions rather than consuming a continuous event stream, so the last-hour dashboard would not update in real time. It is tempting because it offers a graphical, low-code integration canvas, and would be correct for scheduled batch ingestion between systems.
- ✓
Cloud Dataflow with Apache Beam
Why this is correct
Cloud Dataflow with Apache Beam provides serverless, autoscaling stream processing with exactly-once semantics via its streaming engine, satisfying the minimal operational overhead and exactly-once constraints. Beam's windowing and triggers handle the rolling one-hour dashboard aggregation over continuous clickstream events.
- ✗
Cloud Pub/Sub Lite with push subscriptions
Why it's wrong here
Pub/Sub Lite provides at-least-once delivery, so it cannot satisfy the exactly-once requirement; its zonal capacity model also adds operational overhead. It is tempting because Lite suits high-volume, cost-sensitive streaming where occasional duplicates are tolerable, but the dashboard's exactly-once semantics demand standard Pub/Sub.
Quick reference
Cloud Service Model Comparison
| Model | You Manage | Provider Manages | Examples |
|---|---|---|---|
| IaaS | OS, runtime, apps, data | Hardware, hypervisor, networking | EC2, Azure VMs, GCP Compute Engine |
| PaaS | Apps and data | OS, runtime, middleware, hardware | Elastic Beanstalk, Azure App Service |
| SaaS | Data and settings only | Everything else | Microsoft 365, Salesforce, Workday |
| FaaS / Serverless | Function code only | Infra, scaling, runtime | Lambda, Azure Functions, Cloud Run |
| CaaS | Containers and apps | Kubernetes, OS, hardware | EKS, AKS, GKE |
Go deeper
Related to this question
About these practice questions
This PDE question is part of Courseiva's 747-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written and reviewed by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
Last reviewed September 2026 · checked against the official Google Cloud exam blueprint
This PDE practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the PDE exam.