PDE Designing Data Processing Systems Practice Question
A company needs to process streaming sensor data from millions of devices with sub-second latency, apply transformations, and write results to BigQuery for real-time dashboards. The data volume varies, and they want to avoid managing servers. Which service should they use?
⚠ Common exam trap
PDE often tests the distinction between serverless, streaming-native Dataflow and cluster-based or batch-oriented tools like Dataproc, Data Fusion, and Dataprep, causing candidates to pick Dataproc for 'streaming' because Spark Streaming sounds similar, or Data Fusion because it's an ETL tool.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Dataflow
Dataflow is Google Cloud's fully managed, serverless data processing service built on Apache Beam, designed for both batch and streaming pipelines with exactly-once processing semantics. It natively supports streaming ingestion from Pub/Sub or Kafka, applies transformations via Beam's windowing/triggers, and can write directly to BigQuery using the BigQueryIO connector with streaming inserts or Storage Write API. Its autoscaling (Horizontal Autoscaling and Streaming Engine) handles variable data volumes without server management, making it the only option that meets sub-second latency, serverless, and BigQuery streaming requirements simultaneously.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Cloud Data Fusion
Why it's wrong here
Cloud Data Fusion is a managed CDAP service for batch and micro-batch ETL pipelines, not sub-second stream processing; its execution model cannot meet the latency requirement. It is tempting because it orchestrates transformations visually, and it would be correct for scheduled batch ingestion into BigQuery rather than continuous sensor streams.
- ✓
Dataflow
Why this is correct
Dataflow provides serverless, autoscaling stream processing with exactly-once semantics, satisfying the sub-second latency and variable-volume constraints. Its Apache Beam pipeline can transform sensor data and write directly into BigQuery via the built-in BigQueryIO connector, with no servers to manage.
- ✗
Dataproc
Why it's wrong here
Dataproc runs managed Spark and Hadoop clusters, which are batch-oriented and add cluster start-up latency, so it cannot meet sub-second streaming. It is tempting because it is serverless-capable and processes large volumes, and would be correct for batch analytics or lift-and-shift Hadoop workloads.
- ✗
Dataprep
Why it's wrong here
Dataprep is a serverless data-preparation tool for interactive, batch-style wrangling by analysts, not a sub-second streaming pipeline writing to BigQuery. It is tempting because it transforms data without server management, and would be correct for cleaning and profiling datasets before loading them.
Quick reference
Cloud Service Model Comparison
| Model | You Manage | Provider Manages | Examples |
|---|---|---|---|
| IaaS | OS, runtime, apps, data | Hardware, hypervisor, networking | EC2, Azure VMs, GCP Compute Engine |
| PaaS | Apps and data | OS, runtime, middleware, hardware | Elastic Beanstalk, Azure App Service |
| SaaS | Data and settings only | Everything else | Microsoft 365, Salesforce, Workday |
| FaaS / Serverless | Function code only | Infra, scaling, runtime | Lambda, Azure Functions, Cloud Run |
| CaaS | Containers and apps | Kubernetes, OS, hardware | EKS, AKS, GKE |
Go deeper
Related to this question
About these practice questions
This PDE question is part of Courseiva's 747-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written and reviewed by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
Last reviewed September 2026 · checked against the official Google Cloud exam blueprint
This PDE practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the PDE exam.