Cloud Digital Leader Google Cloud Products and Services Practice Question
A data engineering team needs to process streaming data from Cloud Pub/Sub, perform transformations, and write the results to BigQuery. The team requires exactly-once processing semantics and automatic scaling. Which service should they use?
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Cloud Dataflow
Dataflow (Apache Beam) provides exactly-once processing, autoscaling, and native integration with Pub/Sub and BigQuery for streaming pipelines. Cloud Dataproc is for batch Spark/Hadoop, not streaming. Cloud Functions processes events one at a time without exactly-once guarantees across a pipeline. BigQuery itself does not transform streaming data.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Cloud Functions
Why it's wrong here
Cloud Functions is event-driven and serverless, but it is designed for short-lived, single-event triggers rather than continuous streaming pipelines. It does not provide exactly-once processing guarantees across multiple invocations, lacks native support for windowing, watermarks, or stateful aggregations, and would require significant custom code to manage checkpoints and replay. For a streaming workload with transformations and reliable delivery, Cloud Functions is not a suitable processing engine.
- ✓
Cloud Dataflow
Why this is correct
Cloud Dataflow is a fully managed, unified stream and batch processing service built on Apache Beam. It provides exactly-once processing guarantees, automatic scaling, and powerful primitives for event-time processing, windowing, and triggers. With native Pub/Sub and BigQuery I/O connectors, Dataflow can ingest streaming data directly from Pub/Sub, apply complex transformations, and write results to BigQuery without additional glue code, making it the correct choice for this use case.
- ✗
Cloud Dataproc
Why it's wrong here
Cloud Dataproc is a managed service for running Apache Spark, Hadoop, Flink, and other open-source frameworks, primarily oriented toward batch and large-scale data processing. While Spark Streaming or Structured Streaming can be run on Dataproc, doing so requires you to manage cluster lifecycle, achieve exactly-once semantics through extra configuration and external state stores, and handle autoscaling for streaming workloads manually. It is less well integrated with Pub/Sub and BigQuery compared to Dataflow, and adds operational overhead for a streaming ET pipeline, so it is not the best fit here.
- ✗
BigQuery
Why it's wrong here
BigQuery is a serverless, highly scalable data warehouse designed for SQL-based analytics on massive datasets, not for executing arbitrary streaming transformations. Although it can receive streaming data via the Storage Write API and is often the sink in a streaming pipeline, it lacks the ability to perform event-time joins, stateful aggregations, user-defined functions over stream events, or complex event-driven transformations. Relying on BigQuery alone would force you to implement streaming processing logic outside the warehouse, so it is not a processing engine for this scenario.
Quick reference
Cloud Service Model Comparison
| Model | You Manage | Provider Manages | Examples |
|---|---|---|---|
| IaaS | OS, runtime, apps, data | Hardware, hypervisor, networking | EC2, Azure VMs, GCP Compute Engine |
| PaaS | Apps and data | OS, runtime, middleware, hardware | Elastic Beanstalk, Azure App Service |
| SaaS | Data and settings only | Everything else | Microsoft 365, Salesforce, Workday |
| FaaS / Serverless | Function code only | Infra, scaling, runtime | Lambda, Azure Functions, Cloud Run |
| CaaS | Containers and apps | Kubernetes, OS, hardware | EKS, AKS, GKE |
Go deeper
Related to this question
Learn chapter
Cloud Digital Transformation
Key term
Batch
Batch is a cloud computing service that runs large numbers of computing jobs as a group, or batch, without needing to manage individual servers.
Key term
Pub/Sub
Pub/Sub is a messaging pattern where publishers send messages without knowing who receives them, and subscribers receive only the messages they care about.
About these practice questions
Courseiva writes every GCDL question from scratch — 829 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This GCDL practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the GCDL exam.