Cloud Digital Leader Google Cloud Products and Services Practice Question
A data engineering team is building a streaming pipeline that ingests clickstream events from a website, processes them in real-time (e.g., aggregations, filtering), and loads the results into BigQuery for analysis. They also need the ability to replay events in case of failures. Which combination of services is MOST appropriate for the streaming ingestion and processing?
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Pub/Sub and Cloud Dataflow
Pub/Sub for ingestion allows event replay (by setting a subscription's retention), and Dataflow for stream processing handles real-time transformations and writes to BigQuery.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Cloud Storage and Cloud Functions
Why it's wrong here
Cloud Storage is an object storage service for batch files, not a real-time ingestion layer. While Cloud Functions can react to events like file uploads, it is designed for short-lived, event-driven compute, not for continuously processing data streams. This pairing introduces high latency and lacks the fundamental streaming semantics (e.g., message ordering, replay, exactly-once delivery) needed for a proper streaming pipeline. It also fails to handle stateful, windowed aggregations or long-running stream processing.
- ✓
Pub/Sub and Cloud Dataflow
Why this is correct
Pub/Sub provides a fully managed, asynchronous messaging service with durable message retention, at-least-once delivery, and replay support, enabling reliable, scalable stream ingestion with no operators. Cloud Dataflow, built on Apache Beam, processes streams in real time and supports event-time processing, watermarks, windowing, and exactly-once semantics, making it suitable for complex transformations, aggregations, and stateful analytics. As a fully managed service, it also autoscales and seamlessly integrates with GCP and open-source ecosystems, so this combination is the intended architecture for real-time stream processing on GCP.
- ✗
Pub/Sub and Cloud Functions
Why it's wrong here
Pub/Sub is indeed a solid ingestion layer, but Cloud Functions is not designed for complex or stateful stream processing. Cloud Functions has a short execution timeout and is intended for lightweight, single-event responses, not for long-running aggregations, windowing, or exactly-once semantics. Attaching it to Pub/Sub without a stream processor like Dataflow leaves you unable to handle large bursts, time-based windows, or cross-event state. This approach is reasonable only for trivial event-driven actions, not for a full streaming pipeline.
- ✗
Apache Kafka on Compute Engine
Why it's wrong here
Running Apache Kafka on Compute Engine gives you low-level control, but it means you must manage the cluster's provisioning, broker configuration, replication, patching, scale, and storage yourself. GCP's managed services, especially Pub/Sub, offer similar high-throughput message ingestion while eliminating operational overhead and adding native IAM, audit logging, and integration with services like Dataflow and BigQuery. For a streaming pipeline, the need to build and maintain additional connectors for GCP ecosystems makes this option less appropriate. When fully managed alternatives are available, this adds unnecessary complexity without a clear benefit.
Go deeper
Related to this question
Learn chapter
BigQuery and Data Analytics
Key term
Pub/Sub
Pub/Sub is a messaging pattern where publishers send messages without knowing who receives them, and subscribers receive only the messages they care about.
Key term
Stream processing
Stream processing is a data processing method that continuously analyzes and acts on data in real time as it arrives, rather than storing it first and processing it later.
About these practice questions
Courseiva writes every GCDL question from scratch — 829 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This GCDL practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the GCDL exam.