Courseiva
Maintaining and Automating Data WorkloadseasyMultiple ChoiceObjective-mapped

PDE Maintaining and Automating Data Workloads Practice Question

A data engineer needs to orchestrate a complex data pipeline that involves multiple steps including data extraction from Cloud Storage, transformation using Dataflow, and loading into BigQuery. The pipeline has dependencies between tasks and requires monitoring and retries. Which Google Cloud service should be used for orchestration?

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

Cloud Composer

The question asks for a single service to orchestrate a complex data pipeline with multiple steps, task dependencies, retries, and monitoring. Cloud Composer (a managed Apache Airflow service) is specifically designed for such complex workflow orchestration, supporting dependency graphs, automated retries, and built-in monitoring. While other services (Workflows, Cloud Scheduler, Cloud Tasks) can handle simpler orchestration or event-triggered tasks, they lack the full scheduler, retry, and dependency management capabilities required for this use case. Therefore, Cloud Composer is the correct answer.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

  • Workflows

    Why it's wrong here

    Workflows lacks native support for task-level dependency graphs, retry logic with backoff, and integrated monitoring across heterogeneous steps like Dataflow and BigQuery; it is designed for orchestrating loosely coupled HTTP-based microservices and API calls, not complex data pipelines with stateful transformations. It tempts because its name suggests general orchestration, and it would be correct for coordinating serverless workflows with external endpoints or sequential API invocations.

  • Cloud Scheduler

    Why it's wrong here

    Cloud Scheduler is a cron job service, not suitable for complex pipeline orchestration.

  • Cloud Composer

    Why this is correct

    Cloud Composer (Airflow) is designed for orchestrating complex pipelines with dependencies.

  • Cloud Tasks

    Why it's wrong here

    Cloud Tasks is a task queue service for asynchronous execution, not for orchestration with dependencies.

About these practice questions

One of 890 original PDE practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →

How Courseiva writes practice questions · Editorial policy

JA

Written by Johnson Ajibi, MSc IT Security

Senior Network & Security Engineer · founder of Courseiva

This PDE practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the PDE exam.