The answer is to use Cloud Data Fusion for the initial ingestion and transformations, then export the data to Cloud Dataproc for the ML algorithms. This hybrid ETL pipeline is correct because it separates the visual, no-code data integration work, which is ideal for data analysts using Cloud Data Fusion’s Wrangler and pipeline studio, from the custom machine learning execution that requires the distributed compute power of Spark or Hadoop on Cloud Dataproc, which data scientists need. On the Google Professional Data Engineer exam, this scenario tests your understanding of tool specialization and workload partitioning—a common trap is choosing a single service like Dataflow for everything, but that lacks the visual editing analysts require. Remember the memory tip: “Fuse the data, then Proc the ML”—Cloud Data Fusion handles the visual plumbing, while Dataproc runs the custom algorithms.
PDE Designing data processing systems Practice Question
This PDE practice question tests your understanding of designing data processing systems. Read the scenario carefully and evaluate each option against the stated constraints before committing to an answer. After answering, compare your reasoning against the explanation and wrong-answer breakdown below. Once you have made your selection, read the full explanation to reinforce the concept and understand why each distractor is designed to mislead on exam day.
A data engineering team needs to build a data integration pipeline that involves connecting to multiple sources, performing data transformations with visual editing, and then running custom machine learning algorithms. The team has both data analysts and data scientists. Which approach is most suitable?
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Use Cloud Data Fusion for the initial ingestion and transformations, then export the data to Cloud Dataproc for the ML algorithms
Option D is correct because it leverages Cloud Data Fusion's visual, no-code interface for data ingestion and transformation, which is ideal for data analysts, and then exports the prepared data to Cloud Dataproc, which provides native support for custom machine learning algorithms using Spark or Hadoop, meeting the data scientists' needs. This separation of concerns optimizes the pipeline for both user groups and avoids forcing all tasks into a single tool that may not excel at both visual ETL and custom ML.
Key principle: Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
✗
Use Cloud Composer to orchestrate both Data Fusion and Dataproc
Why it's wrong here
While possible, this adds unnecessary complexity; Data Fusion can trigger Dataproc jobs directly.
✗
Use only Cloud Dataproc for all steps
Why it's wrong here
Dataproc requires coding for all transformations, lacking visual editing for analysts.
✗
Use only Cloud Data Fusion for all steps
Why it's wrong here
Data Fusion is great for integration but may have limitations for custom ML algorithms.
✓
Use Cloud Data Fusion for the initial ingestion and transformations, then export the data to Cloud Dataproc for the ML algorithms
Why this is correct
This leverages the strengths of both services: visual integration and custom ML.
Related concept
Read the scenario before looking for a memorised answer.
Common exam traps
Common exam trap: answer the scenario, not the keyword
Google Cloud often tests the misconception that a single tool can handle both visual ETL and custom ML, leading candidates to choose Cloud Data Fusion alone (Option C) without realizing it lacks native support for running custom algorithms like Spark MLlib or TensorFlow.
Detailed technical explanation
How to think about this question
Cloud Data Fusion uses a Wrangler interface for visual transformations, which generates Spark or MapReduce pipelines under the hood, but it cannot execute arbitrary ML libraries like TensorFlow or PyTorch directly. Cloud Dataproc, on the other hand, provides a fully managed Spark cluster where data scientists can submit custom ML jobs using Python, R, or Scala, and it integrates with Cloud Storage for data exchange. In practice, this hybrid approach is common in enterprises where analysts use Data Fusion for schema mapping and cleansing, while data scientists run iterative model training on Dataproc, with the data exported as Parquet or Avro files for optimal performance.
KKey Concepts to Remember
Read the scenario before looking for a memorised answer.
Find the constraint that changes the correct option.
Eliminate answers that are true in general but not in this case.
TExam Day Tips
→Watch for words such as best, first, most likely and least administrative effort.
→Review why wrong options are wrong, not only why the correct option is correct.
Key takeaway
Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Real-world example
How this comes up in practice
A cloud solutions architect for a retail company is evaluating services for a new workload. The correct answer here reflects best practice for the specific scenario described — not a general cloud recommendation. Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option. Cloud exam questions reward reading the constraint carefully: the same technology can be right or wrong depending on the use case.
What to study next
Got this wrong? Here's your next step.
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
Designing data processing systems — This question tests Designing data processing systems — Read the scenario before looking for a memorised answer..
What is the correct answer to this question?
The correct answer is: Use Cloud Data Fusion for the initial ingestion and transformations, then export the data to Cloud Dataproc for the ML algorithms — Option D is correct because it leverages Cloud Data Fusion's visual, no-code interface for data ingestion and transformation, which is ideal for data analysts, and then exports the prepared data to Cloud Dataproc, which provides native support for custom machine learning algorithms using Spark or Hadoop, meeting the data scientists' needs. This separation of concerns optimizes the pipeline for both user groups and avoids forcing all tasks into a single tool that may not excel at both visual ETL and custom ML.
What should I do if I get this PDE question wrong?
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
What is the key concept behind this question?
Read the scenario before looking for a memorised answer.
About these practice questions
Courseiva creates original exam-style practice questions with explanations and wrong-answer analysis. It does not publish real exam questions, exam dumps, or protected exam content. Learn why practice questions differ from exam dumps →
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
This PDE practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the PDE exam.
Question Discussion
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
Sign in to join the discussion.