DP-900 Describe an analytics workload on Azure Practice Question
A data engineer needs to build an analytics solution to transform large volumes of streaming data from IoT devices. The transformations involve complex Python and Spark code, and the results will be stored in Azure Data Lake Storage Gen2 for further analysis. Which Azure service is best suited for executing these transformations?
⚠ Common exam trap
It's easy for candidates to confuse Azure Data Factory or Synapse Pipelines with compute engines for code-based transformations, when those services are primarily for orchestration and integration, not for executing complex Python/Spark code on streaming data.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Azure Databricks
Azure Databricks is best suited because it provides an Apache Spark-based analytics platform that can execute complex Python and Spark code on large-scale streaming data. It integrates natively with Azure Data Lake Storage Gen2 for reading streaming IoT data and writing transformed results, offering optimized performance for big data transformations.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Azure Data Factory
Why it's wrong here
Azure Data Factory is primarily an orchestration and data movement service, responsible for ingesting data from diverse sources and scheduling pipeline activities. Although Mapping Data Flows allow visual, code-free transformations, these run on Azure Databricks clusters under the hood and are limited to a set of designed transformation actions, not arbitrary Python or custom Spark code. For large-scale transformations requiring complex logic, ADF would need to orchestrate a separate compute service, making it the wrong direct tool here.
- ✗
Azure Synapse Pipelines
Why it's wrong here
Azure Synapse Pipelines are built on the same engine as Azure Data Factory and serve as a control plane for orchestration rather than a compute plane for transformation. A pipeline can trigger a Synapse Spark notebook or a Spark job definition, but the pipeline itself does not execute transformation code; it merely coordinates dependencies and parameter passing. Consequently, you would need to write your Python/Spark logic in a separate notebook, and the pipeline adds little value for the actual transformation workload, so it is not the optimal platform for this requirement.
- ✓
Azure Databricks
Why this is correct
Azure Databricks is a fully managed Apache Spark-based analytics platform that provides collaborative notebooks, cluster management, and a unified workspace for data engineering and data science. It natively supports Python, Scala, SQL, and R, allowing you to write complex transformations using the Spark DataFrame API or Spark SQL, with the ability to install custom libraries and control cluster configuration. This makes it the best choice for transforming large volumes of data in Azure Data Lake Storage, with built-in optimizations like Delta Lake for reliable, performance-tuned batch and streaming workloads.
- ✗
Azure Analysis Services
Why it's wrong here
Azure Analysis Services is a cloud-based semantic modeling service that uses the in-memory VertiPaq engine to serve fast, interactive queries for business intelligence tools such as Power BI. It expects data to have already been processed and loaded into its tabular models, and it only supports DAX and MDX queries for exploration, not Python or Spark code for transformation. Because it is a downstream consumption layer rather than a data processing engine, it cannot be used to transform large volumes of raw data.
Go deeper
Related to this question
Learn chapter
Data Roles and Core Concepts
Key term
Azure Databricks
Azure Databricks is a fast, easy, and collaborative Apache Spark-based analytics platform optimized for Azure that lets data teams prepare data, run machine learning models, and build data pipelines using a single workspace.
Key term
Data Lake Storage Gen2
Data Lake Storage Gen2 is a cloud-based storage service that combines a scalable data lake with enterprise-grade file system capabilities for big data analytics.
About these practice questions
This DP-900 question is part of Courseiva's 820-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This DP-900 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the DP-900 exam.