DP-700 Monitor and Optimize an Analytics Solution Practice Test 4 — 15 Questions

Question 1

You are monitoring a Spark notebook in Microsoft Fabric that is taking longer than expected to process a large dataset. You notice that a single executor is processing significantly more data than others. Which tool or feature should you use to identify the specific partition causing this data skew?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

The Spark Advisor and Spark UI. Spark Advisor is integrated directly into Fabric notebooks to provide real-time performance suggestions. It analyzes job execution patterns and can detect common issues like data skew or sub-optimal file sizes. By using the Spark UI alongside Advisor, engineers can pinpoint the exact stage and partition that is causing a bottleneck in the distributed processing pipeline.

Answer

Fabric Monitoring Hub

Answer

The Capacity Metrics App

Answer

The OneLake Explorer

Question 2

You need to quickly identify all failed Data Factory pipeline runs and Spark jobs across multiple workspaces in your Microsoft Fabric environment. Which TWO actions should you perform in the Fabric Monitoring Hub?

Accepted Answer

Apply a filter for the 'Failed' status.. The Fabric Monitoring Hub acts as a centralized dashboard for tracking the health of all activities. It allows users to filter by status and item type across the entire environment. This centralized view is essential for data engineers who need to manage multiple pipelines and notebooks without navigating to each individual workspace to check logs.

Answer

Export the logs to an Azure Log Analytics workspace.

Answer

Schedule a daily refresh for the Monitoring Hub dashboard.

Answer

Configure an alert in the Capacity Metrics app.

Question 3

Refer to the exhibit. You are reviewing the execution plan for a query running on a Fabric SQL Analytics Endpoint. The query is performing slower than expected. Based on the JSON snippet of the plan, what is the most likely cause of the performance bottleneck?

Accepted Answer

The BroadcastExchange is moving too much data for a large table join.. Analyzing query plans in the SQL Analytics Endpoint is vital for performance tuning. The presence of a BroadcastExchange for a table that results in a very high output count after a HashJoin suggests that the data being moved across the network is excessive. This often happens when the engine incorrectly estimates the size of a table or when data is not properly distributed.

Answer

The RemoteScan is failing to find the Parquet files in OneLake.

Answer

The HashJoin is using an unsupported data type for the join condition.

Answer

OneLake storage is currently in a read-only state due to maintenance.

Question 4

A Data Factory pipeline in Fabric fails during the execution of a Copy activity. You need to find the specific error message and the number of rows successfully written before the failure. Where should you look?

Accepted Answer

The pipeline run details in the Monitoring Hub. Data Factory in Fabric provides detailed execution logs for every activity within a pipeline. Accessing the output of a specific activity allows you to see the error codes and performance metrics like rows read and written. This is the first step in troubleshooting data movement issues and identifying data quality problems.

Answer

The Spark UI environment logs

Answer

The OneLake data access logs

Answer

The Capacity Metrics 'Overages' view

Question 5

You are tasked with optimizing the performance of a Delta table in a Fabric Lakehouse that is queried frequently by both Spark notebooks and the SQL Analytics Endpoint. Which TWO techniques should you use to improve data skipping and read performance?

Accepted Answer

Enable V-Order on the Delta table.. Optimizing Delta tables in Fabric involves managing file sizes and metadata. V-Order is a Fabric-specific optimization that sorts data to improve read speeds for Power BI and SQL, while the OPTIMIZE command consolidates small files. Together, these techniques ensure that the engine can effectively skip irrelevant data during a scan operation.

Answer

Convert the table to a CSV format.

Answer

Increase the Spark executor memory only.

Answer

Disable the use of shortcuts to the data.

Question 6

You are configuring a Spark pool in Microsoft Fabric for a workload with highly variable data volumes. You want to ensure that the pool can handle peak loads without over-provisioning resources during quiet periods. Which setting should you adjust?

Accepted Answer

Autoscale on the Spark pool. Autoscale is the key feature for managing variable workloads in Spark pools. It allows the cluster to dynamically add or remove nodes based on the number of pending tasks in the queue. This balances the need for performance during peak times with cost-efficiency during periods of low activity, ensuring Capacity Units are used effectively.

Answer

Dynamic Allocation of executors

Answer

The Max Memory per node setting

Answer

The default Spark version

Question 7

In Microsoft Fabric, you notice that a background job (such as a Dataflow refresh) is taking significantly longer than usual, even though the total Capacity Unit (CU) usage is below the limit. What is the most likely cause of this behavior based on Fabric's capacity management rules?

Accepted Answer

The job is being smoothed over a 24-hour window.. Fabric manages capacity by smoothing the consumption of CUs over time. Background operations are smoothed over a 24-hour window, while interactive operations are smoothed over 5 minutes. If a capacity was previously over-utilized, background jobs may be delayed by the system to prevent further overages, even if current usage appears low on the dashboard.

Answer

The background job has been rejected by the system.

Answer

The SQL Analytics Endpoint has higher priority than Dataflows.

Answer

The workspace is in a 'Trial' capacity which lacks background processing.

Question 8

You are using a KQL Database in a Microsoft Fabric Eventhouse to analyze streaming data. You need to monitor the performance of your Kusto queries and identify which ones are consuming the most resources. Which TWO methods should you use?

Accepted Answer

Run the '.show queries' command in the KQL queryset.. Monitoring KQL performance requires specialized tools within the Eventhouse and Fabric environment. The '.show queries' command provides immediate insights into currently running and recently completed queries, while the Capacity Metrics app provides the high-level view of how these queries impact the overall cost and resource allocation of the Fabric capacity.

Answer

Check the Spark UI for Kusto connector logs.

Answer

Review the OneLake access logs in the Azure Portal.

Answer

Monitor the 'Dataflow Gen2' refresh history.

Question 9

Refer to the exhibit. You are reviewing the configuration for a Fabric Spark Environment. A job is failing with an 'OutOfMemoryError' during a large shuffle operation. Based on the configuration, which change would most likely resolve the issue?

Accepted Answer

Increase 'spark.executor.memory' to 8g or higher.. OutOfMemoryErrors during shuffle operations often indicate that the executor memory is insufficient for the volume of data being processed per task. While dynamic allocation helps with the number of executors, it does not increase the memory available to each individual executor. Increasing 'spark.executor.memory' provides the necessary headroom for complex joins and aggregations.

Answer

Increase 'spark.dynamicAllocation.maxExecutors' to 20.

Answer

Decrease 'spark.executor.cores' to 1.

Answer

Set 'spark.dynamicAllocation.enabled' to 'false'.

Question 10

You are auditing data access in a Microsoft Fabric workspace and notice unexpected 'Access Denied' errors in the OneLake logs for a service principal that should have read-only access. The service principal has the 'Viewer' role in the workspace. What is the most likely cause?

Accepted Answer

OneLake data access control (preview) is restricting specific folders.. OneLake security is governed by both workspace roles and item-level permissions. If 'OneLake data access control' is enabled for a Lakehouse, the 'Viewer' role alone may not be sufficient if specific folder-level permissions have not been granted. Understanding the intersection of these security layers is critical for troubleshooting access issues in complex environments.

Answer

The service principal needs the 'Contributor' role to read data.

Answer

The service principal has exceeded its OneLake throughput quota.

Answer

OneLake does not support service principal authentication.

Question 11

You are analyzing a performance bottleneck using the 'Timepoint Detail' page in the Fabric Capacity Metrics app. Which THREE pieces of information can you find here to help identify the specific cause of a capacity overage? (Select THREE)

Accepted Answer

The name of the operation and the item that triggered it.. The Timepoint Detail page is the most granular view in the Capacity Metrics app. It allows you to see exactly what was happening during a specific 30-second window when the capacity was under load. This detail is essential for identifying 'noisy neighbors' or specific jobs that are consuming more than their fair share of resources.

Answer

The physical IP address of the Spark executor nodes.

Answer

The SQL execution plan for every query in the timepoint.

Question 12

You are monitoring a Dataflow Gen2 refresh in Microsoft Fabric. The refresh fails with an error: 'Mashup Evaluation Error'. What is the most common cause of this error when working with large datasets in Dataflows?

Accepted Answer

The transformation logic is too memory-intensive for the evaluator.. Dataflow Gen2 uses the Power Query engine for data transformation. A 'Mashup Evaluation Error' often occurs when the engine runs out of memory or hits a timeout while processing complex transformations or large volumes of data. Understanding the limitations of the Power Query online evaluator is key to designing robust data ingestion processes.

Answer

The destination Lakehouse has reached its storage limit.

Answer

The Spark pool assigned to the Dataflow is offline.

Answer

The user does not have 'Execute' permissions on the Dataflow.

Question 13

You need to monitor the historical performance of queries in a Fabric Warehouse to identify which ones frequently use the most CPU time. Which Dynamic Management View (DMV) should you query?

Accepted Answer

queryinsights.exec_requests_history. Fabric Warehouse provides several DMVs to monitor query execution. The 'sys.dm_exec_requests' view shows currently running queries, but for historical analysis, 'queryinsights.exec_requests_history' (or similar views in the queryinsights schema) provides the necessary data on completed queries, including their duration and resource consumption over time.

Answer

sys.dm_pdw_nodes_os_performance_counters

Answer

sys.dm_tran_active_transactions

Answer

sys.dm_exec_sessions

Question 14

You are monitoring a Microsoft Fabric Lakehouse. You observe that queries against a specific Delta table are performing poorly. You identify that the table contains a large number of small files. Which command should you run to optimize the file layout?

Accepted Answer

OPTIMIZE table_name. Optimizing file layouts is crucial for performance in Delta Lake, as small files induce metadata overhead and increase read latency. The OPTIMIZE command consolidates these small files into larger, more efficient Parquet files, significantly improving scan performance. This maintenance task is essential in streaming-heavy environments where micro-batching frequently creates tiny data fragments that degrade analytics performance over time.

Answer

ALTER TABLE REFRESH

Answer

VACUUM

Answer

ANALYZE TABLE

Question 15

You are managing a Microsoft Fabric capacity. You need to identify which users are consuming the most compute resources and determine if any throttled requests are occurring. Which TWO tools should you use?

Accepted Answer

Fabric Capacity Metrics app. Monitoring capacity health requires a combination of real-time metrics and long-term diagnostic logs. The Fabric Capacity Metrics app provides granular visual insights into capacity utilization and throttling, while the Log Analytics workspace offers detailed diagnostic logs for query-level analysis. Using both tools allows engineers to correlate high-level capacity health with specific user-driven workloads that may trigger system-wide throttling or degradation.

Answer

Microsoft Purview

Answer

Service Health Dashboard

Answer

Power BI Desktop Performance Analyzer