Courseiva

Databricks-ML-Pro · domain

scenario questions

Practise Databricks Certified Machine Learning Professional scenario questions practice questions — original exam-style scenarios with answer choices, explanations, and analysis of common mistakes.

300 questions56 easy143 medium101 hard

Focused practice

Practice scenario questions questions

Scored sessions drawing only from this domain — pick a length below.

Start 20-question practice test →

What this domain covers

What to know about scenario questions

scenario questions questions test whether you can apply the concept in context, not just recognise a definition.

How the topic appears in realistic exam-style scenarios.

Which detail in the question changes the correct answer.

How to eliminate plausible but wrong options.

How to connect the question back to the wider exam objective.

Watch out for

Common scenario questions exam traps

  • ▸Answering from memory before reading the full scenario.
  • ▸Missing a constraint such as cost, availability, security, scope or command context.
  • ▸Choosing a broad answer when the question asks for the most specific fix.
  • ▸Ignoring why the wrong options are tempting.

Question index

All scenario questions questions (300)

Click any question to see the full explanation, or start a practice session above.

1

A data scientist is using MLflow on Databricks to track a series of experiments. They want to compare the performance of different runs and identify the best model based on a custom metric called "f1_score". Which MLflow feature should they use to efficiently compare and rank these runs?

Easy
2

A data scientist is using MLflow to log a model that includes a custom preprocessing step. They want to ensure that the preprocessing is applied consistently during both training and inference. Which approach should they take?

Hard
3

Your organization wants to monitor production models for drift. Which Databricks service should be used to detect changes in the input data distribution compared to the training data?

Hard
4

A data scientist is using MLflow Tracking to log experiments for a model that predicts customer lifetime value. They want to compare runs across multiple experiments and identify the best performing run based on a custom metric called 'rmse'. Which MLflow feature should they use?

Easy
5

Refer to the exhibit. An engineer is configuring a serving endpoint. Based on the configuration provided, what is the impact of the 'auto_scale' flag?

Medium
6

A fraud-detection model is registered in Unity Catalog and deployed to a Model Serving endpoint. Compliance requires that every prediction be traceable to the exact model version and the request that produced it. Which combination of Databricks features should you configure to meet this requirement?

Hard
7

When using the Databricks Model Registry, what does a 'Model Version' represent in the context of the lifecycle?

Medium
8

Refer to the exhibit. The JSON configuration represents an existing Databricks Model Serving endpoint. You need to update this endpoint to support a traffic split between version 5 and version 6 for A/B testing. Which update strategy is correct?

Hard
9

A team is preparing to promote a new model version to production in the MLflow Model Registry. They must ensure the model can be served with a consistent environment across staging and production and that dependency drift is detected before promotion. Which TWO practices should they follow? (Choose two.)

Medium
10

Your team is experiencing 'training-serving skew' where model performance in production is significantly lower than during training. Which approach should you prioritize to mitigate this issue?

Medium
11

A machine learning team is using Databricks to develop a model and wants to ensure that the model's input schema is validated at inference time to prevent errors from malformed data. Which TWO approaches allow them to enforce schema validation when serving the model with MLflow Model Serving? (Choose two.)

Medium
12

Which component of MLflow is responsible for keeping track of the different versions of a model as it moves from development to testing and production?

Medium
13

Your team uses Databricks for machine learning and needs to ensure that model training is fully automated and reproducible. Which THREE of the following are necessary components for a production-grade automated ML pipeline?

Hard
14

You are monitoring a model served on Databricks Model Serving. You need to detect data drift in the incoming requests without delaying predictions. Which approach should you use?

Hard
15

A team is deploying a model to Databricks Model Serving and wants to implement a canary release strategy to gradually shift traffic from the current model version to a new version. Which TWO configurations are required to achieve this? (Choose two.)

Medium
16

A data scientist is using MLflow to track a deep learning experiment on Databricks. They want to log custom metrics that are computed during training but not automatically captured by `mlflow.autolog()`. What is the correct way to log these custom metrics?

Hard
17

When developing a machine learning pipeline on Databricks, which feature provides the most effective way to track the lineage of a model from the raw data used for training to the final deployment?

Easy
18

Refer to the exhibit. You are managing the 'revenue_forecast' model in the registry. A colleague wants to deploy this version to production. Which Databricks command or process is required to move version 4 to the 'Production' stage while ensuring existing production models remain unaffected?

Medium
19

An ML engineer is deploying a model to Databricks Model Serving that requires a custom Python package not available in the default environment. The model was logged with MLflow and includes the package in its conda environment. What must the engineer ensure for the endpoint to successfully load the model?

Medium
20

A data scientist is using MLflow on Databricks to train a model with a custom training loop. They want to log the model so that it can be loaded later with `mlflow.pyfunc.load_model()` and used for batch inference. The model artifacts include a Python class and a configuration file. Which approach should they use to log the model?

Hard
21

A data scientist has trained a scikit-learn model and logged it with MLflow. They now want to register this model in the MLflow Model Registry and transition it to 'Production' to be served via Databricks Model Serving. Which of the following is a prerequisite for registering the model?

Easy
22

A team has deployed a model to a Databricks Model Serving endpoint. They want to monitor the endpoint's performance and detect data drift over time. Which Databricks feature should they use to automatically track inference data and compute drift metrics?

Easy
23

When developing a machine learning model on Databricks, what is the primary benefit of using Feature Store over standard Delta Lake tables for feature management?

Easy
24

Which of the following describes the correct usage of the MLflow 'log_param' function in a Databricks environment?

Medium
25

You are monitoring a model deployed to a Databricks Model Serving endpoint. You need to track the distribution of input features and model predictions over time to detect data drift. Which Databricks feature should you use?

Easy
26

A machine learning engineer is using Hyperopt with SparkTrials to tune a scikit-learn model on a Databricks cluster. They set max_evals=100 and parallelism=4. After the run, they notice that some trials report a loss of NaN and that the best model selected by Hyperopt has poor performance. What is the most likely reason for the NaN losses?

Hard
27

A data scientist is training a model on Databricks and wants to track experiments using MLflow. They need to record the model's hyperparameters, evaluation metrics, and the resulting model artifact. They also want to be able to compare runs and reproduce results later. Which MLflow component should they use to organize these runs?

Easy
28

A data science team has deployed a model to Databricks Model Serving and wants to ensure that the endpoint can handle sudden spikes in traffic without manual intervention. Which feature should they configure?

Easy
29

Refer to the exhibit. An MLOps engineer is reviewing a JSON object representing a model in the Databricks Model Registry. The engineer wants to promote this model to the 'Production' stage using the MLflow Python API. Which command is correct?

Medium
30

A machine learning engineer needs to deploy a custom scikit-learn model to a Databricks Model Serving endpoint with a strict response time SLA of under 50 milliseconds. The model includes an extensive text-cleaning pipeline that utilizes heavy regex matching. How should the engineer package the model to ensure maximum inference efficiency and meet the low-latency requirement?

Medium
31

An ML engineer is deploying a model that includes a custom Python class for preprocessing. During deployment to a Model Serving endpoint, the model fails to load with a 'ModuleNotFoundError'. What is the most likely cause of this error despite having the class in the training notebook?

Hard
32

When designing a robust MLOps pipeline for high-stakes financial applications, why should you prioritize 'reproducibility' over 'speed' during the deployment phase?

Hard
33

A data science team at a retail company has registered a demand forecasting model in the MLflow Model Registry. The model version is currently in the 'Staging' stage and has been validated by the QA team. Before promoting it to 'Production', the ML engineer wants to ensure that the model's performance does not degrade when serving live traffic. They decide to deploy the model to a small percentage of production traffic while continuing to serve the existing model. Which Databricks feature should they use to achieve this?

Medium
34

You maintain a Databricks ML pipeline that trains a model nightly and registers new versions in MLflow Model Registry. A downstream batch scoring job in another workspace loads the model by stage. Auditors require that every production scoring run can be traced back to the exact training data snapshot and code commit. Which approach best satisfies this requirement?

Medium
35

You are using MLflow to track experiments for a computer vision model. After several runs, you notice that the training loss is not being logged correctly because the metric name contains a space. What is the recommended way to log metrics with names that include spaces?

Medium
36

When utilizing Hyperopt with MLflow on Databricks for distributed hyperparameter tuning, which TWO components are strictly required to configure the optimization run properly? (Select TWO)

Hard
37

You are preparing a feature-engineering job that reads from a Delta table and writes a feature table. The job must run on a schedule and be idempotent so that reruns after a failure do not duplicate data. Which approach should you use?

Medium
38

A data scientist is using MLflow to track experiments on Databricks. They want to record the value of a hyperparameter named 'learning_rate' for a run. Which MLflow function should they use?

Easy
39

A machine learning engineer is using MLflow to track experiments on Databricks. They want to ensure that the model's input schema is enforced during inference to prevent errors from malformed data. Which MLflow feature should they use when logging the model?

Hard
40

You need to perform cross-validation on a large dataset while ensuring that your model remains performant. What is the Databricks-recommended approach?

Medium
41

A team is deploying a scikit-learn model to Databricks Model Serving and wants to minimize cold-start latency so that the first request after a period of inactivity is still fast. Which TWO actions help achieve this? (Choose two.)

Medium
42

A machine learning engineer is using MLflow Tracking to log metrics and artifacts for a deep learning model. They notice that the training run logs a large number of metrics (e.g., loss per batch) and want to reduce the storage footprint and improve query performance. They also need to retain the ability to compare runs and reproduce results. Which of the following actions is most appropriate?

Hard
43

A data scientist has completed hyperparameter tuning with Hyperopt on Databricks and now needs to register the best-performing model to the MLflow Model Registry, including its signature and input example, so that downstream scoring jobs can validate incoming data. The training script uses MLflow autologging. Which approach most reliably captures the signature and input example during registration?

Medium
44

A data scientist is developing a scikit-learn model on Databricks and wants to track the full lineage of the training data, including the exact Delta table version used. They are using MLflow Tracking with a Unity Catalog-enabled workspace. Which approach best captures this lineage as part of the MLflow run?

Medium
45

A data scientist has trained a model and logged it with MLflow. They now need to deploy it as a real-time endpoint on Databricks Model Serving. The model requires a custom Python library that is not available in the default environment. What is the correct way to ensure the library is available when serving the model?

Easy
46

Refer to the exhibit. If the 'train_model' task fails, what happens to the 'evaluate_model' task in this Databricks Job?

Medium
47

A data science team is transitioning from manual model training to automated pipelines in Databricks. They require a mechanism to track model lineage, versions, and stage transitions programmatically. Which Databricks component best satisfies this requirement?

Medium
48

When implementing a Feature Store in Databricks, what is the primary benefit of using a Feature Table compared to a standard Delta table for feature engineering?

Easy
49

A machine learning engineer wants to ensure that model training artifacts are persistent and accessible even if the ephemeral compute cluster is terminated. What is the standard practice in Databricks for achieving this?

Medium
50

A data scientist has developed a scikit-learn model and wants to deploy it as a REST API endpoint on Databricks Model Serving. They have logged the model with MLflow and registered it in the MLflow Model Registry. The model requires a specific Python library that is not pre-installed in the Databricks Model Serving environment. What should the data scientist do to ensure the library is available when the model is served?

Easy
51

Your company uses MLflow tracking. You want to query all experiments that achieved a specific accuracy threshold across multiple teams. What is the most efficient way to achieve this?

Medium
52

You are migrating a legacy ML pipeline to Databricks. You need to ensure that the feature engineering logic used during training is identical to the logic used during real-time inference. What is the recommended approach?

Medium
53

When utilizing the Databricks Feature Store for model development, why should a developer define a primary key in the Feature Table?

Medium
54

A team is deploying a model to Databricks Model Serving that requires a specific version of a Python library that conflicts with the version pre-installed in the serving environment. They include the library version in the model's requirements.txt. However, upon deployment, the endpoint fails to start, and logs indicate a dependency conflict. What is the most likely cause of this failure?

Hard
55

You are designing a strategy for monitoring model performance after deployment. Which of the following is the most important indicator that a model requires retraining?

Medium
56

A machine learning engineer is using MLflow to track experiments on Databricks. They notice that when they run `mlflow.log_artifact` with a local file path inside a notebook, the artifact is stored in the run's artifact location, but when they run the same code in a job cluster, the artifact is missing. The job cluster uses the same MLflow tracking server and experiment. What is the most likely reason for the missing artifact?

Hard
57

You are designing a model retraining strategy. What is the most reliable way to trigger a retraining job based on model performance degradation?

Medium
58

When using the Unity Catalog Model Registry, what are the primary advantages of using 'Aliases' over 'Versions' when calling a model from a production application? (Select TWO)

Medium
59

An ML engineer has deployed a model to Databricks Model Serving and wants to update the endpoint to serve a new model version without changing the endpoint URL or causing downtime. Which approach is correct?

Medium
60

When deploying a model to a Databricks Model Serving endpoint, what is the purpose of the 'Small', 'Medium', and 'Large' workload size settings?

Easy
61

Refer to the exhibit. A user wants to retrieve the 'accuracy' metric from this run programmatically. Which code snippet correctly accesses this value?

Medium
62

Which TWO actions are required to properly implement MLflow Model Registry stages and governance for a machine learning project?

Hard
63

Refer to the exhibit. Which security configuration is the likely culprit for this job failure?

Hard
64

Refer to the exhibit. What is the purpose of the 'signature' section in this model configuration?

Hard
65

An ML engineer is deploying a model to Databricks Model Serving that requires a custom Python package. The package is not available in the default environment and must be installed from a private PyPI repository. Which method ensures the package is available to the model at serving time?

Hard
66

A fraud detection model was deployed to a Databricks Model Serving endpoint. Over the past week, the endpoint's p99 latency has increased from 45 ms to 320 ms, but the model's predictions remain accurate. The serving logs show that each request now includes a larger JSON payload with additional transaction metadata. What is the most likely cause of the degradation?

Medium
67

When deploying a model as a real-time REST API endpoint on Databricks, which service should be used to manage the serving infrastructure, scaling, and availability?

Easy
68

When deploying a model to a Databricks Model Serving endpoint, how can you ensure the model scales automatically based on traffic demand?

Medium
69

Refer to the exhibit. Why is the missing model signature considered an MLOps risk in a production environment?

Hard
70

A data scientist has registered a new model version in MLflow Model Registry and wants to validate it against a golden dataset before promoting it. The validation notebook must run automatically whenever a new version is registered in the 'ChurnModel' registry model, and the result should block promotion if the validation fails. Which approach should the data scientist use?

Medium
71

A nightly Databricks job trains a model, registers a new version in Unity Catalog, and then updates a Model Serving endpoint that serves the 'champion' alias. The endpoint must switch to the new version only after the job's validation step passes. Which approach correctly enforces this?

Hard
72

An ML engineer is training a model with a custom Python loop and wants MLflow to capture training metrics at regular intervals so that partial progress is visible before the run finishes. They are using `mlflow.start_run` and manual logging. Which approach correctly makes intermediate metrics visible during the run?

Hard
73

A team has a production Databricks Model Serving endpoint for a churn model. They retrain weekly and register new model versions in Unity Catalog. They want the endpoint to automatically pick up the newest registered version without manual intervention, while keeping the previous version available for instant rollback. Which approach should they implement?

Hard
74

You are monitoring a production model deployed on Databricks Model Serving. You notice that the model's predictions have gradually become less accurate over time, likely due to data drift. You need to implement a solution that automatically detects drift and triggers retraining. Which Databricks feature should you use to monitor the model's input data and performance?

Hard
75

You are implementing a CI/CD pipeline for a Databricks ML project using Databricks Repos and Databricks Asset Bundles. You need to ensure that the pipeline promotes code and model artifacts across dev, staging, and prod workspaces consistently. Which TWO practices should you implement to achieve this? (Choose two.)

Hard
76

A machine learning engineer is using MLflow to track experiments and has logged a model with a signature. They now want to register this model in the MLflow Model Registry and promote it to Production. Which MLflow API call should they use to add the model to the registry?

Medium
77

A machine learning engineer is setting up a CI/CD pipeline for a model deployed to Databricks Model Serving. The pipeline must automatically update the serving endpoint when a new model version is registered in the MLflow Model Registry and passes a validation job. Which Databricks feature should the engineer use to trigger the update?

Hard
78

A machine learning engineer is training a model using MLflow on Databricks and wants to ensure that the model's input schema is captured and enforced during inference. They are using the `mlflow.pyfunc` flavor. Which action should they take to enable schema enforcement?

Medium
79

You are training a model on Databricks using MLflow. You need to log a custom model flavor to ensure it can be loaded in an environment without the original training code. Which approach is best practice?

Medium
80

When training a model in Databricks, which storage layer should you prioritize for training data to ensure maximum throughput and compatibility with Feature Store?

Easy
81

A machine learning engineer is setting up a Databricks job to retrain a model every night. The job must use a specific Python library version that is not available in the default Databricks Runtime. The engineer wants to ensure that the retraining job has access to this library without affecting other jobs in the workspace. What is the recommended approach?

Easy
82

Which Databricks feature is specifically designed to prevent data leakage during model training by ensuring feature values are fetched as they existed at a specific point in time?

Easy
83

A machine learning engineer is building a model on Databricks and wants to use MLflow to track experiments. They need to log a custom metric that is calculated during training but is not automatically captured by `mlflow.autolog()`. They also want to ensure that the metric is associated with the correct run. Which code snippet should they use inside their training script?

Hard
84

You are debugging a model serving issue where the model is failing in production. Which THREE of the following actions should you prioritize to identify the root cause of the failure?

Hard
85

You are implementing a CI/CD pipeline for a machine learning model on Databricks. The pipeline must automatically run unit tests, train the model, and deploy it to a staging endpoint. Which TWO practices should you follow to ensure the pipeline is reproducible and reliable? (Choose two.)

Hard
86

A fraud detection model is served via a Databricks Model Serving endpoint. The team wants to capture the incoming request payloads and the model's predictions to a Delta table for monitoring and future retraining. Which approach is most appropriate?

Medium
87

A machine learning engineer is training a scikit-learn model on Databricks and wants to automatically log hyperparameters, metrics, and the trained artifact without writing extensive boilerplate logging code. Which approach should the engineer use?

Medium
88

A data scientist is deploying a model to Databricks Model Serving. The model was trained using a scikit-learn pipeline that includes a custom transformer. The custom transformer is defined in a Python module that is not part of the model artifact. What should the data scientist do to ensure the model can be served successfully?

Medium
89

A data scientist is using MLflow to track experiments in a Databricks notebook. They want to record the source code version (Git commit hash) automatically with each run. Which MLflow feature should they enable to capture this information?

Easy
90

Your organization needs to automate the deployment of models to real-time serving endpoints. Which service within the Databricks ecosystem handles the hosting and scaling of these endpoints with managed containerization?

Medium
91

Your team is migrating models to Databricks Model Registry. You need to automate the transition of a model version to 'Staging' only after it passes an automated integration test suite in the CI/CD pipeline. Which mechanism should you use to best achieve this?

Medium
92

An ML engineer is updating a model serving endpoint to use a new model version. They want to gradually shift traffic from the old version to the new version to monitor performance before full rollout. Which feature of Databricks Model Serving should they use?

Medium
93

A team is deploying a model that requires custom Python libraries not available in the default Databricks Runtime. Which TWO methods can be used to ensure these dependencies are available in the Model Serving environment? (Select TWO)

Hard
94

An ML engineer is transitioning a model from the Workspace Model Registry to the Unity Catalog (UC) Model Registry. Which TWO statements describe benefits or requirements of using Unity Catalog for model management? (Select TWO)

Medium
95

When deploying a model to a production environment, why is it recommended to use a 'Model Signature'?

Medium
96

A machine learning engineer is using Hyperopt with SparkTrials on a Databricks cluster to tune a gradient boosting model. They notice that the tuning job is running slowly because each trial trains on the full dataset, and they want to speed up the search without sacrificing final model quality. Which approach is most appropriate?

Hard
97

A machine learning engineer is developing a custom MLflow Python model that requires a pre-processing step using a scikit-learn pipeline. They want to log the model such that it can be served with the pipeline included. Which approach should they take?

Hard
98

A machine learning engineer needs to automate retraining of a model whenever new data lands in a Delta table. The retraining must run on a schedule, use a specific cluster configuration, and send an email alert on failure. Which Databricks feature should be used to orchestrate this workflow?

Easy
99

You are responsible for monitoring a critical model deployed to Databricks Model Serving. You need to detect data drift and model performance degradation. Which TWO of the following actions should you take? (Choose two.)

Medium
100

A data scientist is training a model on a large Delta table. They want to ensure that the training data remains consistent even if the underlying table is updated during the training process. What is the most robust way to achieve this?

Medium
101

You are responsible for deploying a machine learning model to a Databricks Model Serving endpoint. The model must be updated frequently with new versions. You want to ensure that the endpoint remains available during updates and that traffic can be shifted gradually to the new version. Which deployment strategy should you use?

Medium
102

An organization needs to implement a robust CI/CD strategy for their Databricks ML models. Which TWO of the following practices are recommended to ensure reliable model deployment?

Hard
103

What is the best way to handle secrets (like API keys for external feature sources) within a Databricks notebook during model development?

Medium
104

In the context of Databricks MLOps, what is the primary purpose of a 'Staging' environment in the Model Registry?

Easy
105

A data science team is preparing to deploy a high-throughput recommendation model using Databricks Model Serving. Which TWO factors must be considered to optimize endpoint latency and resource utilization? (Choose two)

Hard
106

A machine learning engineer needs to track model experiments and ensure that all training parameters and metrics are captured in a reproducible way. What is the best practice for using MLflow within Databricks notebooks?

Medium
107

A team is developing a model to forecast demand. They need to ensure that their feature engineering code is reusable for both training and real-time inference. Which architectural pattern should they adopt?

Medium
108

A team runs a nightly Databricks job that retrains a demand-forecasting model and registers a new version in the MLflow Model Registry. Compliance requires that the model version used for scoring in production be immutably identified and that any subsequent retraining not silently change what production serves. Which practice best satisfies this requirement?

Hard
109

Your team is using MLflow Model Registry to manage a model that predicts customer churn. A new version has been registered and passed validation. You need to transition this version to the 'Production' stage and ensure that all downstream scoring jobs automatically use it. What should you do?

Medium
110

A team wants to deploy a scikit-learn model to a real-time REST endpoint on Databricks. They have logged the model with MLflow and registered it in Unity Catalog. Which method should they use to create the serving endpoint?

Easy
111

A team notices that their model performance is significantly lower in production than in training. They suspect 'data drift' in the feature inputs. Which Databricks capability should be used to monitor this?

Hard
112

A data scientist is using MLflow to track experiments on Databricks. They want to compare multiple runs and identify the one with the lowest validation RMSE. Which MLflow UI feature allows them to sort and filter runs by a specific metric?

Easy
113

A data scientist is using MLflow to log a model that includes a custom preprocessing step implemented in Python. They want to ensure that the preprocessing logic is packaged with the model so that it can be served consistently. Which MLflow model flavor should they use?

Hard
114

A data scientist has deployed a model to Databricks Model Serving and wants to monitor its performance over time. They need to track prediction drift and data quality issues. Which Databricks feature should they use to automatically capture inference logs and compute metrics?

Medium
115

You are implementing a CI/CD pipeline for a model. You want to automate unit testing of the model's inference performance. Which approach is best suited for Databricks?

Hard
116

A data scientist is using Databricks AutoML to solve a classification problem. After the run completes, they want to modify the feature engineering logic for the best-performing model. Which artifact should they retrieve from the AutoML run?

Medium
117

An ML engineer is deploying a model to Databricks Model Serving and needs to ensure the endpoint can handle sudden spikes in traffic without downtime. The model has a large memory footprint and takes several seconds to load. Which TWO configurations should the engineer implement to achieve this? (Choose two.)

Hard
118

Which THREE of the following are key responsibilities of an MLOps engineer when managing a model lifecycle on Databricks?

Medium
119

A financial institution is using Databricks to build and deploy a credit risk model. The model must comply with regulations that require full auditability of the model's lineage, including data sources, transformations, and training parameters. The team uses MLflow for tracking and the Feature Store for feature management. Which TWO of the following practices are essential to meet the auditability requirements? (Choose two.)

Medium
120

When deploying a model to Databricks Model Serving, you notice that inference latency is higher than expected. Which diagnostic approach is most effective for identifying the bottleneck?

Medium
121

A data scientist is developing a scikit-learn model on Databricks and wants to log the model artifact to MLflow so that it can later be deployed for online inference. They call mlflow.sklearn.log_model() without providing a signature. What is the primary consequence of omitting the model signature?

Medium
122

When evaluating a classification model on Databricks, a team needs to generate a custom performance report that is not natively provided by MLflow. What is the recommended strategy to ensure this report is persisted and associated with the training run?

Medium
123

You are building a CI/CD pipeline that must promote an MLflow model version from Staging to Production in Databricks only after automated validation. The pipeline runs in a service principal context. Which two actions are required to implement this safely and repeatably? (Choose two.)

Hard
124

A data scientist is using MLflow to log a model trained with scikit-learn. They want to ensure that the model can be loaded later for batch inference using `mlflow.pyfunc.load_model`. Which condition must be met for the model to be loadable as a PyFunc model?

Easy
125

An ML engineer is deploying a model to a Databricks Model Serving endpoint. The model's inference function logs predictions to a Delta table for monitoring. During testing, they notice that the logging adds significant latency. They need to reduce the impact on inference latency. Which approach should they take?

Hard
126

Refer to the exhibit. A data scientist is logging their model training process. Which statement accurately describes the storage location of the artifacts referenced in the code snippet?

Medium
127

You are implementing a CI/CD pipeline for ML models on Databricks. The pipeline must automatically retrain, validate, and promote models to Production in MLflow Model Registry. Which TWO practices are essential for maintaining reproducibility and governance in this automated workflow? (Choose two.)

Hard
128

A team wants to track model performance over time to detect drift without writing custom monitoring infrastructure. What is the most efficient Databricks tool for this?

Medium
129

A machine learning engineer is preparing a scikit-learn model for batch scoring with MLflow on Databricks. The team wants the logged model to carry a reproducible environment and a machine-readable description of the input and output schema so downstream consumers can validate requests. Which TWO actions should the engineer take when logging the model with `mlflow.sklearn.log_model`? (Choose two.)

Hard
130

Refer to the exhibit. A data scientist attempted to register a new model version but received the error shown in the exhibit. Which step should be taken to resolve this issue?

Hard
131

A machine learning engineer is preparing to deploy a model to production using MLflow Model Registry. They want to ensure that the model can be easily served and that its dependencies are correctly captured. Which TWO actions should they take when logging the model to guarantee that the serving environment can recreate the necessary Python environment? (Choose two.)

Hard
132

A machine learning engineer is building a feature engineering pipeline in Databricks using Feature Store. They need to ensure that the same feature computation logic is used for both training and batch scoring, and that features are automatically refreshed. Which approach should they take?

Hard
133

A data scientist has trained a model and registered it in Unity Catalog. They now need to deploy it for real-time inference with automatic scaling and a REST API endpoint. Which Databricks feature should they use?

Easy
134

Which THREE of the following are considered best practices for handling data preprocessing in a Databricks ML pipeline to prevent data leakage?

Medium
135

You are implementing a CI/CD pipeline for a machine learning model on Databricks. The pipeline must automatically retrain the model when new data arrives, validate its performance, and promote it to production if it meets quality thresholds. Which TWO of the following steps are essential to include in the pipeline to ensure safe and automated deployment? (Choose two.)

Hard
136

An ML engineer is deploying a model to Databricks Model Serving and needs to ensure that the endpoint can handle traffic spikes while minimizing costs during idle periods. The engineer considers enabling scale-to-zero and configuring autoscaling. Which TWO statements about these features are correct? (Choose two.)

Medium
137

Refer to the exhibit. A developer wants to ensure the Random Forest model can be used for automated inference at scale. Based on the provided code, what is missing to enable the model to support the 'predict' method within the Databricks Model Serving environment?

Hard
138

A fraud-detection model is served via a Databricks Model Serving endpoint. Compliance requires that every prediction request be traceable to the exact model artifact that produced it and that the model's inputs be auditable for drift analysis. Which two actions should you take to satisfy these requirements? (Choose two.)

Hard
139

An ML engineering team maintains a feature table in Databricks Feature Store that is populated by a nightly batch job. The same features feed both an offline training pipeline and a Model Serving endpoint. After a schema change adds two columns to the source Delta table, the endpoint begins returning errors during online lookup. The team confirms the offline training pipeline still works. Which change most likely restores the endpoint?

Hard
140

An ML engineer needs to deploy a model to Databricks Model Serving that requires a specific version of a Python library. The library is available on PyPI. Where should the engineer specify this dependency?

Easy
141

An ML engineer wants to ensure that their model training pipeline is robust against data quality issues. Which approach, if integrated into the pipeline, most effectively detects skewed or missing values before training begins?

Medium
142

Refer to the exhibit. A data scientist is logging a Scikit-Learn model to the MLflow Model Registry. Which benefit does providing the `signature` and `input_example` offer during the deployment phase?

Medium
143

A company has deployed a model to a Databricks Model Serving endpoint. The model's predictions must be logged to a Delta table for monitoring and auditing. The ML engineer wants to enable inference logging without modifying the model's code. Which approach achieves this with minimal effort?

Hard
144

A data scientist has deployed a model to a Databricks Model Serving endpoint. The endpoint is configured with scale-to-zero enabled and a workload size of Small. After a period of inactivity, the endpoint scales down to zero. A client application sends a request to the endpoint after this idle period. What happens to the first request?

Easy
145

An ML engineer has deployed a model to Databricks Model Serving and wants to monitor the endpoint's performance over time. They need to track the number of requests, latency, and error rates. Which Databricks feature provides these metrics out-of-the-box?

Easy
146

An ML engineer is updating a production model serving endpoint to use a new model version. The endpoint currently serves version 1 with the 'Champion' alias. The engineer wants to test version 2 with a small percentage of live traffic before full rollout. Which deployment strategy should they use in Databricks Model Serving?

Hard
147

A data scientist registers a new model version to Unity Catalog and wants to promote it to Production after validation. Which action accomplishes this in the current Databricks recommendation?

Easy
148

A financial institution has deployed a credit risk model to a Databricks Model Serving endpoint. The model was trained on data that includes sensitive customer attributes. The compliance team requires that all predictions be explainable and that the model's decisions can be audited. The data science team wants to use SHAP (SHapley Additive exPlanations) to generate explanations for each prediction. Which approach should they take to integrate SHAP with the serving endpoint while maintaining low latency?

Hard
149

Which of the following describes the 'Gold' layer in the Medallion Architecture, and why is it important for machine learning?

Easy
150

A machine learning engineer is using MLflow to track experiments and wants to compare multiple runs to identify the best model. They have logged metrics such as accuracy, precision, and recall. Which MLflow feature allows them to programmatically retrieve and compare these metrics across runs for further analysis?

Hard
151

Your organization requires that all models deployed to production undergo a drift detection check. Which approach is most effective for monitoring model performance in Databricks?

Medium
152

A fraud detection model is deployed to a Databricks Model Serving endpoint. The team wants to test a new model version without affecting existing predictions. They need to send a copy of live traffic to the new version and log its predictions for comparison, while the current version continues to serve all responses. Which feature should they use?

Hard
153

A team is building a feature store in Databricks. They need to ensure that training data and inference data are consistent to avoid training-serving skew. What is the primary benefit of using the Databricks Feature Store in this context?

Medium
154

A machine learning engineer is developing a model on Databricks and wants to ensure that the model's input schema is enforced during inference. They are using MLflow to log the model. What should they do?

Medium
155

An ML engineer wants to ensure that only models that have passed a specific validation suite can be assigned the 'Champion' alias in Unity Catalog. What is the recommended way to automate this process?

Medium
156

An ML engineer is deploying a model to Databricks Model Serving that uses a custom Python function as a pre-processing step. The function relies on a global variable defined in a separate module. After deployment, the endpoint returns errors indicating the global variable is not defined. The engineer confirmed the module is included in the model's conda environment. What is the most likely cause?

Hard
157

You are preparing a model for deployment in a production Databricks environment. Which THREE steps should be included in your model development pipeline to ensure model quality and traceability?

Hard
158

An ML engineer is deploying a scikit-learn model to a Databricks Model Serving endpoint. The model's inference function requires access to an external feature store table for real-time feature lookup. Which approach allows the model to retrieve these features during serving while maintaining low latency and avoiding per-request authentication complexity?

Medium
159

A data scientist is using MLflow on Databricks to tune a scikit-learn GradientBoostingRegressor with Hyperopt. They configure fmin with max_evals=50, but notice that runs appear in the experiment without parameters or metrics logged, and the best model cannot be reproduced. They want to ensure every trial is fully tracked. Which change should they make?

Medium
160

A data scientist wants to use MLflow to track a scikit-learn model training run on Databricks. They call `mlflow.sklearn.autolog()` before training. Which of the following will MLflow automatically log for this run?

Easy
161

A company uses Databricks Model Serving to host a real-time model. They need to perform A/B testing between two model versions, sending 10% of traffic to a new version and 90% to the current version. Which approach should they use?

Hard
162

Your team uses Databricks Model Serving to host a production model. You need to ensure zero-downtime updates while maintaining the ability to revert to the previous version instantly if performance degrades. Which deployment strategy should you implement?

Medium
163

A financial services company uses Databricks Model Serving to deploy a real-time fraud detection model. The endpoint is configured with scale-to-zero enabled. During a period of no traffic, the endpoint scales down to zero. When a sudden burst of requests arrives, the first few requests experience high latency. Which mechanism is responsible for this behavior?

Hard
164

A team is transitioning from manual experimentation to a formal MLOps pipeline. Which component should be prioritized to ensure that data used during training is reproducible?

Medium
165

A data scientist has a model registered in Unity Catalog and wants to let an external application score it over HTTPS without embedding Databricks credentials in the application. The application's identity is already a service principal in the workspace. Which approach should be used to authenticate calls to the Model Serving endpoint?

Easy
166

A data scientist is training a model with scikit-learn on Databricks and wants to track the experiment using MLflow. They call mlflow.start_run() and then train the model. After training, they call mlflow.log_param() and mlflow.log_metric(), but later find that the run is not visible in the MLflow experiment UI. What is the most likely reason?

Easy
167

Your team is migrating models to Databricks Model Registry. You need to ensure that production models are only deployed after passing specific validation tests. Which feature best facilitates this automated governance?

Medium
168

A data scientist needs to perform batch inference on a large dataset stored in Delta Lake using a model registered in the Unity Catalog. Which approach is most efficient for leveraging Spark's distributed computing capabilities while using the MLflow model?

Medium
169

When working in Databricks, where should a data scientist primarily look to monitor the resource utilization and execution logs of an active model training job?

Easy
170

Which TWO of the following are primary benefits of using the MLflow Model Registry in Databricks?

Medium
171

A fraud detection team has a model registered in Unity Catalog as main.ml.fraud_model. They need to serve it in real time, but compliance requires that every scoring request automatically generate an audit record in a Delta table, and that the model only be promoted to production after a human reviews the audit logs from a canary period. Which deployment configuration satisfies these requirements?

Medium
172

A machine learning engineer is using MLflow to log a model trained with a custom algorithm. They want to ensure that the model can be served with a specific input schema and that the schema is enforced during inference. Which MLflow feature should they use?

Hard
173

A data scientist is using Hyperopt with SparkTrials on a Databricks cluster to tune an XGBoost classifier. After several trials, they notice that each trial runs on a single executor and the overall tuning job takes much longer than expected. They want to speed up hyperparameter tuning without changing the search space. Which adjustment is most likely to improve performance?

Medium
174

An ML engineer is training a PyTorch model on a Databricks cluster and wants to automatically log training metrics, parameters, and the model artifact to MLflow without writing explicit mlflow.log_* calls in the training script. The engineer also needs the run to be nested under a parent run that tracks the overall experiment. Which approach should the engineer use?

Hard
175

A team notices that a deployed Model Serving endpoint occasionally returns stale predictions for a subset of customers shortly after the nightly feature refresh completes. The offline feature table is confirmed current. Which is the most likely explanation?

Easy
176

A machine learning engineer needs to deploy a custom scikit-learn model to a Databricks Model Serving endpoint with maximum throughput and minimum latency. The model requires an external preprocessing Python script during inference. Which deployment approach best leverages MLflow and Databricks architecture?

Medium
177

A data scientist is using MLflow to track a training run. They want to log a dictionary of hyperparameters and a list of evaluation metrics that are computed at the end of each epoch. Which MLflow API calls should they use to log these items?

Easy
178

When logging a model that requires custom libraries (e.g., a specific version of a non-standard package), how do you ensure the environment is reproducible on the serving endpoint?

Medium
179

When developing a model, which THREE actions should a data scientist perform to ensure the model is ready for production deployment via Model Serving?

Medium
180

Which statement best describes the role of the 'Signature' in an MLflow model when deploying to a Databricks Model Serving endpoint?

Medium
181

A data scientist has registered a model in Unity Catalog and wants to deploy it to a Databricks Model Serving endpoint. What is the simplest way to create the endpoint?

Easy
182

Which THREE features are provided by the Databricks Model Registry for model lifecycle management?

Medium
183

Which action should be taken to ensure that sensitive PII data is not leaked when logging models using MLflow?

Medium
184

When deploying a model to a production endpoint, your team requires that the model is served from a specific, immutable version. How do you ensure this in MLflow?

Hard
185

Which component of MLflow tracks the parameters, metrics, and tags associated with a specific training run?

Easy
186

When hyperparameter tuning using `mlflow.spark.autolog()` or `hyperopt`, what is the primary advantage of logging the parameters to the MLflow tracking server?

Medium
187

You need to ensure that a model deployed to a Databricks Model Serving endpoint can be rolled back quickly if it starts performing poorly. Which feature should you use?

Easy
188

A machine learning engineer needs to schedule a Databricks job that runs a Python wheel task to execute a packaged training pipeline on a recurring basis. The pipeline code is built into a wheel and stored in Unity Catalog volumes. Which job configuration correctly executes this workload?

Easy
189

A machine learning team is using MLflow on Databricks to manage experiments. They want to ensure that their model training runs are reproducible and that they can compare different runs effectively. Which TWO practices should they follow? (Choose two.)

Medium
190

A machine learning engineer is using MLflow to log a model. They want to include custom preprocessing logic that is not part of the model's native library. Which MLflow model flavor should they use to package the model with custom code?

Easy
191

A machine learning engineer is using MLflow to track experiments on Databricks. They want to compare multiple runs of a scikit-learn model and automatically log the best model to the Model Registry. They use `mlflow.sklearn.autolog()` and then call `mlflow.sklearn.log_model` with `registered_model_name`. However, they notice that the model version in the registry does not include the signature or input example. Which action should they take to ensure the signature and input example are logged?

Hard
192

A data science team uses MLflow Tracking with a remote tracking server backed by a Databricks-hosted MySQL instance for the backend store and an Azure Data Lake Storage Gen2 path for artifacts. A model-training notebook writes metrics and a model artifact, then calls mlflow.register_model to promote the run into Unity Catalog. Reviewers report that the run's metrics appear in the experiment UI, but the model version in the registry cannot be loaded by the deployment job. The deployment job fails when it tries to download the artifact. Which action most directly resolves the deployment failure?

Medium
193

A regulated financial services firm must prove that every model promoted to production on Databricks is traceable and governed. They use Unity Catalog for models and MLflow for experiment tracking. Which two practices most directly satisfy an auditor's requirement to trace a production model version back to its training data and code? (Choose two.)

Hard
194

A data scientist is building a model that requires custom preprocessing logic that is not available in standard libraries. They need to ensure this logic is bundled with the model for inference. What is the recommended approach to encapsulate this custom logic?

Medium
195

An ML engineer is instrumenting a Databricks job that trains and evaluates several models. They want each model's metrics, parameters, and artifacts grouped so that a downstream automated promotion step can compare candidates within the same experiment. Which MLflow practice best supports programmatic comparison across runs in this job?

Hard
196

A data scientist has trained a model and wants to register it in the MLflow Model Registry on Databricks. They want to indicate that the model is ready for testing in a pre-production environment. Which stage should they transition the model version to?

Easy
197

A machine learning engineer is training a model using MLflow on Databricks and wants to compare multiple runs to select the best hyperparameters. They need to view metrics across runs in a single interface. Which MLflow feature should they use?

Easy
198

An ML engineer is training a model on Databricks using MLflow and wants to ensure that the training process is deterministic across runs. They set the random seed for NumPy, Python, and the machine learning framework. However, they observe that the model's performance varies slightly between runs on the same data and cluster configuration. Which factor is most likely causing the non-determinism?

Hard
199

You are managing a Databricks environment and need to ensure that ML models are reproducible across different workspaces. Which strategy is most effective for cross-workspace model promotion?

Hard
200

A data scientist wants to automate the retraining of a model whenever new data arrives in a Delta table. They need to orchestrate a multi-step workflow that includes data validation, feature engineering, model training, and deployment. Which Databricks feature should they use?

Easy
201

Your team uses MLflow Model Registry. A model version currently in Production has a critical flaw and must be rolled back to a previous version. The previous version is in the Archived stage. What is the most operationally sound approach to restore service quickly while preserving the audit trail?

Medium
202

You are monitoring a model served on a Databricks Model Serving endpoint. You need to track the distribution of incoming request payloads to detect data drift. Which Databricks feature should you use to automatically capture and store inference logs for analysis?

Easy
203

A team is using Databricks Feature Store to manage features for a real-time fraud detection model. They need to ensure that the features used during training are consistent with those served at inference time. Which two actions should they take to achieve this? (Choose two.)

Hard
204

You are developing an MLflow project and want to ensure that your code is reusable. What is the benefit of defining an MLproject file?

Medium
205

Which component of Databricks is specifically designed to prevent training-serving skew by ensuring that feature engineering code is consistent during both model training and real-time inference?

Easy
206

Which method is the most appropriate for logging custom pre-processing logic alongside a model so that it is automatically applied during inference in Databricks?

Medium
207

In an automated MLOps workflow, what is the best practice for handling model training failures?

Medium
208

Which of the following is an advantage of using Databricks AutoML compared to building a custom Scikit-Learn training loop?

Medium
209

A machine learning engineer has deployed a model to a Databricks Model Serving endpoint. The model requires a custom Python package that is not available in the default environment. The engineer has already logged the model with MLflow and included the package in the conda environment. However, upon deployment, the endpoint fails to start. What is the most likely cause?

Hard
210

You are retiring a real-time model endpoint on Databricks Model Serving. The endpoint has been serving production traffic for six months and you want to archive its request logs for compliance before deleting the endpoint. Which action should you take first?

Medium
211

An ML engineer is using MLflow to track a deep learning experiment with PyTorch on Databricks. They want to capture the model's architecture, optimizer state, and training metrics, and later reproduce the exact training run. They call `mlflow.pytorch.autolog()` before training. After several epochs, they notice that metrics are logged but the model signature is missing, and the logged model cannot be loaded for inference without specifying the input example. What should they do to ensure the model is properly logged with a signature?

Hard
212

A data scientist is iterating on a model and notices that their training runs are becoming disorganized. What is the standard Databricks mechanism for tracking different 'attempts' at model improvement within a single project?

Medium
213

A machine learning engineer is using Databricks AutoML to train a classification model. They notice that the best model from AutoML has a high F1 score on the validation set but performs poorly on a holdout test set. They suspect that the data has a temporal component and that the default train/validation split is causing data leakage. What should they do to address this?

Hard
214

A machine learning engineer is using MLflow to log a custom PyTorch model. They define a custom pyfunc class that inherits from mlflow.pyfunc.PythonModel and implements predict(). After logging the model with mlflow.pyfunc.log_model(), they load it with mlflow.pyfunc.load_model() and call predict() with a pandas DataFrame. The prediction fails with an error about missing context. What is the most likely cause?

Hard
215

A data scientist is using MLflow to log a custom PyTorch model on Databricks. They want to ensure that the model can be loaded and used for inference without requiring the original training code. Which MLflow feature should they use to package the model with its dependencies?

Hard
216

Refer to the exhibit. The deployment pipeline is failing to load the model artifact in the target production environment. What is the most likely cause?

Hard
217

A team wants a scheduled Databricks job to automatically retrain a demand-forecasting model whenever the upstream feature table receives new data, and to register the resulting model version only if validation metrics improve. Which Databricks capability should they use to orchestrate this?

Easy
218

A data scientist has registered a model in Unity Catalog under the name `prod.ml.forecast_model`. They now need to define a service-level objective (SLO) that automatically monitors the model's prediction quality in production, not just endpoint uptime. Which Databricks feature should they configure to detect model performance degradation?

Medium
219

Which feature in Databricks allows you to automatically track training code, parameters, metrics, and models during the development phase?

Easy
220

A data scientist has registered a model in Unity Catalog and wants to deploy it to a Databricks Model Serving endpoint. The model version is 3 and the model name is 'fraud_model'. Which identifier should be used to reference this model version when creating the endpoint?

Easy
221

Which Databricks feature is specifically designed to manage the lifecycle of a machine learning model, including versioning, stage transitions, and deployment tracking?

Medium
222

A data science team trains a scikit-learn model on a Databricks cluster and needs the same feature-engineering logic to run identically in a nightly batch scoring job and in a real-time Model Serving endpoint. They want a single artifact that encapsulates preprocessing and the estimator. Which approach should they use?

Medium
223

Which TWO statements regarding the use of Unity Catalog in Databricks for MLOps are correct?

Medium
224

When using MLflow to manage the machine learning lifecycle, what is the primary purpose of the 'conda.yaml' or 'requirements.txt' file automatically generated during log_model?

Hard
225

A team is building an automated retraining pipeline. They need to ensure that only models exceeding a certain performance threshold are registered. What is the most effective way to implement this logic?

Hard
226

A data scientist is using Databricks Feature Store to build a training set for a fraud detection model. The feature table contains a column `transaction_time` that is a timestamp. After creating the training set with `create_training_set`, the resulting DataFrame includes `transaction_time` but the model training code fails because the timestamp is not accepted by the XGBoost trainer. What is the most likely cause and correct resolution?

Medium
227

A machine learning engineer needs to deploy a custom PyTorch model to a Databricks Model Serving endpoint. The model requires a custom pre-processing step that is not part of the standard MLflow transformers or pyfunc flavor. Which deployment approach ensures the custom logic executes reliably within the serverless serving container?

Medium
228

A data scientist is using the Databricks Feature Store to build a training set for a fraud-detection model. The feature table is created with a primary key of `customer_id` and a timestamp key of `transaction_ts`. When calling `create_training_set`, the scientist wants to ensure that each label row receives exactly the most recent feature value available at or before the label's timestamp. Which argument must be supplied to `create_training_set` to enforce this point-in-time behavior?

Medium
229

You are performing hyperparameter tuning using Hyperopt on Databricks. Which TWO configurations must be defined to ensure optimal performance and result tracking?

Medium
230

An ML engineer needs to deploy a model to Databricks Model Serving that requires a custom Python package. The package is not available in the default Databricks Runtime and must be installed from a private PyPI repository. Which approach should be used to include this package in the model's environment?

Medium
231

Refer to the exhibit. A data scientist is preparing to log a model. What is the primary benefit of including the explicit 'signature' provided in the exhibit during the mlflow.log_model process?

Medium
232

A data science team is using Databricks Model Serving to deploy a model that must process sensitive data. They need to ensure that all inference requests are logged for auditing purposes, including the input data and predictions. Which approach should they take?

Medium
233

What is the primary advantage of using a Model-as-Code approach in Databricks for machine learning deployments?

Medium
234

You are developing a machine learning pipeline where you need to perform feature engineering on a large dataset using Spark, then train a model using Scikit-Learn. Which workflow is most efficient?

Medium
235

A machine learning team is using `mlflow.autolog()` to track experiments. They notice that certain custom metrics are not being captured. What is the most effective way to address this?

Medium
236

A machine learning team is using MLflow Model Registry to manage a model that is deployed to a production endpoint. They need to implement a CI/CD pipeline that automatically transitions a model version from 'Staging' to 'Production' only after it passes a set of validation tests. Which MLflow feature allows them to trigger the transition based on test results?

Hard
237

You are responsible for a fraud detection model deployed to a Databricks Model Serving endpoint. The model was trained on transaction data from the past 6 months. After two months in production, you notice a gradual decline in precision and recall. You suspect data drift. Which approach should you use to monitor feature drift for this endpoint?

Medium
238

A data science team is deploying a model to Databricks Model Serving and needs to ensure that the endpoint can handle sudden spikes in traffic without dropping requests. They want to configure auto-scaling appropriately. Which TWO parameters should they adjust to control the scaling behavior? (Choose two.)

Medium
239

You are implementing model monitoring to detect data drift. Which Databricks feature should you use to automatically track and alert on changes in the distribution of input data features over time?

Medium
240

Refer to the exhibit. A machine learning team has updated their model serving endpoint configuration as shown in the JSON. Which deployment strategy is being implemented, and what is the primary risk associated with this specific configuration?

Hard
241

Which practice is most effective for managing dependencies to ensure consistent model training and inference results across different Databricks clusters?

Medium
242

A data scientist is using Databricks Feature Store to build a training set for a fraud detection model. They define a feature table with a primary key of `transaction_id` and a timestamp key of `event_ts`. When creating the training set with `create_training_set`, they specify `lookup_key=['transaction_id']`. The resulting training set contains features from multiple feature tables. Which statement describes how point-in-time correctness is ensured during this operation?

Medium
243

An ML engineer is deploying a model to Databricks Model Serving that uses a custom transformer requiring a GPU. The endpoint must handle high throughput with low latency. Which workload type and configuration should be selected?

Hard
244

Your organization requires that all models deployed to production must be signed by a security officer. How can you enforce this requirement within the Databricks MLflow Model Registry?

Medium
245

A team uses MLflow Projects to package training code and runs jobs on Databricks clusters. They want to ensure that a job run today can be reproduced six months later with the same library versions, even if the cluster's base image and PyPI packages have changed. Which practice best achieves this?

Medium
246

A machine learning engineer is using Databricks Model Serving to deploy a model that requires a custom Python library not available in the default environment. The engineer wants to ensure the endpoint uses the exact library version and that the deployment is reproducible. Which approach should the engineer take?

Medium
247

Refer to the exhibit. Your automated CI/CD pipeline triggered a model deployment to production, but the job failed with the error shown. What is the most likely cause?

Medium
248

What is the primary purpose of registering a model in the MLflow Model Registry?

Easy
249

A fraud detection model is served on a Databricks Model Serving endpoint. You notice that predictions for the same input vector differ between two consecutive requests within seconds, and there is no feature store or external cache involved. The model was logged with a fixed random seed and deterministic inference code. Which action should you take first to diagnose the inconsistency?

Hard
250

A machine learning team is transitioning from local notebooks to Databricks. They want to ensure their code is modular and reusable. Which THREE practices should they implement?

Medium
251

When auditing an ML pipeline in Databricks for compliance and governance, which THREE of the following should be verified?

Hard
252

A data scientist is training a scikit-learn model on Databricks and wants to capture the best hyperparameters found during a hyperparameter sweep. They are using MLflow Tracking with nested runs. Which approach correctly records the best parameters and metrics in the parent run?

Medium
253

Your organization is implementing an MLOps strategy that requires strict model governance. You need to ensure that no model is deployed to production unless it has been tagged with 'validated=true' in the MLflow Model Registry. How can you enforce this policy within your CI/CD workflow?

Hard
254

Which of the following describes the purpose of a 'Gold' table in the Medallion architecture within an MLOps pipeline?

Medium
255

A machine learning engineer has a model registered in Unity Catalog as prod.ml.iris_model. They need to deploy it to a real-time serving endpoint that automatically scales based on traffic and provides a REST API for predictions. The model's signature is logged. Which deployment method should they use?

Medium
256

A data scientist wants to compare multiple runs within the same MLflow experiment to identify the best-performing model based on a custom metric. What is the most efficient way to do this in the MLflow UI?

Easy
257

A team is using Databricks Feature Store to manage features for a real-time model served via Databricks Model Serving. They need to ensure that the online feature values used at inference time are consistent with the training data. Which TWO practices should they implement? (Choose two.)

Hard
258

A machine learning engineer is developing a custom PyFunc model that combines a scikit-learn preprocessing step and a TensorFlow model. They log the model with MLflow and specify a signature. When they attempt to serve the model using Databricks Model Serving, the endpoint returns errors about incompatible input types. The signature was inferred from a pandas DataFrame with integer columns, but the serving request sends JSON with floating-point numbers. Which modification to the model signature will resolve this issue?

Hard
259

A data scientist at your company has trained a scikit-learn model and logged it with MLflow using the default 'sklearn' flavor. The model must now be deployed to a Databricks Model Serving endpoint for real-time inference, and the endpoint must automatically reload the new version whenever the model's stage changes to 'Production' in the MLflow Model Registry. Which deployment approach should the team use?

Medium
260

A machine learning engineer needs to deploy a custom PyTorch model to a Databricks Model Serving endpoint. The model requires custom post-processing logic and loading auxiliary tokenizer files alongside the serialized weights. Which approach provides the correct mechanism to package and serve this custom artifact?

Medium
261

A machine learning engineer is training a model using scikit-learn on Databricks and wants to track the model's hyperparameters, metrics, and artifacts automatically without adding explicit logging calls. Which MLflow feature should they use?

Easy
262

An ML engineer has registered a scikit-learn model in the Unity Catalog Model Registry and wants to serve it as a real-time endpoint using Databricks Model Serving. The model's MLflow signature expects a JSON payload with an array of records. The engineer creates a serving endpoint with a workload size of Medium and configures the served entity to use the latest model version. Which additional configuration is required to enable automatic payload logging to a Delta table for monitoring?

Medium
263

You are building a Databricks job that trains a model and registers it to the MLflow Model Registry. After registration, you need to automatically transition the model version to 'Staging' only if its validation accuracy exceeds 0.95. The job should fail if the accuracy is below this threshold. Which approach should you implement?

Medium
264

A data scientist is training a machine learning model on Databricks using MLflow. They need to track hyperparameter tuning experiments while ensuring that each iteration is uniquely identifiable and reproducible. Which feature should they use to group related runs within a single experiment?

Medium
265

An ML engineer is deploying a model to Databricks Model Serving and needs to enable automatic scaling based on traffic. The model has variable inference latency and the team wants to optimize cost while maintaining performance. Which TWO configurations are required to achieve this? (Choose two.)

Hard
266

A team has deployed a model to Databricks Model Serving and enabled inference tables. They notice that the inference table contains request and response payloads but no ground truth labels. They want to automatically join ground truth labels for monitoring. What should they do?

Hard
267

A machine learning team is using Databricks Feature Store to manage features for their models. They want to ensure that the features used during training are consistent with those served in production. Which TWO practices should they follow? (Choose two.)

Medium
268

When logging a model to the MLflow Model Registry, what is the primary benefit of using a registered model name rather than just the model URI?

Easy
269

Refer to the exhibit. An administrator notices that the cost for this specific endpoint is higher than expected even when there is no traffic. Based on the exhibit, what is the most likely cause of the high idle cost?

Hard
270

Which THREE of the following are primary responsibilities of an MLOps engineer when maintaining production ML models in Databricks?

Hard
271

Your team is using Databricks Feature Store to serve features to a real-time model deployed on Databricks Model Serving. A data scientist updates the feature computation logic for one of the features and publishes a new version to the online store. However, the model endpoint continues to return stale feature values for that feature. What is the most likely cause?

Medium
272

A machine learning engineer is preparing a model for deployment using Databricks Model Serving. They need to ensure that the model's input schema is enforced and that the model can be served with a specific version. Which TWO actions should they perform? (Choose two.)

Hard
273

A machine learning engineer is training a PyTorch model on a Databricks cluster and needs to distribute the training across multiple worker nodes. Which framework should be integrated natively within Databricks to handle this distributed deep learning workflow efficiently?

Medium
274

A machine learning engineer is responsible for monitoring a production model deployed to Databricks Model Serving. The model predicts customer churn and is served via a REST endpoint. The engineer needs to detect data drift and model performance degradation over time. Which TWO actions should the engineer take to enable effective monitoring? (Choose two.)

Hard
275

An ML engineer has a Databricks Model Serving endpoint that is currently serving a registered model version. A new model version is registered in Unity Catalog and must be rolled out to the endpoint without any downtime. Which approach should the engineer use to safely transition traffic to the new model version?

Hard
276

Refer to the exhibit. You are loading a model from the registry. What does the 'models:/MyModel/1' URI specifically represent?

Hard
277

A data scientist wants to record the exact library dependencies and a code snapshot alongside a model so that a reviewer can later restore the same environment and reproduce the training run. They are logging with MLflow on Databricks. Which practice best satisfies this requirement?

Easy
278

A machine learning engineer is deploying a model to Databricks Model Serving and wants to implement a blue-green deployment strategy. They have registered two model versions in Unity Catalog: version 1 (current production) and version 2 (new candidate). They want to route 10% of traffic to version 2 for testing while keeping 90% on version 1. Which feature should they use to achieve this?

Hard
279

An ML engineer is deploying a scikit-learn model to a Databricks Model Serving endpoint. The model expects a single feature vector of 10 float values per request. The endpoint must return predictions in under 100 ms. Which approach should the engineer use to minimize per-request overhead?

Medium
280

A data scientist is developing a model on Databricks and wants to use MLflow to compare multiple runs. They need to quickly identify the run with the lowest validation loss. Which MLflow UI feature allows them to sort and filter runs based on metrics?

Medium
281

Your ML pipeline requires a complex environment with specific C++ dependencies. What is the recommended way to manage this in Databricks?

Medium
282

Which component of Databricks ML is best suited for tracking model hyperparameters, metrics, and code versions during the experimentation phase of the ML lifecycle?

Easy
283

An ML engineer is training an XGBoost model on Databricks and wants to leverage hyperparameter tuning using Hyperopt while automatically logging all trial parameters, metrics, and models to MLflow. Which built-in MLflow function should be used to achieve this automatic integration?

Medium
284

You are using Databricks Feature Store to manage features for a model. A feature table is updated daily with new data. Your model training job reads from the feature table and logs the model with MLflow. To ensure that the model in production uses the correct feature values at inference time, what must you do when logging the model?

Hard
285

A financial institution deploys a credit scoring model using Databricks Model Serving. The model must log all incoming requests and outgoing responses to a Delta table for auditing. The ML engineer needs to enable this logging with minimal performance impact. Which solution should they implement?

Hard
286

Your team uses MLflow Projects to package training code. A colleague runs the project on a Databricks cluster and it fails with a dependency conflict because the cluster has an older version of a library than the project's conda environment specifies. What is the most reliable way to ensure the project uses its declared dependencies without modifying the shared cluster?

Medium
287

You are designing a CI/CD pipeline for a machine learning model on Databricks. The pipeline must automatically retrain the model when new data arrives, validate it, and deploy it to a serving endpoint if it passes. Which two components are essential to achieve this? (Choose two.)

Medium
288

You are auditing a Databricks environment to ensure compliance. Which TWO actions ensure the highest level of model lineage and reproducibility for models registered in MLflow?

Hard
289

A team is developing a model on Databricks and wants to run an automated hyperparameter search over a scikit-learn pipeline. They need to try many parameter combinations in parallel across cluster workers while keeping every trial's parameters and metrics in MLflow. Which Databricks capability should they use to orchestrate the search?

Medium
290

Your organization requires a feature store strategy that supports low-latency point-in-time lookups for online inference. Which implementation approach best addresses this?

Hard
291

When deploying a model as a real-time REST endpoint on Databricks, how can you ensure the infrastructure scales automatically to handle increased request traffic?

Medium
292

A data scientist is using MLflow to track experiments on Databricks. They notice that some runs are missing the model artifact even though they called mlflow.sklearn.log_model(). What is the most likely cause?

Medium
293

When designing a model training pipeline, which TWO features of Unity Catalog best support compliance and model governance?

Hard
294

A data scientist is training a deep learning model on Databricks. They observe that the training process is significantly slower than expected. Upon inspection, they find that data loading from DBFS is the bottleneck. What is the most effective way to improve data loading speed for deep learning training on Databricks?

Medium
295

An ML engineer needs to deploy a model to Databricks Model Serving. The model was logged with MLflow and registered in Unity Catalog. The engineer wants to ensure that only the latest version of the model is served and that the endpoint can be updated without downtime. Which approach should they use?

Easy
296

An ML engineer is deploying a model to Databricks Model Serving and wants to implement A/B testing between two model versions. The engineer needs to route a percentage of traffic to each version and collect performance metrics. Which feature of Databricks Model Serving should the engineer use?

Hard
297

A team runs a weekly retraining job that produces a new model version in Unity Catalog. Their production endpoint is currently serving version 4. They want to promote version 5 with zero downtime and the ability to roll back instantly if error rates rise. Which approach best meets these requirements?

Medium
298

A team has deployed a model to Databricks Model Serving and wants to enable autoscaling to handle variable traffic. They configure the endpoint with scale_to_zero_enabled set to true and a min_provisioned_concurrency of 0. After deployment, they notice that the endpoint takes several seconds to respond to the first request after a period of inactivity. What is the cause of this latency?

Hard
299

Refer to the exhibit. What happens to these logged metrics in MLflow when the training run completes?

Medium
300

A machine learning engineer needs to track hyperparameter tuning experiments in Databricks using MLflow. Which approach best ensures that model training runs are associated with the correct code version and environment settings?

Medium

Frequently asked questions

What does the scenario questions domain cover on the Databricks-ML-Pro exam?
scenario questions questions test whether you can apply the concept in context, not just recognise a definition.
How many questions are in this domain?
This page lists all 300 scenario questions questions in the Databricks-ML-Pro question bank. The actual exam draws from this domain proportionally to its weighting in the official exam blueprint.
What is the best way to practise this domain?
Start with a short focused session (10 questions) to identify gaps, then work through explanations. Repeat with a longer session once the weak areas feel solid.
Can I practise only scenario questions questions?
Yes — the session launcher on this page filters questions to this domain only. Choose any session length for inline explanations and scoring.