Databricks-ML-Pro ML Ops — All Questions With Answers

Question 1mediummultiple choice

A company uses MLflow in Databricks to track experiments. They want to ensure that every experiment run is associated with a specific git commit hash to ensure reproducibility. What is the best way to achieve this?

Question 2hardmultiple choice

Refer to the exhibit. An engineer attempts to delete a model version but receives this error. What is the most likely cause?

Exhibit

Error: "mlflow.exceptions.RestException: RESOURCE_DOES_NOT_EXIST: Model version 10 is not in stage 'None'"

Question 3mediummultiple choice

Read the full ML Ops explanation →

Your team is using MLflow Model Registry to manage production-ready models. You need to ensure that only models reviewed by the lead data scientist are deployed to the production endpoint. Which workflow provides the most secure and scalable approach?

Question 4hardmultiple choice

Read the full ML Ops explanation →

Which TWO actions should be taken when setting up a Feature Store in Databricks to ensure data consistency between offline training and online serving?

Question 5hardmultiple choice

Read the full ML Ops explanation →

Refer to the exhibit. A MLOps engineer is troubleshooting a deployment pipeline. The model version 14 has reached the registry but is not triggering the automated deployment job. What is the most likely cause?

Exhibit

{
  "model_name": "revenue_forecast",
  "version": "14",
  "status": "PENDING_REGISTRATION",
  "tags": {
    "environment": "staging",
    "team": "finance",
    "validation_score": "0.88"
  }
}

Question 6mediummultiple choice

Read the full ML Ops explanation →

Which THREE criteria are essential for a robust model validation strategy before transitioning a model to the 'Production' stage in MLflow?

Question 7hardmultiple choice

Read the full ML Ops explanation →

Refer to the exhibit. The model serving endpoint is failing during high-latency requests. What is the most appropriate configuration change to resolve this?

Exhibit

LOG_LEVEL: INFO
MLFLOW_TRACKING_URI: databricks
DEPLOY_ENVIRONMENT: PROD
ENABLE_AUTO_REGISTRATION: TRUE
SCORING_TIMEOUT: 60s
ERROR: RequestTimeoutException: Model failed to respond within 60s

Question 8mediummultiple choice

Read the full ML Ops explanation →

Your organization wants to prevent models with known vulnerabilities from being deployed. Which Databricks feature should be implemented to scan model dependencies?

Question 9mediummultiple choice

Read the full ML Ops explanation →

Your team is deploying a model to Databricks Model Serving. You need to ensure the endpoint remains available during a library update that changes the inference environment. Which strategy minimizes downtime for production clients?

Question 10hardmulti select

Read the full ML Ops explanation →

You are auditing a Databricks ML workspace to improve governance. Which TWO features in Unity Catalog are essential for tracking the lineage of ML models and their associated data assets?

Question 11mediummultiple choice

Read the full ML Ops explanation →

Refer to the exhibit. A data scientist attempts to promote a model to 'Production' in the Unity Catalog Model Registry and receives this error. What is the most likely cause?

Exhibit

{
  "model_name": "fraud_detection",
  "version": 5,
  "status": "PENDING_REGISTRATION",
  "error": "PERMISSION_DENIED: User does not have CAN_MANAGE permission."
}

Question 12mediummulti select

Read the full ML Ops explanation →

Which THREE criteria are required for an MLflow model to be eligible for 'Model Serving' on Databricks?

Question 13hardmultiple choice

Read the full ML Ops explanation →

Your team needs to implement a 'Shadow Deployment' strategy in Databricks. What is the correct approach to achieve this?

Question 14mediummultiple choice

Read the full ML Ops explanation →

An ML engineer needs to deploy a custom MLflow PyTorch model to a Databricks Model Serving endpoint with maximum throughput and minimum latency. The model requires specialized GPU acceleration and depends on custom inference preprocessing logic. Which architectural approach best fulfills this requirement in Databricks Model Serving?

Question 15mediummultiple choice

Read the full ML Ops explanation →

Your team is using MLflow Model Registry to manage the lifecycle of a forecasting model. You need to transition a model version from 'Staging' to 'Production' only after it passes an automated integration test suite in the CI/CD pipeline. Which approach is the most scalable way to implement this gate?

Question 16mediummulti select

Read the full ML Ops explanation →

You are designing an ML pipeline on Databricks and want to ensure model reproducibility and auditability. Which TWO of the following actions are considered best practices for achieving this?

Question 17mediummultiple choice

Read the full ML Ops explanation →

You have a batch inference pipeline that processes millions of rows daily. The model performance has recently degraded. You need to investigate if the feature distributions have shifted. Which Databricks tool is best suited for monitoring this data drift?

Question 18hardmulti select

Read the full ML Ops explanation →

You are implementing a CI/CD pipeline for your ML projects on Databricks. Which THREE of the following strategies are critical for ensuring reliable and secure model deployment?

Question 19hardmultiple choice

Read the full ML Ops explanation →

Refer to the exhibit. You encounter this error when hitting your model endpoint for the first time after a deployment. What is the most likely cause, and how can you mitigate this?

Exhibit

{
  "model_version": "2",
  "stage": "Staging",
  "deployment_type": "real-time",
  "error_log": "503 Service Unavailable: Model serving endpoint is currently initializing or scaling"
}

Question 20hardmultiple choice

Read the full ML Ops explanation →

You are designing a feature store strategy on Databricks. Which TWO of the following statements correctly describe the benefits of using Databricks Feature Store for MLOps?

Question 21mediummultiple choice

Read the full ML Ops explanation →

Your company uses a multi-workspace architecture for Databricks. You need to deploy a model trained in the 'Development' workspace to the 'Production' workspace. What is the most efficient and secure way to share this model across workspaces?

Question 22mediummultiple choice

Read the full ML Ops explanation →

Refer to the exhibit. A junior data scientist runs the provided code snippet to track a training experiment. Why will this code likely result in a runtime error or an illogical MLflow experiment record?

Exhibit

log_data = {
  "accuracy": 0.92,
  "learning_rate": 0.01,
  "batch_size": 32
}
mlflow.log_metrics(log_data)
mlflow.log_params(log_data)

Question 23mediummultiple choice

Read the full ML Ops explanation →

An ML engineer needs to deploy a custom scikit-learn model to Databricks Model Serving while ensuring that all input data payloads are automatically validated against a predefined schema before inference execution. Which deployment approach best achieves this requirement?

Question 24mediummultiple choice

Read the full ML Ops explanation →

Refer to the exhibit. A data scientist is attempting to load a model saved in Unity Catalog, but the job fails. What is the most likely cause?

Exhibit

MLflow error: 'Cannot load model. Artifact path does not exist in the current Unity Catalog volume.'

Question 25mediummulti select

Read the full ML Ops explanation →

Which THREE practices are considered best for maintaining high-quality ML models in production within Databricks?

Question 26hardmultiple choice

Read the full ML Ops explanation →

Refer to the exhibit. What is the effect of this policy on your Databricks Model Registry?

Exhibit

JSON policy: {"action": "allow", "condition": "if model_stage == 'Production' and user_role != 'Admin'", "effect": "deny_write"}

Question 27mediummulti select

Read the full ML Ops explanation →

Which TWO of the following are essential for implementing an effective CI/CD process for ML on Databricks?

Question 28easymultiple choice

Study the full Python automation breakdown →

You are preparing a scikit-learn model for deployment to a Databricks Model Serving endpoint. When you log the model with MLflow, which flavor should you use to ensure the endpoint can load and serve the model with a minimal, optimized Python environment?

Question 29hardmulti select

Read the full ML Ops explanation →

You are building a CI/CD pipeline for a machine learning model using Databricks Repos and MLflow. The pipeline must automatically test, register, and deploy the model to a staging endpoint. Which TWO steps are essential to include in the pipeline to ensure the model can be served with the correct dependencies? (Choose two.)

Question 30hardmultiple choice

Study the full Python automation breakdown →

You are deploying a model to a Databricks Model Serving endpoint that requires a custom Python library not available in the default environment. You have logged the model with MLflow and specified the library in the conda environment. However, when you attempt to serve the model, the endpoint fails to start. What is the most likely cause?

Question 31hardmultiple choice

Read the full ML Ops explanation →

You are using Databricks Feature Store to serve features for a real-time model deployed on Databricks Model Serving. The feature table is updated every 15 minutes with new streaming data, but the online feature store is refreshed only once daily. Your model's predictions have become stale and inaccurate within an hour of the daily refresh. Which action should you take to minimize prediction latency while ensuring the online store reflects the latest feature values?

Question 32hardmultiple choice

Read the full ML Ops explanation →

Your team runs a nightly Databricks job that retrains a demand-forecasting model and registers a new version in the MLflow Model Registry. A separate production job loads the model by stage. After a recent promotion, the production job started failing with a 'model not found' error, even though the version appears in the registry. The production job uses a service principal with 'Can Read' permission on the registered model. What is the most likely cause?

Question 33hardmultiple choice

Read the full ML Ops explanation →

A machine learning engineer is configuring a Databricks job to run a hyperparameter tuning workflow using Hyperopt. The job must run on a cluster that automatically scales and uses spot instances to reduce cost, while ensuring that the tuning process can recover from spot instance interruptions. Which configuration should they use?

Question 34mediummultiple choice

Read the full ML Ops explanation →

You are building a Databricks job that trains a model and logs it to MLflow. The job must run on a schedule and you need to ensure that every run is associated with a unique experiment and that the model artifacts are stored in a central location for governance. Which combination of MLflow APIs and Databricks features should you use?

Question 35hardmultiple choice

Read the full ML Ops explanation →

A data scientist has registered a model in the MLflow Model Registry and wants to automate the promotion of model versions to the Production stage only after they pass a validation suite. Which mechanism should be used to enforce this gate?

Question 36hardmultiple choice

Study the full Python automation breakdown →

You are using Databricks Model Serving to deploy a model that requires a custom Python library not available in the default environment. You have packaged the library as a wheel file and included it in the MLflow model's conda environment. After deployment, the endpoint fails with an ImportError for that library. What is the most likely reason?

Question 37hardmulti select

Read the full ML Ops explanation →

You are preparing to promote a model version to 'Production' in the MLflow Model Registry on Databricks. Your organization requires that the promotion be gated by automated checks. Which TWO actions should you take to enforce a robust promotion gate? (Choose two.)

Question 38mediummultiple choice

Read the full ML Ops explanation →

You are using Databricks Repos to manage ML project code and need to ensure that a training job always uses the latest version of the code from a specific branch. The job is scheduled to run daily. Which configuration should you use to guarantee the job uses the most recent commit on that branch?

Question 39mediummultiple choice

Read the full ML Ops explanation →

A data scientist at a retail company has trained a scikit-learn model using MLflow Tracking and logged the model with the default signature. When they attempt to register the model to Unity Catalog using mlflow.register_model(), the registration fails with an error about missing required metadata. The workspace has Unity Catalog enabled and the target catalog and schema already exist. What is the most likely cause?

Question 40easymultiple choice

Read the full ML Ops explanation →

A data scientist has trained a scikit-learn model and logged it with MLflow using the default flavor. They now need to register this model in the MLflow Model Registry and later serve it on a Databricks Model Serving endpoint. Which MLflow model flavor should they use to ensure the model can be loaded and served without custom code?

Question 41hardmultiple choice

Read the full ML Ops explanation →

A data scientist notices that a model registered in MLflow Model Registry shows a different signature than the one logged during training. The model was trained in a notebook that used a pandas DataFrame with a column of type int64, but the registered signature shows long. What is the most likely explanation?

Question 42easymultiple choice

Read the full ML Ops explanation →

A data scientist wants to promote a model version to Production in MLflow Model Registry but the transition is blocked. The registered model has stage transitions enabled and the user has CAN_EDIT permission on the model. Which is the most likely reason the transition fails?

Question 43mediummultiple choice

Read the full ML Ops explanation →

A data science team is using MLflow Model Registry to manage a model that is retrained weekly. They want to ensure that the Production stage always points to the latest approved model version. The team uses a CI/CD pipeline that registers a new model version and transitions it to Staging after validation. What should the pipeline do next to automatically promote the model to Production while ensuring that the previous Production version is archived?

Question 44mediummultiple choice

Read the full ML Ops explanation →

You are using MLflow Model Registry to manage a model that is deployed to a Databricks Model Serving endpoint. You have transitioned a new model version to the 'Production' stage. You want the serving endpoint to automatically update to serve this new version without manual intervention. What should you do?

Question 45mediummultiple choice

Read the full ML Ops explanation →

A data science team is transitioning from manual model training to automated pipelines in Databricks. They require a mechanism to track model lineage, versions, and stage transitions programmatically. Which Databricks component best satisfies this requirement?

Question 46hardmultiple choice

Read the full ML Ops explanation →

An organization needs to implement a robust CI/CD strategy for their Databricks ML models. Which TWO of the following practices are recommended to ensure reliable model deployment?

Question 47mediummultiple choice

Study the full Python automation breakdown →

Refer to the exhibit. An MLOps engineer is reviewing a JSON object representing a model in the Databricks Model Registry. The engineer wants to promote this model to the 'Production' stage using the MLflow Python API. Which command is correct?

Exhibit

{
  "model_name": "revenue_forecast",
  "version": "5",
  "stage": "Staging",
  "tags": {
    "validation_status": "pending",
    "team": "finance"
  }
}

Question 48mediummultiple choice

Read the full ML Ops explanation →

A team is building a feature store in Databricks. They need to ensure that training data and inference data are consistent to avoid training-serving skew. What is the primary benefit of using the Databricks Feature Store in this context?

Question 49easymultiple choice

Read the full ML Ops explanation →

When deploying a model as a real-time REST API endpoint on Databricks, which service should be used to manage the serving infrastructure, scaling, and availability?

Question 50hardmultiple choice

Read the full ML Ops explanation →

Which THREE of the following are primary responsibilities of an MLOps engineer when maintaining production ML models in Databricks?

Question 51mediummultiple choice

Read the full ML Ops explanation →

What is the primary advantage of using a Model-as-Code approach in Databricks for machine learning deployments?

Question 52mediummultiple choice

Read the full ML Ops explanation →

Which of the following describes the purpose of a 'Gold' table in the Medallion architecture within an MLOps pipeline?

Question 53mediummultiple choice

Read the full ML Ops explanation →

Refer to the exhibit. An engineer is configuring a serving endpoint. Based on the configuration provided, what is the impact of the 'auto_scale' flag?

Exhibit

JSON config = {
  "retention_days": 30,
  "environment": "production",
  "auto_scale": true,
  "max_workers": 10
}

Question 54hardmultiple choice

Read the full ML Ops explanation →

When auditing an ML pipeline in Databricks for compliance and governance, which THREE of the following should be verified?

Question 55mediummultiple choice

Read the full ML Ops explanation →

A machine learning engineer needs to track model experiments and ensure that all training parameters and metrics are captured in a reproducible way. What is the best practice for using MLflow within Databricks notebooks?

Question 56mediummultiple choice

Read the full ML Ops explanation →

Your organization requires that all models deployed to production undergo a drift detection check. Which approach is most effective for monitoring model performance in Databricks?

Question 57hardmultiple choice

Read the full ML Ops explanation →

You are managing a Databricks environment and need to ensure that ML models are reproducible across different workspaces. Which strategy is most effective for cross-workspace model promotion?

Question 58mediummultiple choice

Read the full ML Ops explanation →

Your company uses MLflow tracking. You want to query all experiments that achieved a specific accuracy threshold across multiple teams. What is the most efficient way to achieve this?

Question 59mediummultiple choice

Read the full ML Ops explanation →

When deploying a model to a Databricks Model Serving endpoint, how can you ensure the model scales automatically based on traffic demand?

Question 60mediummultiple choice

Read the full ML Ops explanation →

A team is transitioning from manual experimentation to a formal MLOps pipeline. Which component should be prioritized to ensure that data used during training is reproducible?

Question 61mediummultiple choice

Read the full ML Ops explanation →

Which TWO statements regarding the use of Unity Catalog in Databricks for MLOps are correct?

Question 62mediummultiple choice

Read the full ML Ops explanation →

You are designing a model retraining strategy. What is the most reliable way to trigger a retraining job based on model performance degradation?

Question 63hardmultiple choice

Read the full ML Ops explanation →

Refer to the exhibit. The deployment pipeline is failing to load the model artifact in the target production environment. What is the most likely cause?

Exhibit

{
  "model": "churn_predictor",
  "run_id": "d7a8e9f0",
  "status": "READY",
  "artifacts": {
    "model_path": "/dbfs/mlflow/models/churn/1",
    "conda_env": "environment.yaml"
  }
}

Question 64easymultiple choice

Read the full ML Ops explanation →

Which component of Databricks is specifically designed to prevent training-serving skew by ensuring that feature engineering code is consistent during both model training and real-time inference?

Question 65hardmultiple choice

Read the full ML Ops explanation →

You are implementing a CI/CD pipeline for a model. You want to automate unit testing of the model's inference performance. Which approach is best suited for Databricks?

Question 66mediummultiple choice

Read the full ML Ops explanation →

Refer to the exhibit. If the 'train_model' task fails, what happens to the 'evaluate_model' task in this Databricks Job?

Exhibit

job_config.json:
{
  "tasks": [
    {
      "task_key": "train_model",
      "notebook_task": {
        "notebook_path": "/training"
      }
    },
    {
      "task_key": "evaluate_model",
      "depends_on": [{"task_key": "train_model"}],
      "notebook_task": {
        "notebook_path": "/evaluation"
      }
    }
  ]
}

Question 67hardmultiple choice

Read the full ML Ops explanation →

Your organization wants to monitor production models for drift. Which Databricks service should be used to detect changes in the input data distribution compared to the training data?

Question 68mediummultiple choice

Read the full ML Ops explanation →

Which action should be taken to ensure that sensitive PII data is not leaked when logging models using MLflow?

Question 69easymultiple choice

Read the full ML Ops explanation →

In the context of Databricks MLOps, what is the primary purpose of a 'Staging' environment in the Model Registry?

Question 70mediummultiple choice

Read the full ML Ops explanation →

When deploying a model to a production environment, why is it recommended to use a 'Model Signature'?

Question 71mediummulti select

Read the full ML Ops explanation →

Which TWO of the following are primary benefits of using the MLflow Model Registry in Databricks?

Question 72easymultiple choice

Read the full ML Ops explanation →

Which of the following describes the 'Gold' layer in the Medallion Architecture, and why is it important for machine learning?

Question 73hardmultiple choice

Read the full ML Ops explanation →

Refer to the exhibit. A data scientist attempted to register a new model version but received the error shown in the exhibit. Which step should be taken to resolve this issue?

Exhibit

{
  "model_name": "revenue_forecast",
  "version": 12,
  "status": "PENDING_REGISTRATION",
  "error": "PERMISSION_DENIED",
  "details": "User lacks 'CAN_MANAGE' on Model Registry"
}

Question 74easymultiple choice

Read the full ML Ops explanation →

Which feature in Databricks allows you to automatically track training code, parameters, metrics, and models during the development phase?

Question 75mediummultiple choice

Read the full ML Ops explanation →

Your organization requires that all models deployed to production must be signed by a security officer. How can you enforce this requirement within the Databricks MLflow Model Registry?

Question 76mediummultiple choice

Read the full ML Ops explanation →

You are migrating a legacy ML pipeline to Databricks. You need to ensure that the feature engineering logic used during training is identical to the logic used during real-time inference. What is the recommended approach?

Question 77hardmultiple choice

Read the full ML Ops explanation →

Refer to the exhibit. Why is the missing model signature considered an MLOps risk in a production environment?

Exhibit

MLflow error: 'Could not log model: Model signature is missing. Please provide a signature for improved model serving and validation.'

Question 78mediummultiple choice

Read the full ML Ops explanation →

Which component of MLflow is responsible for keeping track of the different versions of a model as it moves from development to testing and production?

Question 79mediummultiple choice

Read the full ML Ops explanation →

When deploying a model as a real-time REST endpoint on Databricks, how can you ensure the infrastructure scales automatically to handle increased request traffic?

Question 80hardmulti select

Read the full ML Ops explanation →

Your team uses Databricks for machine learning and needs to ensure that model training is fully automated and reproducible. Which THREE of the following are necessary components for a production-grade automated ML pipeline?

Question 81mediummultiple choice

Read the full ML Ops explanation →

You are designing a strategy for monitoring model performance after deployment. Which of the following is the most important indicator that a model requires retraining?

Question 82mediummultiple choice

Read the full ML Ops explanation →

Your team is migrating models to Databricks Model Registry. You need to automate the transition of a model version to 'Staging' only after it passes an automated integration test suite in the CI/CD pipeline. Which mechanism should you use to best achieve this?

Question 83mediummultiple choice

Read the full ML Ops explanation →

Refer to the exhibit. You are managing the 'revenue_forecast' model in the registry. A colleague wants to deploy this version to production. Which Databricks command or process is required to move version 4 to the 'Production' stage while ensuring existing production models remain unaffected?

Exhibit

{
  "model_name": "revenue_forecast",
  "version": 4,
  "stage": "None",
  "tags": {
    "status": "pending_review",
    "owner": "finance_team"
  }
}

Question 84hardmultiple choice

Read the full ML Ops explanation →

Your organization is implementing an MLOps strategy that requires strict model governance. You need to ensure that no model is deployed to production unless it has been tagged with 'validated=true' in the MLflow Model Registry. How can you enforce this policy within your CI/CD workflow?

Question 85hardmultiple choice

Read the full ML Ops explanation →

You are debugging a model serving issue where the model is failing in production. Which THREE of the following actions should you prioritize to identify the root cause of the failure?

Question 86easymultiple choice

Read the full ML Ops explanation →

Which component of Databricks ML is best suited for tracking model hyperparameters, metrics, and code versions during the experimentation phase of the ML lifecycle?

Question 87mediummultiple choice

Read the full ML Ops explanation →

Your organization needs to automate the deployment of models to real-time serving endpoints. Which service within the Databricks ecosystem handles the hosting and scaling of these endpoints with managed containerization?

Question 88mediummultiple choice

Read the full ML Ops explanation →

You are implementing model monitoring to detect data drift. Which Databricks feature should you use to automatically track and alert on changes in the distribution of input data features over time?

Question 89hardmultiple choice

Read the full ML Ops explanation →

When designing a robust MLOps pipeline for high-stakes financial applications, why should you prioritize 'reproducibility' over 'speed' during the deployment phase?

Question 90mediummultiple choice

Read the full ML Ops explanation →

Which THREE of the following are key responsibilities of an MLOps engineer when managing a model lifecycle on Databricks?

Question 91mediummultiple choice

Read the full ML Ops explanation →

Your team is migrating models to Databricks Model Registry. You need to ensure that production models are only deployed after passing specific validation tests. Which feature best facilitates this automated governance?

Question 92hardmulti select

Read the full ML Ops explanation →

You are auditing a Databricks environment to ensure compliance. Which TWO actions ensure the highest level of model lineage and reproducibility for models registered in MLflow?

Question 93hardmultiple choice

Read the full ML Ops explanation →

Your organization requires a feature store strategy that supports low-latency point-in-time lookups for online inference. Which implementation approach best addresses this?

Question 94easymultiple choice

Read the full ML Ops explanation →

Which component of MLflow tracks the parameters, metrics, and tags associated with a specific training run?

Question 95mediummultiple choice

Read the full ML Ops explanation →

Your ML pipeline requires a complex environment with specific C++ dependencies. What is the recommended way to manage this in Databricks?

Question 96hardmultiple choice

Read the full ML Ops explanation →

Refer to the exhibit. Which security configuration is the likely culprit for this job failure?

Exhibit

Error: 'Delta Table access denied: user does not have permission on the table schema.'

Question 97mediummultiple choice

Read the full ML Ops explanation →

A team wants to track model performance over time to detect drift without writing custom monitoring infrastructure. What is the most efficient Databricks tool for this?

Question 98hardmultiple choice

Read the full ML Ops explanation →

When deploying a model to a production endpoint, your team requires that the model is served from a specific, immutable version. How do you ensure this in MLflow?

Question 99easymultiple choice

Read the full ML Ops explanation →

Which Databricks feature is specifically designed to prevent data leakage during model training by ensuring feature values are fetched as they existed at a specific point in time?

Question 100mediummultiple choice

Read the full ML Ops explanation →

In an automated MLOps workflow, what is the best practice for handling model training failures?

Question 101mediummultiple choice

Read the full ML Ops explanation →

Your team uses Databricks Model Serving to host a production model. You need to ensure zero-downtime updates while maintaining the ability to revert to the previous version instantly if performance degrades. Which deployment strategy should you implement?

Question 102hardmulti select

Read the full ML Ops explanation →

Which TWO actions are required to properly implement MLflow Model Registry stages and governance for a machine learning project?

Question 103mediummultiple choice

Read the full ML Ops explanation →

Refer to the exhibit. Your automated CI/CD pipeline triggered a model deployment to production, but the job failed with the error shown. What is the most likely cause?

Exhibit

MLflow Run ID: a1b2c3d4e5f6
Status: FAILED
Error: [Databricks][MLflow] mlflow.exceptions.RestException: RESOURCE_DOES_NOT_EXIST: Model version with name 'customer_churn' and version '5' not found.

Question 104easymultiple choice

Read the full ML Ops explanation →

When implementing a Feature Store in Databricks, what is the primary benefit of using a Feature Table compared to a standard Delta table for feature engineering?

Question 105mediummultiple choice

Read the full ML Ops explanation →

Your team is experiencing 'training-serving skew' where model performance in production is significantly lower than during training. Which approach should you prioritize to mitigate this issue?

Question 106mediummultiple choice

Read the full ML Ops explanation →

You are responsible for a fraud detection model deployed to a Databricks Model Serving endpoint. The model was trained on transaction data from the past 6 months. After two months in production, you notice a gradual decline in precision and recall. You suspect data drift. Which approach should you use to monitor feature drift for this endpoint?

Question 107mediummultiple choice

Read the full ML Ops explanation →

You are retiring a real-time model endpoint on Databricks Model Serving. The endpoint has been serving production traffic for six months and you want to archive its request logs for compliance before deleting the endpoint. Which action should you take first?

Question 108mediummultiple choice

Read the full ML Ops explanation →

A data scientist has registered a model in Unity Catalog under the name `prod.ml.forecast_model`. They now need to define a service-level objective (SLO) that automatically monitors the model's prediction quality in production, not just endpoint uptime. Which Databricks feature should they configure to detect model performance degradation?

Question 109mediummultiple choice

Read the full ML Ops explanation →

Your team is using MLflow Model Registry to manage a model that predicts customer churn. A new version has been registered and passed validation. You need to transition this version to the 'Production' stage and ensure that all downstream scoring jobs automatically use it. What should you do?

Question 110easymultiple choice

Read the full ML Ops explanation →

A team wants to deploy a scikit-learn model to a real-time REST endpoint on Databricks. They have logged the model with MLflow and registered it in Unity Catalog. Which method should they use to create the serving endpoint?

Question 111easymultiple choice

Read the full ML Ops explanation →

A data scientist has trained a scikit-learn model and logged it with MLflow. They now want to register this model in the MLflow Model Registry and transition it to 'Production' to be served via Databricks Model Serving. Which of the following is a prerequisite for registering the model?

Question 112hardmultiple choice

Read the full ML Ops explanation →

A fraud-detection model is registered in Unity Catalog and deployed to a Model Serving endpoint. Compliance requires that every prediction be traceable to the exact model version and the request that produced it. Which combination of Databricks features should you configure to meet this requirement?

Question 113hardmultiple choice

Read the full ML Ops explanation →

You are using Databricks Feature Store to manage features for a model. A feature table is updated daily with new data. Your model training job reads from the feature table and logs the model with MLflow. To ensure that the model in production uses the correct feature values at inference time, what must you do when logging the model?

Question 114hardmulti select

Read the full ML Ops explanation →

You are implementing a CI/CD pipeline for a Databricks ML project using Databricks Repos and Databricks Asset Bundles. You need to ensure that the pipeline promotes code and model artifacts across dev, staging, and prod workspaces consistently. Which TWO practices should you implement to achieve this? (Choose two.)

Question 115easymultiple choice

Read the full ML Ops explanation →

A data scientist registers a new model version to Unity Catalog and wants to promote it to Production after validation. Which action accomplishes this in the current Databricks recommendation?

Question 116mediummultiple choice

Read the full ML Ops explanation →

A data scientist at your company has trained a scikit-learn model and logged it with MLflow using the default 'sklearn' flavor. The model must now be deployed to a Databricks Model Serving endpoint for real-time inference, and the endpoint must automatically reload the new version whenever the model's stage changes to 'Production' in the MLflow Model Registry. Which deployment approach should the team use?

Question 117easymultiple choice

Read the full ML Ops explanation →

You are monitoring a model deployed to a Databricks Model Serving endpoint. You need to track the distribution of input features and model predictions over time to detect data drift. Which Databricks feature should you use?

Question 118mediummultiple choice

Read the full ML Ops explanation →

You are using MLflow to track experiments for a computer vision model. After several runs, you notice that the training loss is not being logged correctly because the metric name contains a space. What is the recommended way to log metrics with names that include spaces?

Question 119hardmulti select

Read the full ML Ops explanation →

A fraud-detection model is served via a Databricks Model Serving endpoint. Compliance requires that every prediction request be traceable to the exact model artifact that produced it and that the model's inputs be auditable for drift analysis. Which two actions should you take to satisfy these requirements? (Choose two.)

Question 120hardmultiple choice

Read the full ML Ops explanation →

A nightly Databricks job trains a model, registers a new version in Unity Catalog, and then updates a Model Serving endpoint that serves the 'champion' alias. The endpoint must switch to the new version only after the job's validation step passes. Which approach correctly enforces this?

Question 121mediummultiple choice

Read the full ML Ops explanation →

A data science team trains a scikit-learn model on a Databricks cluster and needs the same feature-engineering logic to run identically in a nightly batch scoring job and in a real-time Model Serving endpoint. They want a single artifact that encapsulates preprocessing and the estimator. Which approach should they use?

Question 122mediummultiple choice

Read the full ML Ops explanation →

You are preparing a feature-engineering job that reads from a Delta table and writes a feature table. The job must run on a schedule and be idempotent so that reruns after a failure do not duplicate data. Which approach should you use?

Question 123easymultiple choice

Read the full ML Ops explanation →

A team wants a scheduled Databricks job to automatically retrain a demand-forecasting model whenever the upstream feature table receives new data, and to register the resulting model version only if validation metrics improve. Which Databricks capability should they use to orchestrate this?

Question 124mediummultiple choice

Read the full ML Ops explanation →

A data scientist has completed hyperparameter tuning with Hyperopt on Databricks and now needs to register the best-performing model to the MLflow Model Registry, including its signature and input example, so that downstream scoring jobs can validate incoming data. The training script uses MLflow autologging. Which approach most reliably captures the signature and input example during registration?

Question 125mediummultiple choice

Read the full ML Ops explanation →

A data science team at a retail company has registered a demand forecasting model in the MLflow Model Registry. The model version is currently in the 'Staging' stage and has been validated by the QA team. Before promoting it to 'Production', the ML engineer wants to ensure that the model's performance does not degrade when serving live traffic. They decide to deploy the model to a small percentage of production traffic while continuing to serve the existing model. Which Databricks feature should they use to achieve this?

Question 126mediummultiple choice

Read the full ML Ops explanation →

Your team is using Databricks Feature Store to serve features to a real-time model deployed on Databricks Model Serving. A data scientist updates the feature computation logic for one of the features and publishes a new version to the online store. However, the model endpoint continues to return stale feature values for that feature. What is the most likely cause?

Question 127mediummultiple choice

Read the full ML Ops explanation →

You are building a Databricks job that trains a model and registers it to the MLflow Model Registry. After registration, you need to automatically transition the model version to 'Staging' only if its validation accuracy exceeds 0.95. The job should fail if the accuracy is below this threshold. Which approach should you implement?

Question 128hardmultiple choice

Read the full ML Ops explanation →

A team runs a nightly Databricks job that retrains a demand-forecasting model and registers a new version in the MLflow Model Registry. Compliance requires that the model version used for scoring in production be immutably identified and that any subsequent retraining not silently change what production serves. Which practice best satisfies this requirement?

Question 129hardmultiple choice

Read the full ML Ops explanation →

A machine learning engineer is using MLflow Tracking to log metrics and artifacts for a deep learning model. They notice that the training run logs a large number of metrics (e.g., loss per batch) and want to reduce the storage footprint and improve query performance. They also need to retain the ability to compare runs and reproduce results. Which of the following actions is most appropriate?

Question 130mediummultiple choice

Read the full ML Ops explanation →

A data scientist has registered a new model version in MLflow Model Registry and wants to validate it against a golden dataset before promoting it. The validation notebook must run automatically whenever a new version is registered in the 'ChurnModel' registry model, and the result should block promotion if the validation fails. Which approach should the data scientist use?

Question 131easymultiple choice

Read the full ML Ops explanation →

A machine learning engineer needs to automate retraining of a model whenever new data lands in a Delta table. The retraining must run on a schedule, use a specific cluster configuration, and send an email alert on failure. Which Databricks feature should be used to orchestrate this workflow?

Question 132hardmulti select

Read the full ML Ops explanation →

You are implementing a CI/CD pipeline for a machine learning model on Databricks. The pipeline must automatically retrain the model when new data arrives, validate its performance, and promote it to production if it meets quality thresholds. Which TWO of the following steps are essential to include in the pipeline to ensure safe and automated deployment? (Choose two.)

Question 133easymultiple choice

Read the full ML Ops explanation →

You are monitoring a model served on a Databricks Model Serving endpoint. You need to track the distribution of incoming request payloads to detect data drift. Which Databricks feature should you use to automatically capture and store inference logs for analysis?

Question 134easymultiple choice

Study the full Python automation breakdown →

A machine learning engineer needs to schedule a Databricks job that runs a Python wheel task to execute a packaged training pipeline on a recurring basis. The pipeline code is built into a wheel and stored in Unity Catalog volumes. Which job configuration correctly executes this workload?

Question 135mediummultiple choice

Read the full ML Ops explanation →

You maintain a Databricks ML pipeline that trains a model nightly and registers new versions in MLflow Model Registry. A downstream batch scoring job in another workspace loads the model by stage. Auditors require that every production scoring run can be traced back to the exact training data snapshot and code commit. Which approach best satisfies this requirement?

Question 136mediummulti select

Read the full ML Ops explanation →

A financial institution is using Databricks to build and deploy a credit risk model. The model must comply with regulations that require full auditability of the model's lineage, including data sources, transformations, and training parameters. The team uses MLflow for tracking and the Feature Store for feature management. Which TWO of the following practices are essential to meet the auditability requirements? (Choose two.)

Question 137mediummultiple choice

Read the full ML Ops explanation →

A fraud detection model was deployed to a Databricks Model Serving endpoint. Over the past week, the endpoint's p99 latency has increased from 45 ms to 320 ms, but the model's predictions remain accurate. The serving logs show that each request now includes a larger JSON payload with additional transaction metadata. What is the most likely cause of the degradation?

Question 138mediummultiple choice

Study the full Python automation breakdown →

A machine learning engineer is using Databricks Model Serving to deploy a model that requires a custom Python library not available in the default environment. The engineer wants to ensure the endpoint uses the exact library version and that the deployment is reproducible. Which approach should the engineer take?

Question 139easymultiple choice

Study the full Python automation breakdown →

A data scientist has trained a model and logged it with MLflow. They now need to deploy it as a real-time endpoint on Databricks Model Serving. The model requires a custom Python library that is not available in the default environment. What is the correct way to ensure the library is available when serving the model?

Question 140mediummulti select

Read the full ML Ops explanation →

A team is preparing to promote a new model version to production in the MLflow Model Registry. They must ensure the model can be served with a consistent environment across staging and production and that dependency drift is detected before promotion. Which TWO practices should they follow? (Choose two.)

Question 141mediummultiple choice

Read the full ML Ops explanation →

Your team uses MLflow Model Registry. A model version currently in Production has a critical flaw and must be rolled back to a previous version. The previous version is in the Archived stage. What is the most operationally sound approach to restore service quickly while preserving the audit trail?

Question 142hardmultiple choice

Read the full ML Ops explanation →

A fraud detection model is served on a Databricks Model Serving endpoint. You notice that predictions for the same input vector differ between two consecutive requests within seconds, and there is no feature store or external cache involved. The model was logged with a fixed random seed and deterministic inference code. Which action should you take first to diagnose the inconsistency?

Question 143easymultiple choice

Study the full Python automation breakdown →

A data scientist has developed a scikit-learn model and wants to deploy it as a REST API endpoint on Databricks Model Serving. They have logged the model with MLflow and registered it in the MLflow Model Registry. The model requires a specific Python library that is not pre-installed in the Databricks Model Serving environment. What should the data scientist do to ensure the library is available when the model is served?

Question 144mediummulti select

Read the full ML Ops explanation →

You are designing a CI/CD pipeline for a machine learning model on Databricks. The pipeline must automatically retrain the model when new data arrives, validate it, and deploy it to a serving endpoint if it passes. Which two components are essential to achieve this? (Choose two.)

Question 145hardmultiple choice

Read the full ML Ops explanation →

You are monitoring a production model deployed on Databricks Model Serving. You notice that the model's predictions have gradually become less accurate over time, likely due to data drift. You need to implement a solution that automatically detects drift and triggers retraining. Which Databricks feature should you use to monitor the model's input data and performance?

Question 146hardmulti select

Read the full ML Ops explanation →

A team is using Databricks Feature Store to manage features for a real-time fraud detection model. They need to ensure that the features used during training are consistent with those served at inference time. Which two actions should they take to achieve this? (Choose two.)

Question 147hardmultiple choice

Read the full ML Ops explanation →

An ML engineer is instrumenting a Databricks job that trains and evaluates several models. They want each model's metrics, parameters, and artifacts grouped so that a downstream automated promotion step can compare candidates within the same experiment. Which MLflow practice best supports programmatic comparison across runs in this job?

Question 148mediummultiple choice

Read the full ML Ops explanation →

A data science team uses MLflow Tracking with a remote tracking server backed by a Databricks-hosted MySQL instance for the backend store and an Azure Data Lake Storage Gen2 path for artifacts. A model-training notebook writes metrics and a model artifact, then calls mlflow.register_model to promote the run into Unity Catalog. Reviewers report that the run's metrics appear in the experiment UI, but the model version in the registry cannot be loaded by the deployment job. The deployment job fails when it tries to download the artifact. Which action most directly resolves the deployment failure?

Question 149mediummultiple choice

Read the full ML Ops explanation →

You are responsible for deploying a machine learning model to a Databricks Model Serving endpoint. The model must be updated frequently with new versions. You want to ensure that the endpoint remains available during updates and that traffic can be shifted gradually to the new version. Which deployment strategy should you use?

Question 150mediummulti select

Read the full ML Ops explanation →

You are responsible for monitoring a critical model deployed to Databricks Model Serving. You need to detect data drift and model performance degradation. Which TWO of the following actions should you take? (Choose two.)

Question 151hardmultiple choice

Read the full ML Ops explanation →

You are monitoring a model served on Databricks Model Serving. You need to detect data drift in the incoming requests without delaying predictions. Which approach should you use?

Question 152hardmultiple choice

Read the full ML Ops explanation →

A machine learning team is using MLflow Model Registry to manage a model that is deployed to a production endpoint. They need to implement a CI/CD pipeline that automatically transitions a model version from 'Staging' to 'Production' only after it passes a set of validation tests. Which MLflow feature allows them to trigger the transition based on test results?

Question 153easymultiple choice

Read the full ML Ops explanation →

A data scientist is using MLflow Tracking to log experiments for a model that predicts customer lifetime value. They want to compare runs across multiple experiments and identify the best performing run based on a custom metric called 'rmse'. Which MLflow feature should they use?

Question 154mediummultiple choice

Read the full ML Ops explanation →

A fraud detection model is served via a Databricks Model Serving endpoint. The team wants to capture the incoming request payloads and the model's predictions to a Delta table for monitoring and future retraining. Which approach is most appropriate?

Question 155hardmulti select

Read the full ML Ops explanation →

A machine learning engineer is responsible for monitoring a production model deployed to Databricks Model Serving. The model predicts customer churn and is served via a REST endpoint. The engineer needs to detect data drift and model performance degradation over time. Which TWO actions should the engineer take to enable effective monitoring? (Choose two.)

Question 156hardmulti select

Read the full ML Ops explanation →

You are implementing a CI/CD pipeline for a machine learning model on Databricks. The pipeline must automatically run unit tests, train the model, and deploy it to a staging endpoint. Which TWO practices should you follow to ensure the pipeline is reproducible and reliable? (Choose two.)

Question 157hardmultiple choice

Read the full ML Ops explanation →

An ML engineering team maintains a feature table in Databricks Feature Store that is populated by a nightly batch job. The same features feed both an offline training pipeline and a Model Serving endpoint. After a schema change adds two columns to the source Delta table, the endpoint begins returning errors during online lookup. The team confirms the offline training pipeline still works. Which change most likely restores the endpoint?

Question 158easymultiple choice

Read the full ML Ops explanation →

You need to ensure that a model deployed to a Databricks Model Serving endpoint can be rolled back quickly if it starts performing poorly. Which feature should you use?

Question 159easymultiple choice

Read the full ML Ops explanation →

A data scientist wants to automate the retraining of a model whenever new data arrives in a Delta table. They need to orchestrate a multi-step workflow that includes data validation, feature engineering, model training, and deployment. Which Databricks feature should they use?

Question 160hardmultiple choice

Read the full ML Ops explanation →

A machine learning engineer is setting up a CI/CD pipeline for a model deployed to Databricks Model Serving. The pipeline must automatically update the serving endpoint when a new model version is registered in the MLflow Model Registry and passes a validation job. Which Databricks feature should the engineer use to trigger the update?

Question 161hardmulti select

Read the full ML Ops explanation →

A team is using Databricks Feature Store to manage features for a real-time model served via Databricks Model Serving. They need to ensure that the online feature values used at inference time are consistent with the training data. Which TWO practices should they implement? (Choose two.)

Question 162mediummultiple choice

Read the full ML Ops explanation →

A team runs a weekly retraining job that produces a new model version in Unity Catalog. Their production endpoint is currently serving version 4. They want to promote version 5 with zero downtime and the ability to roll back instantly if error rates rise. Which approach best meets these requirements?

Question 163hardmulti select

Read the full ML Ops explanation →

You are building a CI/CD pipeline that must promote an MLflow model version from Staging to Production in Databricks only after automated validation. The pipeline runs in a service principal context. Which two actions are required to implement this safely and repeatably? (Choose two.)

Question 164mediummultiple choice

Read the full ML Ops explanation →

Your team uses MLflow Projects to package training code. A colleague runs the project on a Databricks cluster and it fails with a dependency conflict because the cluster has an older version of a library than the project's conda environment specifies. What is the most reliable way to ensure the project uses its declared dependencies without modifying the shared cluster?

Question 165mediummultiple choice

Read the full ML Ops explanation →

A machine learning engineer is using MLflow to track experiments and has logged a model with a signature. They now want to register this model in the MLflow Model Registry and promote it to Production. Which MLflow API call should they use to add the model to the registry?

Question 166hardmulti select

Read the full ML Ops explanation →

You are implementing a CI/CD pipeline for ML models on Databricks. The pipeline must automatically retrain, validate, and promote models to Production in MLflow Model Registry. Which TWO practices are essential for maintaining reproducibility and governance in this automated workflow? (Choose two.)

Question 167hardmulti select

Read the full ML Ops explanation →

A regulated financial services firm must prove that every model promoted to production on Databricks is traceable and governed. They use Unity Catalog for models and MLflow for experiment tracking. Which two practices most directly satisfy an auditor's requirement to trace a production model version back to its training data and code? (Choose two.)

Question 168mediummultiple choice

Read the full ML Ops explanation →

A team uses MLflow Projects to package training code and runs jobs on Databricks clusters. They want to ensure that a job run today can be reproduced six months later with the same library versions, even if the cluster's base image and PyPI packages have changed. Which practice best achieves this?

Question 169hardmultiple choice

Read the full ML Ops explanation →

A company uses Databricks Model Serving to host a real-time model. They need to perform A/B testing between two model versions, sending 10% of traffic to a new version and 90% to the current version. Which approach should they use?

Question 170easymultiple choice

Study the full Python automation breakdown →

A machine learning engineer is setting up a Databricks job to retrain a model every night. The job must use a specific Python library version that is not available in the default Databricks Runtime. The engineer wants to ensure that the retraining job has access to this library without affecting other jobs in the workspace. What is the recommended approach?

Question 171easymultiple choice

Read the full ML Ops explanation →

A data scientist wants to compare multiple runs within the same MLflow experiment to identify the best-performing model based on a custom metric. What is the most efficient way to do this in the MLflow UI?

Question 172easymultiple choice

Read the full ML Ops explanation →

A team notices that a deployed Model Serving endpoint occasionally returns stale predictions for a subset of customers shortly after the nightly feature refresh completes. The offline feature table is confirmed current. Which is the most likely explanation?

Question 173hardmultiple choice

Read the full ML Ops explanation →

A financial institution has deployed a credit risk model to a Databricks Model Serving endpoint. The model was trained on data that includes sensitive customer attributes. The compliance team requires that all predictions be explainable and that the model's decisions can be audited. The data science team wants to use SHAP (SHapley Additive exPlanations) to generate explanations for each prediction. Which approach should they take to integrate SHAP with the serving endpoint while maintaining low latency?

Question 174hardmultiple choice

Read the full ML Ops explanation →

A team has a production Databricks Model Serving endpoint for a churn model. They retrain weekly and register new model versions in Unity Catalog. They want the endpoint to automatically pick up the newest registered version without manual intervention, while keeping the previous version available for instant rollback. Which approach should they implement?