Databricks-ML-Pro ML Ops Practice Test 6 — 15 Questions

Question 1

You are migrating a legacy ML pipeline to Databricks. You need to ensure that the feature engineering logic used during training is identical to the logic used during real-time inference. What is the recommended approach?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Use the Databricks Feature Store to define and log features.. Consistency between training and inference (the 'training-serving skew') is a primary cause of model failure. The Databricks Feature Store acts as the single source of truth for feature definitions. By using it, you ensure that the same transformations are applied during both training and inference, eliminating discrepancies that arise from re-implementing logic in different languages or frameworks, which is critical for model reliability.

Answer

Copy the feature transformation code into both the training notebook and the inference service.

Answer

Store the features in a Parquet file and load it during both training and inference.

Answer

Implement the transformation logic as a SQL view in the Hive Metastore.

Question 2

Refer to the exhibit. Why is the missing model signature considered an MLOps risk in a production environment?

Accepted Answer

It makes it difficult to perform automated input validation at inference time.. Model signatures define the expected input schema. Without them, the serving engine cannot validate that incoming data matches what the model expects, which leads to runtime errors or silent, incorrect predictions. In production, this lack of validation makes it impossible to distinguish between data errors and model logic errors, creating significant operational risks and slowing down root cause analysis during incidents.

Answer

It prevents the model from being saved to the local file system.

Answer

It restricts the model to only be deployed on CPU clusters.

Answer

It slows down the training process by adding extra validation overhead.

Question 3

Which component of MLflow is responsible for keeping track of the different versions of a model as it moves from development to testing and production?

Accepted Answer

MLflow Model Registry. The MLflow Model Registry is the central repository for model versioning. It allows teams to manage the lifecycle of a model by transitioning versions through different stages. This is a critical MLOps function because it ensures that production environments are always pointing to a known, stable version of the model, while allowing developers to continue iterating on new versions without disrupting the live service.

Answer

MLflow Tracking

Answer

MLflow Projects

Answer

MLflow Recipes

Question 4

When deploying a model as a real-time REST endpoint on Databricks, how can you ensure the infrastructure scales automatically to handle increased request traffic?

Accepted Answer

Deploy the model using Databricks Model Serving endpoints.. Databricks Model Serving provides serverless, auto-scaling inference endpoints. By default, it manages the underlying infrastructure, scaling the number of replicas based on real-time request volume. This is a key MLOps requirement to ensure high availability and performance without manual intervention, allowing teams to handle unpredictable traffic spikes without over-provisioning and incurring unnecessary costs during low-traffic periods.

Answer

Configure the cluster to use a fixed number of workers in the cluster settings.

Answer

Manually add instances to the inference cluster using the Databricks API before peak times.

Answer

Enable 'Auto-terminate' on the inference cluster configuration.

Question 5

Your team uses Databricks for machine learning and needs to ensure that model training is fully automated and reproducible. Which THREE of the following are necessary components for a production-grade automated ML pipeline?

Accepted Answer

Git integration to version control the training notebooks and scripts.. An automated pipeline requires a workflow orchestrator (Workflows), a centralized registry (MLflow), and version-controlled logic (Git). These three components work together to provide a seamless transition from code development to production deployment. This triad ensures that every step is reproducible, monitored, and audit-ready, which is the foundational requirement for any mature MLOps practice operating at enterprise scale.

Answer

Manual approval steps for every single model training run.

Answer

Using the same cluster for both development and production tasks to minimize complexity.

Question 6

You are designing a strategy for monitoring model performance after deployment. Which of the following is the most important indicator that a model requires retraining?

Accepted Answer

A significant drop in model prediction accuracy on production data.. Performance degradation, often caused by model drift or data drift, is the primary driver for retraining. While monitoring system metrics like latency is important, the predictive quality of the model is the ultimate metric. Detecting a significant drop in accuracy or precision indicates that the model is no longer meeting business requirements, triggering the need for a new training cycle in an automated MLOps workflow.

Answer

An increase in the number of concurrent inference requests.

Answer

The expiry of the model's 'Production' stage status.

Answer

A minor change in the underlying Databricks runtime version.

Question 7

Your team is migrating models to Databricks Model Registry. You need to automate the transition of a model version to 'Staging' only after it passes an automated integration test suite in the CI/CD pipeline. Which mechanism should you use to best achieve this?

Accepted Answer

Use the MLflow Python client's transition_model_version_stage method within the CI/CD script.. Integrating the MLflow client within the CI/CD pipeline allows for programmatic stage transitions using the 'transition_model_version_stage' API. This approach ensures that manual intervention is minimized and models only move forward after passing defined quality gates. Automating this lifecycle phase is a cornerstone of robust MLOps, as it prevents untested models from reaching production environments and ensures consistency across deployment stages.

Answer

Manually update the model stage using the Databricks UI after the tests complete.

Answer

Configure a Databricks Job to transition the model based on a scheduled cron trigger.

Answer

Set the model stage to 'Staging' inside the training notebook using mlflow.register_model.

Question 8

Refer to the exhibit. You are managing the 'revenue_forecast' model in the registry. A colleague wants to deploy this version to production. Which Databricks command or process is required to move version 4 to the 'Production' stage while ensuring existing production models remain unaffected?

Accepted Answer

Use the MLflow transition_model_version_stage API with archive_existing_versions=True.. In Databricks, using the 'transition_model_version_stage' method with 'archive_existing_versions=True' is the standard practice for seamless deployments. This automatically moves the previous production version to 'Archived', maintaining a clear audit trail. Proper lifecycle management ensures that only one version is active in production at a time, preventing conflicts and ensuring that the most current, verified model is the one serving live traffic.

Answer

Delete the existing Production version and then promote version 4 to Production.

Answer

Directly update the 'stage' tag in the model JSON definition to 'Production'.

Answer

Reregister the model as a new model name to avoid conflicts with version 3.

Question 9

Your organization is implementing an MLOps strategy that requires strict model governance. You need to ensure that no model is deployed to production unless it has been tagged with 'validated=true' in the MLflow Model Registry. How can you enforce this policy within your CI/CD workflow?

Accepted Answer

Add a validation script in the CI/CD pipeline that queries the model version tags.. Implementing a policy-based deployment gate in your CI/CD pipeline ensures that governance requirements are met before code or models hit production. By querying the model's tags using the MLflow client before attempting a deployment, you create a hard stop for non-compliant models. This is a critical security and compliance practice, preventing unauthorized or untested models from being served to end-users or critical business processes.

Answer

Use Databricks workspace permissions to prevent unauthorized users from deploying models.

Answer

Rely on the MLflow UI to visually verify the tag before clicking 'Deploy'.

Answer

Set the default stage of all new models to 'Production' via a global config.

Question 10

You are debugging a model serving issue where the model is failing in production. Which THREE of the following actions should you prioritize to identify the root cause of the failure?

Accepted Answer

Check the Databricks cluster/endpoint logs for errors during the inference request.. Effective troubleshooting in MLOps relies on systematic isolation of the failure point: infrastructure, data, or model code. Checking system logs, verifying input data schemas, and reviewing model version history are standard diagnostic steps. These actions help determine if the failure is due to a sudden change in incoming data distributions, an infrastructure error, or a regression within the specific model version currently deployed to production.

Answer

Retrain the model from scratch on the full production dataset to clear errors.

Answer

Delete the model registry and recreate the model versions.

Question 11

Which component of Databricks ML is best suited for tracking model hyperparameters, metrics, and code versions during the experimentation phase of the ML lifecycle?

Accepted Answer

MLflow Tracking. MLflow Tracking is the dedicated component designed to record every experiment's parameters, metrics, and code state. By capturing these elements, data scientists can compare different iterations of a model to identify the best-performing configuration. This visibility is vital in MLOps, as it creates an audit trail of how a final model was derived, supporting reproducibility and informed decision-making before promoting a model to the registry.

Answer

Databricks SQL

Answer

Delta Lake

Answer

Unity Catalog

Question 12

Your organization needs to automate the deployment of models to real-time serving endpoints. Which service within the Databricks ecosystem handles the hosting and scaling of these endpoints with managed containerization?

Accepted Answer

Databricks Model Serving. Databricks Model Serving provides a fully managed, scalable infrastructure for deploying models as REST APIs. It handles the underlying container orchestration, allowing developers to focus on the model artifact rather than infrastructure management. This is essential for MLOps, as it simplifies the transition from a registered model in the MLflow registry to a production-ready, highly available endpoint that handles real-time traffic efficiently.

Answer

Databricks Jobs

Answer

Delta Live Tables

Answer

Databricks Repos

Question 13

You are implementing model monitoring to detect data drift. Which Databricks feature should you use to automatically track and alert on changes in the distribution of input data features over time?

Accepted Answer

Databricks Lakehouse Monitoring. Databricks Lakehouse Monitoring provides automated insights into data quality and drift. By tracking statistical properties of incoming data against a baseline, it generates alerts when significant shifts are detected. This is a crucial component of MLOps, as it proactively identifies when a model's performance might degrade due to environmental changes, allowing teams to retrain or adjust models before they negatively impact business outcomes.

Answer

MLflow Experiment Tracking

Answer

Delta Live Tables Expectations

Answer

Databricks SQL Alerts

Question 14

When designing a robust MLOps pipeline for high-stakes financial applications, why should you prioritize 'reproducibility' over 'speed' during the deployment phase?

Accepted Answer

Reproducibility is required for compliance, auditability, and reliable debugging.. Reproducibility ensures that a model can be recreated exactly using the same code, environment, and data. In high-stakes fields like finance, being able to audit every decision is a regulatory requirement. While speed is useful, a fast deployment of an un-reproducible model creates significant business risk. If a model fails, you must be able to recreate the state to identify and fix the bug to remain compliant.

Answer

Speed is irrelevant in all machine learning contexts.

Answer

Databricks does not support fast deployment pipelines.

Answer

Speed increases the risk of data leakage during training.

Question 15

Which THREE of the following are key responsibilities of an MLOps engineer when managing a model lifecycle on Databricks?

Accepted Answer

Automating the model registration and promotion process in CI/CD.. MLOps engineers act as the bridge between data science and production operations. Their core duties involve automating the lifecycle, ensuring that data quality is monitored, and maintaining the infrastructure security and governance required to serve models reliably. These activities ensure that machine learning remains a stable and repeatable business function rather than an ad-hoc, error-prone research endeavor.

Answer

Writing the core machine learning algorithms for every project.

Answer

Manually testing every model in the production environment.