Databricks-ML-Pro Practice Questions

Question 1

You need to perform cross-validation on a large dataset while ensuring that your model remains performant. What is the Databricks-recommended approach?

Accepted Answer

Use a Spark-based cross-validator or distribute folds across the cluster.. Leveraging Spark's distributed nature for cross-validation allows you to train folds in parallel, maximizing cluster utilization. By using libraries like Spark MLlib or distributed cross-validation wrappers, you can scale the evaluation process to datasets that would otherwise be impossible to handle on a single node. This ensures robust model evaluation while respecting the operational constraints of large-scale distributed data processing.

Answer

Collect all data to the driver node and use Scikit-Learn's cross_val_score.

Answer

Perform cross-validation only on a small, sampled subset of the data.

Answer

Hardcode the fold split indices to ensure reproducibility.

Question 2

A data science team is transitioning from manual model training to automated pipelines in Databricks. They require a mechanism to track model lineage, versions, and stage transitions programmatically. Which Databricks component best satisfies this requirement?

Accepted Answer

MLflow Model Registry. MLflow Model Registry provides a centralized model store, set of APIs, and UI for managing the full lifecycle of MLflow models. It enables versioning, model stage transitions, and lineage tracking, which are critical for MLOps maturity. By using the Model Registry, teams ensure reproducibility and governance, allowing for seamless promotion of models from staging to production while maintaining an audit trail of changes and deployment history.

Answer

Databricks Jobs Scheduler

Answer

Databricks Repos

Answer

Delta Lake

Question 3

You are designing a strategy for monitoring model performance after deployment. Which of the following is the most important indicator that a model requires retraining?

Accepted Answer

A significant drop in model prediction accuracy on production data.. Performance degradation, often caused by model drift or data drift, is the primary driver for retraining. While monitoring system metrics like latency is important, the predictive quality of the model is the ultimate metric. Detecting a significant drop in accuracy or precision indicates that the model is no longer meeting business requirements, triggering the need for a new training cycle in an automated MLOps workflow.

Answer

An increase in the number of concurrent inference requests.

Answer

The expiry of the model's 'Production' stage status.

Answer

A minor change in the underlying Databricks runtime version.

Question 4

When deploying a model to a Databricks Model Serving endpoint, how can you ensure the model scales automatically based on traffic demand?

Accepted Answer

Configure auto-scaling settings in the Model Serving endpoint definition to handle traffic fluctuations.. Databricks Model Serving utilizes auto-scaling compute resources to handle fluctuations in traffic. By configuring the serving endpoint with appropriate auto-scaling parameters, the platform dynamically adjusts the number of concurrent instances based on request load. This ensures that the application maintains low latency under heavy load while remaining cost-effective during periods of low activity, which is essential for managing production-level model inference at scale.

Answer

Manually adjust the number of instances in the endpoint configuration every time traffic increases.

Answer

Set the endpoint to a fixed number of instances that is high enough to handle peak traffic.

Answer

Use a load balancer to redirect traffic to different model endpoints depending on the time of day.

Question 5

Which Databricks feature is specifically designed to manage the lifecycle of a machine learning model, including versioning, stage transitions, and deployment tracking?

Accepted Answer

MLflow Model Registry.. The MLflow Model Registry is the definitive tool in Databricks for managing the model lifecycle. It allows teams to register models, track versions, and manage stage transitions (e.g., Staging to Production). By providing a centralized, audit-trailed repository, it ensures that only validated models are deployed into production, fulfilling the core requirements of MLOps for governance, reliability, and automated deployment pipelines.

Answer

Unity Catalog.

Answer

Databricks Delta Lake.

Answer

Databricks Repos.

Question 6

A data science team trains a scikit-learn model on a Databricks cluster and needs the same feature-engineering logic to run identically in a nightly batch scoring job and in a real-time Model Serving endpoint. They want a single artifact that encapsulates preprocessing and the estimator. Which approach should they use?

Accepted Answer

Log the model with MLflow using the sklearn flavor and a custom pyfunc wrapper that includes the preprocessing steps.. Wrapping preprocessing and the estimator in a single pyfunc model lets MLflow serialize both as one artifact. Batch scoring loads that artifact with the pyfunc loader, and Model Serving uses the same artifact, so feature transformations are guaranteed identical and training-serving skew is avoided without duplicating logic.

Answer

Register the raw estimator in Unity Catalog and reimplement preprocessing separately in the batch job and endpoint code.

Answer

Package the preprocessing into a custom container image and reference the image from the model version metadata.

Answer

Log the model with the sklearn flavor and pass the preprocessing function name as a signature parameter.

Question 7

Which TWO statements regarding the use of Unity Catalog in Databricks for MLOps are correct?

Accepted Answer

It enables centralized lineage tracking between data tables and MLflow models.. Unity Catalog acts as the centralized governance layer for all data and AI assets. It provides fine-grained access control and lineage tracking, allowing organizations to maintain visibility over which data is used by which models. By centralizing these assets, teams can collaborate safely while ensuring that compliance and auditing requirements are satisfied across the entire organization, regardless of the individual workspace where the work is performed.

Answer

Unity Catalog enforces access control at the table level only, not on MLflow models.

Answer

Unity Catalog is only compatible with Python and does not support SQL-based model management.

Answer

Users must manually export model artifacts to an external store to share them via Unity Catalog.

Question 8

A team notices that their model performance is significantly lower in production than in training. They suspect 'data drift' in the feature inputs. Which Databricks capability should be used to monitor this?

Accepted Answer

Using Databricks Lakehouse Monitoring to track inference data distributions.. Databricks Lakehouse Monitoring provides automated insights into data quality and drift by comparing production inference data against training baselines. This is essential for detecting the performance decay caused by concept or data drift. By identifying these issues early, teams can trigger automated retraining pipelines, maintaining model accuracy over time and ensuring the business value of the deployed model is sustained.

Answer

Manually querying the Delta table after every batch inference.

Answer

Enabling 'Audit Logs' to track individual inference request parameters.

Answer

Increasing the number of features in the model to cover more data.

Question 9

When deploying a model to Databricks Model Serving, you notice that inference latency is higher than expected. Which diagnostic approach is most effective for identifying the bottleneck?

Accepted Answer

Check the built-in request metrics and logs for the serving endpoint to analyze duration distribution.. Monitoring tools provided by Databricks, such as the built-in request metrics and logs, are essential for identifying latency bottlenecks. By examining request volume, processing duration, and resource utilization, you can determine if the latency is due to model complexity, infrastructure constraints, or external data dependencies. This allows for data-driven optimization, such as choosing a larger workload size, optimizing the model architecture, or implementing caching for frequently accessed data inputs.

Answer

Re-train the model with a smaller dataset to see if it improves performance.

Answer

Increase the number of instances in the model serving endpoint without checking logs.

Answer

Restart the Databricks workspace to clear cached inference results.

Question 10

Refer to the exhibit. A data scientist is logging their model training process. Which statement accurately describes the storage location of the artifacts referenced in the code snippet?

Accepted Answer

The model artifact created by log_model is stored in the MLflow tracking store's internal directory structure.. MLflow handles artifacts differently based on the log function used. While 'log_artifact' takes a explicit path (often DBFS or local filesystem), 'log_model' packages the model with its metadata and dependencies into a standard MLflow directory structure. Understanding this distinction is essential for production deployments, as model registry and deployment tools rely on the specific internal structure generated by the 'log_model' function, not just raw file paths.

Answer

All items are stored in the same local directory on the driver node.

Answer

The log_artifact command uploads the weights directly to the Model Registry.

Answer

The log_model function is equivalent to copying the file directly to DBFS.

Question 11

When using MLflow to manage the machine learning lifecycle, what is the primary purpose of the 'conda.yaml' or 'requirements.txt' file automatically generated during log_model?

Accepted Answer

To ensure that the inference environment has the necessary dependencies installed.. These files define the environment specification required to recreate the model's runtime environment. When a model is moved to a production serving endpoint or a different cluster, Databricks uses these specifications to install the correct library versions. This ensures that the model executes in an environment identical to the one it was trained in, preventing silent failures caused by library version mismatches.

Answer

To store the model's hyperparameter search space configurations.

Answer

To act as a security manifest that validates the digital signature of the model.

Answer

To limit the maximum number of concurrent requests the model can handle.

Question 12

Which THREE of the following are considered best practices for handling data preprocessing in a Databricks ML pipeline to prevent data leakage?

Accepted Answer

Fit your scaler/transformer exclusively on the training portion of the data.. Preventing data leakage is essential for valid model performance. The key is to calculate statistics (like means or scaling factors) strictly on the training set and apply them to the validation/test sets. Using Spark ML transformers encapsulates this logic, ensuring that the transformation process is consistent and prevents the model from 'seeing' information from the test set during the training phase, leading to accurate performance estimation.

Answer

Calculate global mean imputation values using the entire dataset before splitting.

Answer

Perform feature selection using the entire dataset to maximize model power.

Question 13

Refer to the exhibit. A data scientist is logging a Scikit-Learn model to the MLflow Model Registry. Which benefit does providing the `signature` and `input_example` offer during the deployment phase?

Accepted Answer

It enables MLflow to enforce data types during inference, preventing schema mismatch errors.. Providing a model signature and input example defines the expected data schema, allowing MLflow to perform type validation during inference. This is vital for production systems, as it prevents runtime errors caused by malformed inputs and enables Databricks to automatically generate deployment documentation and test payloads, significantly reducing the debugging time when deploying models to Model Serving endpoints.

Answer

It automatically scales the cluster size based on the input example size.

Answer

It allows the model to be trained in distributed mode using PySpark.

Answer

It automatically converts the model into an ONNX format for faster inference.

Question 14

An ML engineer wants to ensure that their model training pipeline is robust against data quality issues. Which approach, if integrated into the pipeline, most effectively detects skewed or missing values before training begins?

Accepted Answer

Using DLT Expectations to define and enforce constraints on input data.. Integrating data quality checks, such as those provided by Delta Live Tables (DLT) expectations or Great Expectations, is crucial for MLOps. By enforcing schema and statistical constraints at the ingest and preparation stages, the pipeline can fail early if data quality falls below standards, preventing the training of 'garbage-in-garbage-out' models and saving compute costs while maintaining model reliability in production.

Answer

Manually inspecting the first 100 rows of the dataset using a notebook cell.

Answer

Relying on the model to handle missing values by using imputation during training.

Answer

Increasing the size of the training cluster to process more data.

Question 15

A team is building an automated retraining pipeline. They need to ensure that only models exceeding a certain performance threshold are registered. What is the most effective way to implement this logic?

Accepted Answer

Write a Python script that evaluates the model and conditionally calls the Model Registry API.. Integrating conditional logic into the retraining script using the MLflow API allows for programmatic model governance. By evaluating the model against validation data and only calling 'register_model' if the performance exceeds the threshold, the team prevents poor-quality models from entering the registry. This automated gatekeeping is vital for maintaining the health of the production pipeline and ensuring that only high-performing models proceed to deployment.

Answer

Manually inspect all models in the MLflow UI before registering them.

Answer

Register every trained model and let the production system filter them.

Answer

Use MLflow's 'auto-register' feature that registers all models by default.

Databricks Certified Machine Learning Professional Databricks-ML-Pro practice test

Three ways to study

Study Databricks-ML-Pro by domain

Study Databricks-ML-Pro by topic

Model Deployment practice questions

ML Ops practice questions

Model Development practice questions

Databricks-ML-Pro fundamentals practice questions

Databricks-ML-Pro scenario practice questions

Databricks-ML-Pro troubleshooting practice questions

Databricks Certified Machine Learning Professional practice questions