Databricks-ML-Pro Practice Exam 1 — 20 Questions

Question 1

You need to perform cross-validation on a large dataset while ensuring that your model remains performant. What is the Databricks-recommended approach?

Accepted Answer

Use a Spark-based cross-validator or distribute folds across the cluster.. Leveraging Spark's distributed nature for cross-validation allows you to train folds in parallel, maximizing cluster utilization. By using libraries like Spark MLlib or distributed cross-validation wrappers, you can scale the evaluation process to datasets that would otherwise be impossible to handle on a single node. This ensures robust model evaluation while respecting the operational constraints of large-scale distributed data processing.

Answer

Collect all data to the driver node and use Scikit-Learn's cross_val_score.

Answer

Perform cross-validation only on a small, sampled subset of the data.

Answer

Hardcode the fold split indices to ensure reproducibility.

Question 2

A data science team is transitioning from manual model training to automated pipelines in Databricks. They require a mechanism to track model lineage, versions, and stage transitions programmatically. Which Databricks component best satisfies this requirement?

Accepted Answer

MLflow Model Registry. MLflow Model Registry provides a centralized model store, set of APIs, and UI for managing the full lifecycle of MLflow models. It enables versioning, model stage transitions, and lineage tracking, which are critical for MLOps maturity. By using the Model Registry, teams ensure reproducibility and governance, allowing for seamless promotion of models from staging to production while maintaining an audit trail of changes and deployment history.

Answer

Databricks Jobs Scheduler

Answer

Databricks Repos

Answer

Delta Lake

Question 3

You are designing a strategy for monitoring model performance after deployment. Which of the following is the most important indicator that a model requires retraining?

Accepted Answer

A significant drop in model prediction accuracy on production data.. Performance degradation, often caused by model drift or data drift, is the primary driver for retraining. While monitoring system metrics like latency is important, the predictive quality of the model is the ultimate metric. Detecting a significant drop in accuracy or precision indicates that the model is no longer meeting business requirements, triggering the need for a new training cycle in an automated MLOps workflow.

Answer

An increase in the number of concurrent inference requests.

Answer

The expiry of the model's 'Production' stage status.

Answer

A minor change in the underlying Databricks runtime version.

Question 4

When deploying a model to a Databricks Model Serving endpoint, how can you ensure the model scales automatically based on traffic demand?

Accepted Answer

Configure auto-scaling settings in the Model Serving endpoint definition to handle traffic fluctuations.. Databricks Model Serving utilizes auto-scaling compute resources to handle fluctuations in traffic. By configuring the serving endpoint with appropriate auto-scaling parameters, the platform dynamically adjusts the number of concurrent instances based on request load. This ensures that the application maintains low latency under heavy load while remaining cost-effective during periods of low activity, which is essential for managing production-level model inference at scale.

Answer

Manually adjust the number of instances in the endpoint configuration every time traffic increases.

Answer

Set the endpoint to a fixed number of instances that is high enough to handle peak traffic.

Answer

Use a load balancer to redirect traffic to different model endpoints depending on the time of day.

Question 5

Which Databricks feature is specifically designed to manage the lifecycle of a machine learning model, including versioning, stage transitions, and deployment tracking?

Accepted Answer

MLflow Model Registry.. The MLflow Model Registry is the definitive tool in Databricks for managing the model lifecycle. It allows teams to register models, track versions, and manage stage transitions (e.g., Staging to Production). By providing a centralized, audit-trailed repository, it ensures that only validated models are deployed into production, fulfilling the core requirements of MLOps for governance, reliability, and automated deployment pipelines.

Answer

Unity Catalog.

Answer

Databricks Delta Lake.

Answer

Databricks Repos.

Question 6

A data science team trains a scikit-learn model on a Databricks cluster and needs the same feature-engineering logic to run identically in a nightly batch scoring job and in a real-time Model Serving endpoint. They want a single artifact that encapsulates preprocessing and the estimator. Which approach should they use?

Accepted Answer

Log the model with MLflow using the sklearn flavor and a custom pyfunc wrapper that includes the preprocessing steps.. Wrapping preprocessing and the estimator in a single pyfunc model lets MLflow serialize both as one artifact. Batch scoring loads that artifact with the pyfunc loader, and Model Serving uses the same artifact, so feature transformations are guaranteed identical and training-serving skew is avoided without duplicating logic.

Answer

Register the raw estimator in Unity Catalog and reimplement preprocessing separately in the batch job and endpoint code.

Answer

Package the preprocessing into a custom container image and reference the image from the model version metadata.

Answer

Log the model with the sklearn flavor and pass the preprocessing function name as a signature parameter.

Question 7

Which TWO statements regarding the use of Unity Catalog in Databricks for MLOps are correct?

Accepted Answer

It enables centralized lineage tracking between data tables and MLflow models.. Unity Catalog acts as the centralized governance layer for all data and AI assets. It provides fine-grained access control and lineage tracking, allowing organizations to maintain visibility over which data is used by which models. By centralizing these assets, teams can collaborate safely while ensuring that compliance and auditing requirements are satisfied across the entire organization, regardless of the individual workspace where the work is performed.

Answer

Unity Catalog enforces access control at the table level only, not on MLflow models.

Answer

Unity Catalog is only compatible with Python and does not support SQL-based model management.

Answer

Users must manually export model artifacts to an external store to share them via Unity Catalog.

Question 8

A team notices that their model performance is significantly lower in production than in training. They suspect 'data drift' in the feature inputs. Which Databricks capability should be used to monitor this?

Accepted Answer

Using Databricks Lakehouse Monitoring to track inference data distributions.. Databricks Lakehouse Monitoring provides automated insights into data quality and drift by comparing production inference data against training baselines. This is essential for detecting the performance decay caused by concept or data drift. By identifying these issues early, teams can trigger automated retraining pipelines, maintaining model accuracy over time and ensuring the business value of the deployed model is sustained.

Answer

Manually querying the Delta table after every batch inference.

Answer

Enabling 'Audit Logs' to track individual inference request parameters.

Answer

Increasing the number of features in the model to cover more data.

Question 9

When deploying a model to Databricks Model Serving, you notice that inference latency is higher than expected. Which diagnostic approach is most effective for identifying the bottleneck?

Accepted Answer

Check the built-in request metrics and logs for the serving endpoint to analyze duration distribution.. Monitoring tools provided by Databricks, such as the built-in request metrics and logs, are essential for identifying latency bottlenecks. By examining request volume, processing duration, and resource utilization, you can determine if the latency is due to model complexity, infrastructure constraints, or external data dependencies. This allows for data-driven optimization, such as choosing a larger workload size, optimizing the model architecture, or implementing caching for frequently accessed data inputs.

Answer

Re-train the model with a smaller dataset to see if it improves performance.

Answer

Increase the number of instances in the model serving endpoint without checking logs.

Answer

Restart the Databricks workspace to clear cached inference results.

Question 10

Refer to the exhibit. A data scientist is logging their model training process. Which statement accurately describes the storage location of the artifacts referenced in the code snippet?

Accepted Answer

The model artifact created by log_model is stored in the MLflow tracking store's internal directory structure.. MLflow handles artifacts differently based on the log function used. While 'log_artifact' takes a explicit path (often DBFS or local filesystem), 'log_model' packages the model with its metadata and dependencies into a standard MLflow directory structure. Understanding this distinction is essential for production deployments, as model registry and deployment tools rely on the specific internal structure generated by the 'log_model' function, not just raw file paths.

Answer

All items are stored in the same local directory on the driver node.

Answer

The log_artifact command uploads the weights directly to the Model Registry.

Answer

The log_model function is equivalent to copying the file directly to DBFS.

Question 11

When using MLflow to manage the machine learning lifecycle, what is the primary purpose of the 'conda.yaml' or 'requirements.txt' file automatically generated during log_model?

Accepted Answer

To ensure that the inference environment has the necessary dependencies installed.. These files define the environment specification required to recreate the model's runtime environment. When a model is moved to a production serving endpoint or a different cluster, Databricks uses these specifications to install the correct library versions. This ensures that the model executes in an environment identical to the one it was trained in, preventing silent failures caused by library version mismatches.

Answer

To store the model's hyperparameter search space configurations.

Answer

To act as a security manifest that validates the digital signature of the model.

Answer

To limit the maximum number of concurrent requests the model can handle.

Question 12

Which THREE of the following are considered best practices for handling data preprocessing in a Databricks ML pipeline to prevent data leakage?

Accepted Answer

Fit your scaler/transformer exclusively on the training portion of the data.. Preventing data leakage is essential for valid model performance. The key is to calculate statistics (like means or scaling factors) strictly on the training set and apply them to the validation/test sets. Using Spark ML transformers encapsulates this logic, ensuring that the transformation process is consistent and prevents the model from 'seeing' information from the test set during the training phase, leading to accurate performance estimation.

Answer

Calculate global mean imputation values using the entire dataset before splitting.

Answer

Perform feature selection using the entire dataset to maximize model power.

Question 13

Refer to the exhibit. A data scientist is logging a Scikit-Learn model to the MLflow Model Registry. Which benefit does providing the `signature` and `input_example` offer during the deployment phase?

Accepted Answer

It enables MLflow to enforce data types during inference, preventing schema mismatch errors.. Providing a model signature and input example defines the expected data schema, allowing MLflow to perform type validation during inference. This is vital for production systems, as it prevents runtime errors caused by malformed inputs and enables Databricks to automatically generate deployment documentation and test payloads, significantly reducing the debugging time when deploying models to Model Serving endpoints.

Answer

It automatically scales the cluster size based on the input example size.

Answer

It allows the model to be trained in distributed mode using PySpark.

Answer

It automatically converts the model into an ONNX format for faster inference.

Question 14

An ML engineer wants to ensure that their model training pipeline is robust against data quality issues. Which approach, if integrated into the pipeline, most effectively detects skewed or missing values before training begins?

Accepted Answer

Using DLT Expectations to define and enforce constraints on input data.. Integrating data quality checks, such as those provided by Delta Live Tables (DLT) expectations or Great Expectations, is crucial for MLOps. By enforcing schema and statistical constraints at the ingest and preparation stages, the pipeline can fail early if data quality falls below standards, preventing the training of 'garbage-in-garbage-out' models and saving compute costs while maintaining model reliability in production.

Answer

Manually inspecting the first 100 rows of the dataset using a notebook cell.

Answer

Relying on the model to handle missing values by using imputation during training.

Answer

Increasing the size of the training cluster to process more data.

Question 15

A team is building an automated retraining pipeline. They need to ensure that only models exceeding a certain performance threshold are registered. What is the most effective way to implement this logic?

Accepted Answer

Write a Python script that evaluates the model and conditionally calls the Model Registry API.. Integrating conditional logic into the retraining script using the MLflow API allows for programmatic model governance. By evaluating the model against validation data and only calling 'register_model' if the performance exceeds the threshold, the team prevents poor-quality models from entering the registry. This automated gatekeeping is vital for maintaining the health of the production pipeline and ensuring that only high-performing models proceed to deployment.

Answer

Manually inspect all models in the MLflow UI before registering them.

Answer

Register every trained model and let the production system filter them.

Answer

Use MLflow's 'auto-register' feature that registers all models by default.

Question 16

When developing a model, which THREE actions should a data scientist perform to ensure the model is ready for production deployment via Model Serving?

Accepted Answer

Log the model with a defined input/output signature.. Production-ready models require strict standards: a defined schema (signature) for input validation, proper metadata logging for reproducibility, and registration in the Model Registry. These steps ensure the model is governable, traceable, and secure. Skipping any of these components makes the model difficult to debug, deploy reliably, or monitor for performance drift in production environments.

Answer

Hardcode the data path to an external S3 bucket within the model object.

Answer

Include the entire training dataset in the model's metadata.

Question 17

You are performing hyperparameter tuning using Hyperopt on Databricks. Which TWO configurations must be defined to ensure optimal performance and result tracking?

Accepted Answer

Use SparkTrials to distribute the hyperparameter search across the cluster.. Using SparkTrials allows Hyperopt to distribute trial execution across multiple cluster nodes, significantly accelerating grid or random search. Integrating MLflow within the objective function ensures that each trial's parameters, metrics, and artifacts are captured, enabling users to analyze the tuning history and select the best model based on validated performance metrics.

Answer

Call mlflow.end_run() manually at the end of every trial function.

Answer

Wrap the objective function in an MLflow autologging block.

Answer

Set the search space to use a linear scale for all numerical hyperparameters.

Question 18

An ML engineer needs to deploy a model to Databricks Model Serving that requires a custom Python package. The package is not available in the default Databricks Runtime and must be installed from a private PyPI repository. Which approach should be used to include this package in the model's environment?

Accepted Answer

Include the package in the model's conda.yaml or requirements.txt file when logging the model with MLflow.. Databricks Model Serving builds a container for the model based on the environment specified during MLflow model logging. By including the private PyPI package in the conda.yaml or requirements.txt with the appropriate index URL, the package is installed in the serving environment. This is the supported method for custom dependencies.

Answer

Install the package on the driver node of the serving cluster using a %pip magic command before deployment.

Answer

Add the package to the cluster's init script and reference the cluster when creating the serving endpoint.

Answer

Upload the package as a Databricks notebook and import it at runtime within the model's predict function.

Question 19

What is the primary advantage of using a Model-as-Code approach in Databricks for machine learning deployments?

Accepted Answer

It enables consistent, reproducible, and versioned deployment environments.. Model-as-Code treats the entire deployment process—infrastructure, environment configuration, and code—as versioned artifacts. This allows for total reproducibility, where any production state can be rolled back or recreated using stored definitions. This practice is essential for enterprise MLOps, as it ensures that deployments are predictable, scalable, and audit-compliant, significantly reducing the risks associated with manual configuration changes in a production environment.

Answer

It ensures that the model is always trained on the latest data.

Answer

It automatically generates unit tests for all machine learning code.

Answer

It eliminates the need for any monitoring of model performance.

Question 20

A machine learning engineer needs to deploy a custom scikit-learn model to a Databricks Model Serving endpoint with a strict response time SLA of under 50 milliseconds. The model includes an extensive text-cleaning pipeline that utilizes heavy regex matching. How should the engineer package the model to ensure maximum inference efficiency and meet the low-latency requirement?

Accepted Answer

Implement a custom MLflow PyFunc model where both the text preprocessing and the scikit-learn predictor are encapsulated inside the predict method.. Integrating the preprocessing directly into the MLflow PyFunc wrapper ensures that the input transformation runs within the optimized inference container memory space, avoiding out-of-band network calls and reducing serialization overhead. This architectural pattern prevents latency bottlenecks often introduced by separate preprocessing microservices, satisfying strict production SLAs.

Answer

Store the preprocessing logic in a Delta table and have the serving endpoint query the table asynchronously during the scoring request.

Answer

Develop a separate Azure or AWS Lambda function to handle the text cleaning before forwarding the request payload to the model endpoint.

Answer

Deploy the scikit-learn model natively without custom wrapper code and require client applications to execute the regex cleaning logic locally.