Databricks-ML-Pro Practice Test 4 — 25 Questions

Question 1

A data scientist needs to perform batch inference on a large dataset stored in Delta Lake using a model registered in the Unity Catalog. Which approach is most efficient for leveraging Spark's distributed computing capabilities while using the MLflow model?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Using mlflow.pyfunc.spark_udf to wrap the model and applying it to the Spark DataFrame columns.. MLflow provides a built-in function to load models as Spark User Defined Functions (UDFs). This allows the model to be distributed across the executor nodes of a Spark cluster, enabling parallel processing of large datasets. This method is preferred over manual iteration as it integrates seamlessly with the Spark DataFrame API and optimizes resource utilization during high-volume batch jobs.

Answer

Loading the model with mlflow.pyfunc.load_model and using a for-loop to iterate over DataFrame rows.

Answer

Converting the Delta table to a Pandas DataFrame and using the standard model.predict() method.

Answer

Calling the Model Serving REST API for every row in the Delta Lake table using a standard Python request.

Question 2

Which statement best describes the role of the 'Signature' in an MLflow model when deploying to a Databricks Model Serving endpoint?

Accepted Answer

It specifies the data types and names of the input features and the output predictions.. An MLflow Model Signature defines the schema of the inputs and outputs for a model. This is crucial for Model Serving as it allows the endpoint to perform input validation before the data reaches the model. It also enables the UI to generate a 'Call' template, making it easier for developers to test the API.

Answer

It is a cryptographic hash used to verify the integrity of the model files.

Answer

It lists the specific users and groups who have permission to call the endpoint.

Answer

It contains the hyperparameters used during the final training run of the model version.

Question 3

When evaluating a classification model on Databricks, a team needs to generate a custom performance report that is not natively provided by MLflow. What is the recommended strategy to ensure this report is persisted and associated with the training run?

Accepted Answer

Save the report to a local temporary file and use MLflow.log_artifact to upload it to the run.. Logging custom plots and reports as artifacts is the recommended way to enrich MLflow run metadata. By saving visualizations or summary statistics as files (e.g., HTML, PNG, or JSON) and using 'log_artifact', the team ensures that non-standard evaluation metrics are permanently stored. This practice allows stakeholders to review specific model performance indicators without needing to re-run the training code, which is vital for compliance and post-training analysis.

Answer

Print the report to the notebook output and rely on the notebook's command history.

Answer

Store the report in an external database and manually link it via a comment in the run.

Answer

Re-generate the report every time the model is loaded for inference.

Question 4

A machine learning engineer is training a PyTorch model on a Databricks cluster and needs to distribute the training across multiple worker nodes. Which framework should be integrated natively within Databricks to handle this distributed deep learning workflow efficiently?

Accepted Answer

TorchDistributor. TorchDistributor is the native Databricks library designed to launch distributed PyTorch training jobs seamlessly across cluster nodes using standard PyTorch native CLI commands and environment configurations. Understanding distributed training orchestration on Databricks is crucial for scaling deep learning pipelines on large datasets without manually managing cluster communication sockets.

Answer

Databricks Feature Store Client

Answer

MLflow Model Registry

Answer

Spark MLlib Pipeline

Question 5

A machine learning engineer wants to ensure that model training artifacts are persistent and accessible even if the ephemeral compute cluster is terminated. What is the standard practice in Databricks for achieving this?

Accepted Answer

Log the model using MLflow, which stores the artifact in the configured backend.. In Databricks, local cluster storage is ephemeral and is deleted when the cluster terminates. To ensure model artifacts persist, developers must log them to MLflow, which automatically handles the backend storage in DBFS or Unity Catalog-managed storage. This practice decouples the model lifecycle from the compute lifecycle, ensuring that models remain available for deployment or further evaluation after the compute resources are released.

Answer

Save the model to the local file system using the /dbfs/ path prefix.

Answer

Export the model artifact to a temporary workspace file and download it locally.

Answer

Configure the cluster to use an external persistent volume for local storage.

Question 6

A machine learning engineer is training a scikit-learn model on Databricks and wants to automatically log hyperparameters, metrics, and the trained artifact without writing extensive boilerplate logging code. Which approach should the engineer use?

Accepted Answer

Execute mlflow.sklearn.autolog() prior to initiating the model training fit process to automatically capture all runs.. Autologging automatically captures all relevant parameters, metrics, and models without requiring manual mlflow.log_param calls. This ensures consistency, prevents human error during tracking, and natively integrates with Spark dataframes. It significantly accelerates the model development lifecycle on Databricks by standardizing the capture of experimentation metadata across distributed runs.

Answer

Manually invoke mlflow.start_run() and explicitly call mlflow.log_metric() for every single training epoch iteration.

Answer

Store all model metrics directly inside a temporary Delta table and sync them to MLflow during the final evaluation phase.

Answer

Configure the cluster environment variables to automatically intercept stdout and parse training metrics using regex.

Question 7

Which method is the most appropriate for logging custom pre-processing logic alongside a model so that it is automatically applied during inference in Databricks?

Accepted Answer

Use the mlflow.pyfunc flavor to wrap the model and transformation logic.. The mlflow.pyfunc flavor is designed specifically for this purpose. It allows developers to define a custom class that inherits from PythonModel, where both the pre-processing logic and the model prediction logic reside in the same artifact. This ensures that the exact same transformation steps applied during training are applied during inference, preventing training-serving skew, which is a common source of production model degradation.

Answer

Include pre-processing in the notebook and rely on the serving user to call it.

Answer

Store the transformation logic in a separate repository and import it at inference time.

Answer

Write the pre-processing code as a SQL view in the Databricks SQL Warehouse.

Question 8

Refer to the exhibit. A data scientist is preparing to log a model. What is the primary benefit of including the explicit 'signature' provided in the exhibit during the mlflow.log_model process?

Accepted Answer

It allows the serving endpoint to perform automatic data type validation on incoming requests.. The model signature acts as a contract between the model and its environment. By explicitly defining the input and output schema, Databricks can perform validation during inference to prevent runtime errors caused by mismatched data types. This is critical for production pipelines where data quality might fluctuate, ensuring that the model consumes and produces the expected data formats reliably.

Answer

It enables automatic hyperparameter tuning during the next training iteration.

Answer

It automatically encrypts the model weights for secure storage in the registry.

Answer

It forces the model to be converted into a serialized format like ONNX.

Question 9

Refer to the exhibit. You are loading a model from the registry. What does the 'models:/MyModel/1' URI specifically represent?

Accepted Answer

A unique identifier for the registered model name and its specific version.. The URI format 'models:/ModelName/Version' is the standard way to reference registered models within MLflow. It points to a specific, versioned artifact stored in the registry, ensuring that the inference code consistently uses the exact model state that was approved. This abstraction allows developers to change model versions without modifying the underlying inference application, promoting a stable production environment.

Answer

A direct pointer to the local file system path of the model artifact.

Answer

An alias for the most recently trained model in the current experiment.

Answer

A reference to the raw source code used to train the model.

Question 10

Refer to the exhibit. The deployment pipeline is failing to load the model artifact in the target production environment. What is the most likely cause?

Accepted Answer

The path '/dbfs/...' is not a reliable way to reference artifacts across different clusters.. The exhibit shows a hard-coded path beginning with '/dbfs/'. In Databricks, accessing DBFS via local file system paths can be inconsistent across different clusters or environments. The correct approach is to use the MLflow URI (e.g., 'runs:/...') to load models, as it abstracts the underlying storage location and ensures the artifact is resolved correctly regardless of the execution environment or storage configuration.

Answer

The model version is not set to 'PRODUCTION' in the metadata.

Answer

The conda_env file is missing from the artifact storage.

Answer

The run_id 'd7a8e9f0' has been archived and is no longer accessible.

Question 11

When deploying a model as a real-time REST endpoint on Databricks, how can you ensure the infrastructure scales automatically to handle increased request traffic?

Accepted Answer

Deploy the model using Databricks Model Serving endpoints.. Databricks Model Serving provides serverless, auto-scaling inference endpoints. By default, it manages the underlying infrastructure, scaling the number of replicas based on real-time request volume. This is a key MLOps requirement to ensure high availability and performance without manual intervention, allowing teams to handle unpredictable traffic spikes without over-provisioning and incurring unnecessary costs during low-traffic periods.

Answer

Configure the cluster to use a fixed number of workers in the cluster settings.

Answer

Manually add instances to the inference cluster using the Databricks API before peak times.

Answer

Enable 'Auto-terminate' on the inference cluster configuration.

Question 12

A machine learning engineer needs to deploy a custom PyTorch model to a Databricks Model Serving endpoint. The model requires custom post-processing logic and loading auxiliary tokenizer files alongside the serialized weights. Which approach provides the correct mechanism to package and serve this custom artifact?

Accepted Answer

Subclass mlflow.pyfunc.PythonModel, implement the load_context and predict methods, bundle the tokenizer files in artifacts, and log via mlflow.pyfunc.log_model.. Custom PyTorch models requiring custom code and auxiliary files must be logged using MLflow's pyfunc flavor with custom artifact dependencies. This allows packaging artifacts and arbitrary Python code safely so that the serving infrastructure can instantiate the pyfunc wrapper, execute custom tokenization, and perform required post-processing cleanly during real-time inference.

Answer

Log the model as a standard torch.jit artifact without metadata and point the serving endpoint directly to the raw .pt file in Unity Catalog.

Answer

Create an external FastAPI application outside Databricks, wrap the model, and route requests via a custom reverse proxy.

Answer

Store the tokenizer files in a Delta table and configure the serving endpoint to query the table on every incoming inference request.

Question 13

A data scientist is developing a scikit-learn model on Databricks and wants to log the model artifact to MLflow so that it can later be deployed for online inference. They call mlflow.sklearn.log_model() without providing a signature. What is the primary consequence of omitting the model signature?

Accepted Answer

The model will be logged, but MLflow cannot infer the input and output schema for deployment, potentially causing issues in serving or scoring.. Providing a signature when logging a model captures the expected input and output schema, which is essential for reliable deployment and scoring. Without it, MLflow cannot validate incoming data against the model's expectations, potentially leading to errors in serving or batch inference. The model still logs successfully, but the lack of schema metadata can cause integration problems.

Answer

MLflow will not log the model at all because a signature is mandatory for scikit-learn models.

Answer

The model will be logged, but MLflow Model Serving will reject requests because it cannot validate the input schema.

Answer

MLflow will automatically generate a signature by inspecting the training data, so omitting it has no effect.

Question 14

You are responsible for monitoring a critical model deployed to Databricks Model Serving. You need to detect data drift and model performance degradation. Which TWO of the following actions should you take? (Choose two.)

Accepted Answer

Set up a Databricks SQL dashboard that queries the inference table and compares feature distributions to a baseline.. Inference tables capture the necessary request and response data for monitoring, while Databricks SQL dashboards enable analysis and alerting on that data. Together, they provide a robust solution for detecting data drift and model performance degradation. Other actions, such as changing instance types or isolating workspaces, do not address the monitoring requirements.

Answer

Deploy the model to a different workspace to isolate production traffic.

Answer

Use MLflow to log the model's training metrics and compare them to production metrics manually.

Answer

Configure the endpoint to use a smaller instance type to reduce cost.

Question 15

You are monitoring a model served on a Databricks Model Serving endpoint. You need to track the distribution of incoming request payloads to detect data drift. Which Databricks feature should you use to automatically capture and store inference logs for analysis?

Accepted Answer

Enable inference tables on the model serving endpoint.. Inference tables are a Databricks Model Serving feature that automatically logs request and response payloads to a Delta table. This enables easy querying and monitoring for data drift without writing additional code. Other options either do not capture payloads automatically or are not designed for this purpose.

Answer

Configure the endpoint to log to MLflow Tracking.

Answer

Use Databricks SQL dashboards to query the endpoint's access logs.

Answer

Enable model serving logs to be written to a cloud storage bucket.

Question 16

A machine learning engineer is responsible for monitoring a production model deployed to Databricks Model Serving. The model predicts customer churn and is served via a REST endpoint. The engineer needs to detect data drift and model performance degradation over time. Which TWO actions should the engineer take to enable effective monitoring? (Choose two.)

Accepted Answer

Enable inference logging on the model serving endpoint to capture request and response payloads.. Effective monitoring of a production model requires capturing inference data and analyzing it for drift and performance. Enabling inference logging provides the raw data, while scheduling a job to compute drift metrics against the training set enables detection of data drift. Together, these actions allow the engineer to identify when the model's input distribution diverges from training, which is a key signal of degradation.

Answer

Enable automatic model retraining triggered by any change in the input data schema.

Answer

Use the model's training accuracy as a proxy for production performance and set up alerts based on that metric.

Answer

Configure the endpoint to use a smaller instance type to reduce cost, as monitoring does not require additional resources.

Question 17

You need to ensure that a model deployed to a Databricks Model Serving endpoint can be rolled back quickly if it starts performing poorly. Which feature should you use?

Accepted Answer

Enable multiple model versions on the endpoint and use traffic splitting to shift traffic back to a previous version.. Model Serving endpoints can host multiple model versions and use traffic splitting to route requests. If a new version underperforms, you can instantly shift traffic back to a previous version by adjusting the split, achieving a fast rollback without redeployment. Other methods are manual, slow, or do not directly control the serving endpoint.

Answer

Use MLflow Model Registry to transition the model version back to Staging, which automatically reverts the serving endpoint.

Answer

Delete the current model version from the registry and register the previous version as a new version.

Answer

Configure the endpoint to use a webhook that triggers a rollback job when performance metrics drop.

Question 18

When developing a machine learning model on Databricks, what is the primary benefit of using Feature Store over standard Delta Lake tables for feature management?

Accepted Answer

It ensures feature consistency between training and inference.. Databricks Feature Store provides a unified interface for feature engineering, storage, and retrieval. Its primary advantage is consistency, ensuring that the same feature transformation logic is applied during both training and inference. This eliminates "training-serving skew," a common issue where discrepancies between development and production pipelines lead to degraded model performance in real-world scenarios.

Answer

It provides built-in GPU acceleration for all training jobs.

Answer

It automates the elimination of data leakage during training.

Answer

It automatically converts all data types to tensors.

Question 19

A machine learning engineer is using Hyperopt with SparkTrials on a Databricks cluster to tune a gradient boosting model. They notice that the tuning job is running slowly because each trial trains on the full dataset, and they want to speed up the search without sacrificing final model quality. Which approach is most appropriate?

Accepted Answer

Use a smaller subset of the training data for each trial and then retrain the best model on the full dataset.. Using a data subset for hyperparameter tuning accelerates the search by reducing training time per trial, enabling more configurations to be evaluated. Once the best hyperparameters are found, retraining on the full dataset ensures the final model benefits from all available data. This balances efficiency and quality, especially when full-dataset training is expensive.

Answer

Increase the parallelism parameter in SparkTrials to run more trials concurrently.

Answer

Reduce the number of trials and increase the max_evals parameter to compensate.

Answer

Switch from SparkTrials to Trials to avoid distributed overhead.

Question 20

Your organization wants to monitor production models for drift. Which Databricks service should be used to detect changes in the input data distribution compared to the training data?

Accepted Answer

Databricks Lakehouse Monitoring. Databricks Lakehouse Monitoring is the native solution for tracking data quality and drift. By analyzing incoming data against a baseline established during training, it identifies statistical deviations. This is critical for MLOps because detecting drift early allows data scientists to trigger retraining or investigate data pipeline issues, ensuring model performance remains consistent over time despite changing real-world data patterns.

Answer

MLflow Model Registry

Answer

Delta Live Tables (DLT)

Answer

Databricks SQL Alerting