Databricks-ML-Assoc Practice Test 4 — 25 Questions

Question 1

A team is transitioning their model development from a single notebook to a production-grade ML pipeline. Which Databricks feature should they use to manage and coordinate this end-to-end process?

Accepted Answer

Databricks Workflows.. Databricks Workflows allows for the creation of multi-task pipelines that can run notebooks, Python scripts, or JARs in a defined order. This is essential for professional ML development, where data preprocessing, training, and evaluation need to happen sequentially. Moving from ad-hoc notebooks to controlled workflows improves reliability, allows for dependency management, and enables scheduling, which is critical for continuous integration and delivery of machine learning models.

Answer

Databricks Feature Store.

Answer

MLflow Model Registry.

Answer

Databricks SQL.

Question 2

Refer to the exhibit. A developer encounters this error while trying to register a model in the Unity Catalog. What does this error signify about the model deployment process?

Accepted Answer

The model lacks a defined input and output schema.. The error indicates that the model's input and output schema are undefined, preventing the Unity Catalog from verifying data compatibility during inference. A model signature acts as a contract between the model and its consumers. Without it, the model serving environment cannot guarantee that incoming data matches the expected structure, which is a requirement for production-grade models to prevent runtime failures and ensure safe, reliable deployments in a shared enterprise environment.

Answer

The model has not been trained on enough data.

Answer

The user does not have permission to write to the catalog.

Answer

The model file size exceeds the registry's limit.

Question 3

Refer to the exhibit. A model was successfully logged but fails to load in a production environment with the error shown in the exhibit. What is the most likely cause of this issue?

Accepted Answer

The production environment has a different version of scikit-learn than the training environment.. The error indicates a missing dependency or version mismatch in the inference environment. When a model relies on specific sub-modules, these must be available in the underlying Python environment. This issue highlights the importance of correctly specifying dependencies during the logging phase. If the environment is not captured precisely, the inference cluster will fail to load the model because the necessary shared libraries are missing or incompatible.

Answer

The model artifact is corrupted during the transfer to the production environment.

Answer

The model was trained using an incompatible version of the Spark runtime.

Answer

The model requires an external network connection to download the sklearn library during loading.

Question 4

When logging a machine learning model using MLflow, which component is required to capture the environment dependencies (such as library versions) to ensure the model can be reproduced in a different Databricks workspace?

Accepted Answer

A saved requirements file or conda environment definition.. The MLflow 'conda.yaml' or 'requirements.txt' file is the standardized mechanism for tracking environment dependencies. By logging these alongside the model artifact, MLflow creates a reproducible environment signature. This is critical for MLOps, as it ensures that the model runs against the exact versions of libraries it was trained on, preventing runtime errors caused by mismatched dependency versions across different development, staging, and production environments.

Answer

The model's training accuracy metrics.

Answer

The raw training dataset used during training.

Answer

The Spark configuration file (spark-defaults.conf).

Question 5

When deploying a model to a production endpoint, what is the best practice for handling dependencies?

Accepted Answer

Include a requirements.txt file in the model artifact. The best practice is to ensure all dependencies are explicitly defined in the MLflow model artifact. Using custom environment files or letting MLflow infer them ensures that the production container is built using the exact versions of packages used in training. This minimizes the risk of production-level errors caused by version mismatches, ensuring stability and reproducibility across the model lifecycle in the Databricks ecosystem.

Answer

Manually install dependencies in the cluster terminal

Answer

Use the 'latest' tag for all library imports

Answer

Only use libraries that come pre-installed in the Databricks Runtime

Question 6

A data scientist wants to test a newly registered model version interactively before promoting it to production. They need to send a sample request to the model and inspect the prediction and the model's input schema. Which Databricks feature should they use?

Accepted Answer

The Serving tab of the registered model in Unity Catalog, which provides a test request interface.. The Serving tab on a registered model version in Unity Catalog offers a built-in test interface. It lets the user submit a sample request, see the prediction, and review the model signature that defines expected inputs and outputs. This provides a quick validation step before the version is promoted or attached to a production endpoint.

Answer

The Databricks Jobs UI run history for the training job.

Answer

The `mlflow.pyfunc.load_model` function in a notebook.

Answer

The Model Registry's version description field.

Question 7

A data scientist is training a model using MLflow on Databricks and needs to ensure that all parameters and metrics are logged for every training run. Which approach ensures the most reliable logging of artifacts and metrics during model training?

Accepted Answer

Invoke mlflow.autolog() at the beginning of the notebook cell prior to training.. Using mlflow.autolog() is the recommended practice for capturing model metadata, hyperparameters, and metrics automatically in Databricks. This approach minimizes boilerplate code and ensures consistency across experiments, reducing human error. It is vital for reproducibility and model governance within the Databricks environment, as it captures the framework-specific details required for later model registration and deployment without requiring manual tracking of every individual metric.

Answer

Manually call mlflow.log_metric for every individual iteration inside the training loop.

Answer

Configure the MLflow tracking URI to point to an external database before initiating the training.

Answer

Use the model.save() method instead of MLflow tracking for better persistence.

Question 8

A data scientist is training a machine learning model on Databricks and needs to log parameters, metrics, and model artifacts. Which tracking component should be used to ensure the reproducibility of the experiment runs?

Accepted Answer

MLflow Tracking. MLflow Tracking is the core component for logging parameters, code versions, metrics, and output files when running machine learning code. By recording these artifacts, teams can compare multiple runs, track model lineage, and ensure that experiments are reproducible across different environments. Integrating MLflow into the workflow is essential for transitioning from local notebook experimentation to production-ready MLOps pipelines within the Databricks ecosystem.

Answer

Databricks Feature Store

Answer

MLflow Model Registry

Answer

Delta Lake Versioning

Question 9

A data scientist is training a model using MLflow on Databricks. They need to ensure that the model artifacts, environment dependencies, and signature are automatically captured to facilitate seamless deployment to Databricks Model Serving. Which command should they use within the training script?

Accepted Answer

mlflow.sklearn.log_model(). The mlflow.spark.log_model or mlflow.sklearn.log_model functions are critical for capturing the model flavor, environment, and signature. By automatically logging these components, Databricks Model Serving can identify the required dependencies and input schema, allowing for a standardized deployment process. This automation is essential for reducing manual configuration errors and ensuring that the model behaves identically in production as it did during the training phase.

Answer

mlflow.save_model()

Answer

mlflow.log_artifact()

Answer

mlflow.set_tracking_uri()

Question 10

A user is experiencing 'Out of Memory' (OOM) errors during the evaluation phase of a large XGBoost model on Databricks. What is the most effective way to address this while utilizing the distributed nature of Databricks?

Accepted Answer

Use a Spark-native implementation of the algorithm.. Using Spark-based distributed training, such as the `sparkdl` or native XGBoost spark estimator, allows the data to be partitioned across the cluster nodes. This prevents the driver from attempting to hold the entire dataset in memory. By distributing the workload, the system can handle datasets that exceed the memory capacity of a single machine, which is fundamental for scaling machine learning applications on Databricks.

Answer

Increase the driver node memory indefinitely.

Answer

Downsample the data until it fits in memory.

Answer

Convert the data to a single JSON file.

Question 11

Refer to the exhibit. A model is failing to deploy to Databricks Model Serving. The error log indicates 'Schema Mismatch'. Based on the JSON signature provided, what is the most likely cause of the deployment failure?

Accepted Answer

The input data types do not match the expected integer/double types.. The error occurs because the input data sent to the serving endpoint does not match the defined signature. The signature strictly enforces types; if the incoming request sends a string instead of an integer for 'age', or if a field is missing, the serving layer rejects the payload. Validating the schema against the expected MLflow signature is critical for preventing runtime inference errors when integrating with external client applications.

Answer

The model environment is missing.

Answer

The output type is too large to process.

Answer

The model version is not registered.

Question 12

When logging a model using MLflow, what does the 'artifacts' parameter allow a user to include?

Accepted Answer

Additional files and dependencies required for model inference.. The 'artifacts' parameter allows users to bundle additional files, such as custom scripts, configuration files, or data samples, along with the model. This is crucial for custom model implementations where the model relies on external code or auxiliary data to function correctly. Including these artifacts ensures that the model environment is self-contained, promoting portability and preventing failures when the model is deployed on a different cluster.

Answer

A list of all users who have access to the model.

Answer

A copy of the raw training dataset.

Answer

The credentials used to authenticate the training job.

Question 13

Which Databricks artifact should be used to encapsulate a model, its environment dependencies, and the required code to ensure consistent model behavior across different deployment environments?

Accepted Answer

An MLflow model with a captured Conda or pip environment.. An MLflow model flavor, specifically using the 'MLmodel' metadata file, provides a standard format for packaging models. By including the conda.yaml or requirements.txt file, MLflow captures all environment dependencies. This ensures that when the model is loaded in any environment (e.g., development, staging, production), the environment is reconstructed exactly, preventing version mismatches and runtime errors that frequently cause failed deployments in machine learning pipelines.

Answer

A raw Python script that loads the model weights.

Answer

A Delta Table containing the trained model weights.

Answer

A Git repository containing the training notebook and data.

Question 14

A data scientist is deploying a model to a Databricks Model Serving endpoint. They observe that the inference latency is high. What should they check first?

Accepted Answer

The complexity of the input data and preprocessing transformations.. High inference latency is often caused by heavy preprocessing steps or unoptimized model complexity. Checking the 'inference profile' or analyzing the time taken for data transformation versus the actual model prediction is the most critical first step. By separating these concerns, the data scientist can identify whether the bottleneck lies in the feature engineering pipeline (which might need optimization) or the model architecture itself, enabling targeted performance improvements.

Answer

The number of users accessing the workspace.

Answer

The version of the Databricks Runtime installed on the cluster.

Answer

The storage location of the training dataset.

Question 15

Which TWO of the following are benefits of using the Databricks Feature Store for machine learning workflows?

Accepted Answer

It enables consistent feature definitions across training and inference pipelines.. The Databricks Feature Store facilitates feature reuse across different teams and projects, preventing redundant engineering work. Additionally, it ensures point-in-time correctness by preventing data leakage during training through time-travel capabilities. These features are critical for maintaining consistency between training and inference environments, reducing the likelihood of training-serving skew, and streamlining the overall MLOps lifecycle within the Databricks platform.

Answer

It automatically scales the compute resources for training deep learning models.

Answer

It automatically retrains models when feature data changes.

Answer

It converts unstructured image data into structured feature vectors.

Question 16

Which feature in Databricks allows a data scientist to version and manage the lifecycle of machine learning models in a centralized repository?

Accepted Answer

Databricks Model Registry. The Model Registry is the central component in Databricks for managing the model lifecycle. It allows users to transition models through stages like Staging, Production, and Archived. This structure is vital for large teams to ensure that only validated models are deployed to production environments, providing a clear audit trail and simplifying deployment workflows through versioning and stage-based access controls.

Answer

MLflow Experiments

Answer

Databricks Repos

Answer

Unity Catalog

Question 17

Refer to the exhibit. A data scientist receives this error while trying to load a model. What is the most likely cause of this failure in the workflow?

Accepted Answer

The model version number is incorrectly referenced in the code.. This error indicates that the code is attempting to reference a specific version of a model that does not exist in the Model Registry. This often occurs when a script relies on hard-coded version numbers rather than dynamic lookups or stage-based references. In a production workflow, using stage aliases like 'Production' is preferred to ensure that the application always fetches the current valid version without needing manual updates when models are updated.

Answer

The model has been deleted from the registry.

Answer

The cluster does not have permission to access the MLflow registry.

Answer

The MLflow tracking URI is pointing to a different workspace.

Question 18

A data scientist needs to perform hyperparameter tuning using Hyperopt. Which THREE components are essential to successfully implement an automated tuning run on a Databricks cluster?

Accepted Answer

A defined objective function that minimizes or maximizes a metric.. Successful hyperparameter tuning with Hyperopt requires a well-defined objective function, a search space, and an optimization algorithm. Integration with MLflow is also critical to track the performance of every trial. By combining these three elements, the scientist can efficiently navigate the search space to find optimal model parameters, while ensuring that the results are logged and manageable within the Databricks MLflow tracking workspace.

Answer

A pre-trained model checkpoint to initialize the search.

Answer

A dedicated GPU cluster for every single trial run.

Question 19

When designing an ML workflow, what is the primary benefit of using MLflow Projects over executing raw scripts?

Accepted Answer

They facilitate consistent execution by encapsulating environment and dependency definitions.. MLflow Projects provide a standard format for packaging reusable data science code. By using a YAML-based environment definition, they ensure that the code runs in the exact same environment across different machines. This is critical for ML workflows to guarantee reproducibility, as it eliminates the 'it works on my machine' problem by explicitly defining the dependencies and environment setup required for the project execution in a portable, platform-agnostic manner.

Answer

They automatically scale the underlying compute cluster size based on the task.

Answer

They allow for the automatic versioning and tracking of data snapshots.

Answer

They replace the need for unit testing individual functions within the pipeline.

Question 20

A data scientist needs to track parameters, metrics, and model artifacts during training on Databricks. Which approach is the industry-standard best practice to ensure reproducibility and lineage?

Accepted Answer

Use the MLflow Tracking API to log parameters and artifacts during the training run.. MLflow Tracking is the core component for logging parameters, metrics, and artifacts in Databricks. By integrating MLflow into the training script, data scientists create a centralized record of every experiment run. This allows for easy comparison between different model versions, facilitates team collaboration, and ensures that the exact code, environment, and hyperparameter configuration used to produce a specific model artifact can be audited and reproduced later in the MLOps lifecycle.

Answer

Manually save model artifacts to DBFS and document parameters in a spreadsheet.

Answer

Write all model logs to a local temporary folder on the driver node.

Answer

Deploy the model directly to production without logging parameters to save compute costs.