Databricks-ML-Assoc Practice Test 10 — 10 Questions

Question 1

Which feature in Databricks allows a data scientist to version and manage the lifecycle of machine learning models in a centralized repository?

Accepted Answer

Databricks Model Registry. The Model Registry is the central component in Databricks for managing the model lifecycle. It allows users to transition models through stages like Staging, Production, and Archived. This structure is vital for large teams to ensure that only validated models are deployed to production environments, providing a clear audit trail and simplifying deployment workflows through versioning and stage-based access controls.

Answer

MLflow Experiments

Answer

Databricks Repos

Answer

Unity Catalog

Question 2

Refer to the exhibit. A data scientist receives this error while trying to load a model. What is the most likely cause of this failure in the workflow?

Accepted Answer

The model version number is incorrectly referenced in the code.. This error indicates that the code is attempting to reference a specific version of a model that does not exist in the Model Registry. This often occurs when a script relies on hard-coded version numbers rather than dynamic lookups or stage-based references. In a production workflow, using stage aliases like 'Production' is preferred to ensure that the application always fetches the current valid version without needing manual updates when models are updated.

Answer

The model has been deleted from the registry.

Answer

The cluster does not have permission to access the MLflow registry.

Answer

The MLflow tracking URI is pointing to a different workspace.

Question 3

A data scientist needs to perform hyperparameter tuning using Hyperopt. Which THREE components are essential to successfully implement an automated tuning run on a Databricks cluster?

Accepted Answer

A defined objective function that minimizes or maximizes a metric.. Successful hyperparameter tuning with Hyperopt requires a well-defined objective function, a search space, and an optimization algorithm. Integration with MLflow is also critical to track the performance of every trial. By combining these three elements, the scientist can efficiently navigate the search space to find optimal model parameters, while ensuring that the results are logged and manageable within the Databricks MLflow tracking workspace.

Answer

A pre-trained model checkpoint to initialize the search.

Answer

A dedicated GPU cluster for every single trial run.

Question 4

When designing an ML workflow, what is the primary benefit of using MLflow Projects over executing raw scripts?

Accepted Answer

They facilitate consistent execution by encapsulating environment and dependency definitions.. MLflow Projects provide a standard format for packaging reusable data science code. By using a YAML-based environment definition, they ensure that the code runs in the exact same environment across different machines. This is critical for ML workflows to guarantee reproducibility, as it eliminates the 'it works on my machine' problem by explicitly defining the dependencies and environment setup required for the project execution in a portable, platform-agnostic manner.

Answer

They automatically scale the underlying compute cluster size based on the task.

Answer

They allow for the automatic versioning and tracking of data snapshots.

Answer

They replace the need for unit testing individual functions within the pipeline.

Question 5

A data scientist needs to track parameters, metrics, and model artifacts during training on Databricks. Which approach is the industry-standard best practice to ensure reproducibility and lineage?

Accepted Answer

Use the MLflow Tracking API to log parameters and artifacts during the training run.. MLflow Tracking is the core component for logging parameters, metrics, and artifacts in Databricks. By integrating MLflow into the training script, data scientists create a centralized record of every experiment run. This allows for easy comparison between different model versions, facilitates team collaboration, and ensures that the exact code, environment, and hyperparameter configuration used to produce a specific model artifact can be audited and reproduced later in the MLOps lifecycle.

Answer

Manually save model artifacts to DBFS and document parameters in a spreadsheet.

Answer

Write all model logs to a local temporary folder on the driver node.

Answer

Deploy the model directly to production without logging parameters to save compute costs.

Question 6

Refer to the exhibit. A data scientist is attempting to log a model to an S3 bucket via MLflow, but they receive the error shown. What is the most likely root cause?

Accepted Answer

The compute cluster's instance profile lacks write access to the S3 bucket.. The 'Permission denied' error indicates that the identity running the Databricks notebook or job lacks the necessary IAM permissions to write to the specified S3 bucket. In Databricks, interacting with external storage requires proper instance profile or service principal configuration. This error underscores the importance of cloud identity and access management (IAM) in ML workflows, as secure, authorized access to storage is foundational for maintaining the integrity and security of model artifacts during the development lifecycle.

Answer

The S3 bucket is full and cannot accept new model artifacts.

Answer

The MLflow model flavor is not compatible with the S3 storage protocol.

Answer

The run_id 'xyz123' already exists and is locked by another user.

Question 7

Refer to the exhibit. Why is providing an 'input_example' highly recommended during the model logging process?

Accepted Answer

It enables automatic schema validation and documentation in the model registry.. Providing an input example allows MLflow to infer the model's input schema and provides a test case for downstream deployment. This example is critical for Databricks to validate the model's interface, allowing automated tests to run against the model immediately upon deployment. It also serves as a form of self-documentation, helping other team members understand how to interact with the model's API without needing to look at complex training code.

Answer

It automatically generates unit tests for the training pipeline.

Answer

It increases the accuracy of the model during inference.

Answer

It forces the model to use a faster serializing algorithm.

Question 8

Which Databricks feature allows you to manage the lifecycle of a model, including transitions from 'Staging' to 'Production'?

Accepted Answer

MLflow Model Registry. The MLflow Model Registry provides a centralized store for managing models throughout their lifecycle. It allows teams to track model versions, apply transitions (e.g., Staging to Production), and manage metadata. This central control is fundamental for MLOps, as it provides a clear record of which model is currently active in the production environment and ensures that only validated models are promoted to downstream systems.

Answer

Databricks SQL

Answer

Delta Live Tables

Answer

Unity Catalog

Question 9

What is the primary benefit of using a 'Job Cluster' instead of an 'All-Purpose Cluster' for automated ML workflows?

Accepted Answer

Job clusters provide lower costs and better environment isolation.. Job clusters are ephemeral compute resources that are created for a specific job and terminated immediately after completion. They are significantly more cost-effective because they use specialized pricing and ensure that resources are not idling between runs. Using job clusters also ensures complete environment isolation, preventing interference from other users or interactive processes, which is foundational for ensuring reproducible and reliable machine learning pipeline execution in production environments.

Answer

All-purpose clusters are always faster for training large models.

Answer

Job clusters allow for interactive debugging of code during runtime.

Answer

All-purpose clusters are required for scheduling workflows in Databricks.

Question 10

When using the Databricks Feature Store for real-time inference, why is it recommended to use a specific online store (e.g., Cosmos DB) instead of querying the offline store?

Accepted Answer

Online stores are designed for low-latency random access lookups.. Offline stores (Delta Lake) are optimized for high-throughput, sequential read/write operations common in batch training, but they suffer from high latency during random access lookups. Online stores are optimized for low-latency point lookups (Key-Value access). Separating these storage tiers allows ML models to achieve the sub-millisecond response times required for real-time applications while still leveraging the massive analytical capabilities of the offline store for training.

Answer

The offline store is not compatible with the Python programming language.

Answer

The offline store cannot handle concurrent requests from multiple inference endpoints.

Answer

The offline store requires a GPU cluster to perform any queries.