Databricks-ML-Assoc Practice Test 8 — 10 Questions

Question 1

Which Databricks ML component is best suited for managing access control for machine learning experiments and models across different teams?

Accepted Answer

Unity Catalog.. Unity Catalog is the centralized governance layer in Databricks. It allows administrators to define fine-grained access controls for experiments and models, ensuring that sensitive IP is protected and that users only have access to what they need. Implementing Unity Catalog is a best practice for security and compliance, ensuring that model assets are governed as strictly as the underlying data they rely on.

Answer

Notebook tags.

Answer

Environment variables in the cluster config.

Answer

The 'git commit' history.

Question 2

Refer to the exhibit. A user attempts to transition a model to production, but the code fails with the provided error. What is the most likely cause?

Accepted Answer

The model has not been registered in the Model Registry.. The error indicates that the Model Registry cannot locate the model name provided. In Databricks, models must be registered before they can be transitioned to specific stages like 'Production'. The user likely misspelled the model name or is attempting to reference a model that has not yet been registered within the current workspace environment. Verifying the Model Registry UI will confirm the correct naming conventions and existing model registrations.

Answer

The cluster does not have sufficient permissions to read the model.

Answer

The model version is archived and cannot be transitioned.

Answer

The model artifact is missing from the underlying DBFS storage.

Question 3

Why is it important to use a 'Feature Store' rather than joining raw tables directly in the training notebook?

Accepted Answer

It prevents training-serving skew by centralizing feature logic.. Using a Feature Store ensures that feature engineering logic is consistent and reusable across different models, preventing 'training-serving skew'. Joining raw tables in a notebook often leads to 're-implementation drift', where the code used in training differs slightly from the production inference pipeline. A Feature Store enforces a single source of truth for features, making models more reliable and reducing the time spent on redundant data cleaning tasks.

Answer

It is faster to write raw SQL joins.

Answer

It automatically deletes old training data.

Answer

It prevents the use of any non-SQL data sources.

Question 4

When performing hyperparameter tuning using Hyperopt with SparkTrials on Databricks, what is the primary advantage of using SparkTrials over the standard Trials object?

Accepted Answer

SparkTrials allows for the distribution of training jobs across multiple workers.. SparkTrials enables the parallel execution of hyperparameter trials across the Spark cluster. By distributing the training tasks, it significantly reduces the time required to complete large grid or random searches. Understanding this distinction is essential for optimizing the development lifecycle, as it prevents the bottleneck of sequential execution on a single node, which is unfeasible for complex models or large datasets common in professional enterprise scenarios.

Answer

SparkTrials automatically selects the best hyperparameters.

Answer

SparkTrials provides built-in visualization of the parameter space.

Answer

SparkTrials forces the use of a GPU-enabled cluster.

Question 5

When logging a model in Databricks, why is it recommended to specify the `pip_requirements` or `conda_env` explicitly instead of relying on the environment's current state?

Accepted Answer

It ensures the model remains portable and reproducible.. Relying on the current notebook environment is risky because it captures all installed packages, not just those required for the model. Specifying dependencies explicitly ensures that the environment is minimal and reproducible, which is vital for preventing environment conflicts in production. This practice ensures that the model can be deployed successfully in clean, isolated environments, a core requirement for stable production model serving and CI/CD pipelines.

Answer

It forces the model to use the latest version of all libraries.

Answer

It significantly reduces the model artifact's memory usage.

Answer

It allows the model to run without any Python libraries.

Question 6

A team is transitioning their model development from a single notebook to a production-grade ML pipeline. Which Databricks feature should they use to manage and coordinate this end-to-end process?

Accepted Answer

Databricks Workflows.. Databricks Workflows allows for the creation of multi-task pipelines that can run notebooks, Python scripts, or JARs in a defined order. This is essential for professional ML development, where data preprocessing, training, and evaluation need to happen sequentially. Moving from ad-hoc notebooks to controlled workflows improves reliability, allows for dependency management, and enables scheduling, which is critical for continuous integration and delivery of machine learning models.

Answer

Databricks Feature Store.

Answer

MLflow Model Registry.

Answer

Databricks SQL.

Question 7

Refer to the exhibit. A developer encounters this error while trying to register a model in the Unity Catalog. What does this error signify about the model deployment process?

Accepted Answer

The model lacks a defined input and output schema.. The error indicates that the model's input and output schema are undefined, preventing the Unity Catalog from verifying data compatibility during inference. A model signature acts as a contract between the model and its consumers. Without it, the model serving environment cannot guarantee that incoming data matches the expected structure, which is a requirement for production-grade models to prevent runtime failures and ensure safe, reliable deployments in a shared enterprise environment.

Answer

The model has not been trained on enough data.

Answer

The user does not have permission to write to the catalog.

Answer

The model file size exceeds the registry's limit.

Question 8

Refer to the exhibit. A model was successfully logged but fails to load in a production environment with the error shown in the exhibit. What is the most likely cause of this issue?

Accepted Answer

The production environment has a different version of scikit-learn than the training environment.. The error indicates a missing dependency or version mismatch in the inference environment. When a model relies on specific sub-modules, these must be available in the underlying Python environment. This issue highlights the importance of correctly specifying dependencies during the logging phase. If the environment is not captured precisely, the inference cluster will fail to load the model because the necessary shared libraries are missing or incompatible.

Answer

The model artifact is corrupted during the transfer to the production environment.

Answer

The model was trained using an incompatible version of the Spark runtime.

Answer

The model requires an external network connection to download the sklearn library during loading.

Question 9

When logging a machine learning model using MLflow, which component is required to capture the environment dependencies (such as library versions) to ensure the model can be reproduced in a different Databricks workspace?

Accepted Answer

A saved requirements file or conda environment definition.. The MLflow 'conda.yaml' or 'requirements.txt' file is the standardized mechanism for tracking environment dependencies. By logging these alongside the model artifact, MLflow creates a reproducible environment signature. This is critical for MLOps, as it ensures that the model runs against the exact versions of libraries it was trained on, preventing runtime errors caused by mismatched dependency versions across different development, staging, and production environments.

Answer

The model's training accuracy metrics.

Answer

The raw training dataset used during training.

Answer

The Spark configuration file (spark-defaults.conf).

Question 10

When deploying a model to a production endpoint, what is the best practice for handling dependencies?

Accepted Answer

Include a requirements.txt file in the model artifact. The best practice is to ensure all dependencies are explicitly defined in the MLflow model artifact. Using custom environment files or letting MLflow infer them ensures that the production container is built using the exact versions of packages used in training. This minimizes the risk of production-level errors caused by version mismatches, ensuring stability and reproducibility across the model lifecycle in the Databricks ecosystem.

Answer

Manually install dependencies in the cluster terminal

Answer

Use the 'latest' tag for all library imports

Answer

Only use libraries that come pre-installed in the Databricks Runtime