Databricks-ML-Assoc Practice Exam 4 — 20 Questions

Question 1

When preparing data for machine learning in Databricks, which feature of Delta Lake is most beneficial for managing large-scale datasets during the training process?

Accepted Answer

Time Travel (versioning) to access previous snapshots of training data.. Delta Lake's Time Travel (versioning) feature allows data scientists to query data as it existed at a specific point in time. This is essential for ensuring reproducibility in machine learning experiments, as it ensures that the training data remains consistent across different runs, even if the underlying table is updated or modified by other processes in the production pipeline.

Answer

Compaction (Auto Optimize) for improved query speed during data reading.

Answer

Schema enforcement to prevent corrupted data from entering the training set.

Answer

Z-Ordering to speed up filtering on specific columns in the dataset.

Question 2

When developing a model, a data scientist uses the MLflow 'pyfunc' flavor to wrap their model. What is the primary benefit of using this approach?

Accepted Answer

It enables the model to be saved and loaded in a consistent, standardized format across different frameworks.. The 'pyfunc' flavor provides a generic, standardized wrapper for models. This is crucial because it allows any model—regardless of the library (scikit-learn, XGBoost, PyTorch)—to be deployed in the same way. By providing a common predict method, 'pyfunc' ensures that downstream serving infrastructure can interact with the model without knowing the underlying library's specific API, which is vital for standardized model deployment pipelines.

Answer

It automatically converts the model into a Spark UDF for faster distributed batch inference.

Answer

It optimizes the model size by removing unnecessary metadata during the serialization process.

Answer

It provides built-in hyperparameter tuning capabilities for the wrapped model.

Question 3

An ML engineer registers a model in Unity Catalog and needs a stable pointer that always resolves to the version currently approved for production, without modifying calling code each time a new version is promoted. Which Model Registry feature should the engineer configure to provide this stable reference?

Accepted Answer

A model version alias such as 'champion' assigned to the approved version. Model version aliases provide exactly the stable, reassignable pointer described: consumers load by alias, and promotion is performed by moving the alias to the newly approved version. Tags, descriptions, and permission grants are metadata or access controls and cannot redirect consumers to a chosen version at load time.

Answer

A model version tag recording the approval date

Answer

A registered model description summarizing the production candidate

Answer

A workspace-level permission grant on the registered model

Question 4

Which approach is most efficient for deploying a high-throughput, low-latency model in Databricks?

Accepted Answer

Using Databricks Model Serving. Databricks Model Serving is the recommended service for production environments requiring low latency and high scalability. It automatically manages scaling and infrastructure, ensuring that models are served in a highly available manner. By abstracting away the server management and load balancing, it allows developers to focus on model performance rather than infrastructure maintenance, which is essential for maintaining service level agreements in production-grade ML applications.

Answer

Running a custom Flask app on a standard notebook

Answer

Batch processing using Spark streaming

Answer

Manual deployment to an external cloud VM

Question 5

Which Databricks feature provides a managed environment specifically optimized for machine learning libraries like TensorFlow, PyTorch, and XGBoost?

Accepted Answer

Databricks Runtime for Machine Learning. Databricks Runtime for Machine Learning (ML Runtime) is pre-configured with popular machine learning libraries and optimized versions of deep learning frameworks. It includes pre-installed dependencies and optimized binaries for distributed training, which saves time for data scientists who would otherwise need to manually configure clusters. This runtime simplifies the setup process and ensures compatibility between the infrastructure and the most common data science toolkits used in production machine learning projects.

Answer

Databricks SQL

Answer

Delta Live Tables

Answer

Unity Catalog

Question 6

A data scientist needs to run the same feature-engineering notebook against three different parameter sets in a Databricks Job. She wants each parameter set to execute independently and in parallel, with separate logs. Which Job feature should she use?

Accepted Answer

A for-each task that iterates over a parameter array and runs the notebook once per element.. The for-each task is designed for iterating a nested task over an input array, producing one task run per element with its own logs and status. That gives the independent, parallel executions the scientist needs while keeping everything in one workflow. Passing a JSON string, creating separate jobs, or relying on autoscaling all fail to produce per-parameter task runs with isolated logs.

Answer

A job cluster with autoscaling enabled and a single task.

Answer

A single notebook task with the three parameter sets passed as a JSON string argument.

Answer

Three separate jobs created from the same notebook, each with its own parameter.

Question 7

A data scientist is using Databricks Feature Store to create a feature table for a recommendation model. They want to ensure that the same feature computation logic is used both during training and at inference time to avoid training-serving skew. Which Feature Store capability directly addresses this requirement?

Accepted Answer

Feature Store allows features to be computed once and reused across training and batch or online serving through a unified feature computation function.. Databricks Feature Store reduces training-serving skew by letting you define a feature computation function that is used both to create the feature table for training and to compute features at inference time. This unified logic ensures that the model sees features derived from the same transformations in both phases.

Answer

Feature Store provides a point-in-time lookup that ensures training data reflects the state of features at the time of each label event.

Answer

Feature Store enforces schema validation on feature tables, rejecting any inference request that does not match the training schema.

Answer

Feature Store automatically versions feature tables and tracks lineage from source data to model.

Question 8

A data scientist is building a pipeline using MLflow. Which TWO of the following tasks should be performed to ensure experiment reproducibility and auditability?

Accepted Answer

Log the git commit hash using mlflow.set_tag().. Reproducibility in machine learning requires strict tracking of code versions, dependencies, and parameters. By logging the source code version (git hash) and the specific Python environment (conda.yaml or requirements.txt), the scientist ensures that any collaborator can recreate the exact training state later. These practices are fundamental to the Databricks ML lifecycle, ensuring that models can be retrained or audited for compliance during the deployment phase.

Answer

Manually copy the training data into the MLflow model folder.

Answer

Disable the automatic logging feature to save memory.

Answer

Use a global variable for all experiment parameters.

Question 9

You are tracking a deep learning model experiment using MLflow. You want to ensure that the model architecture and all hyperparameters are easily reproducible. Which approach is best practice?

Accepted Answer

Log parameters, metrics, and include the conda environment configuration with the model.. Logging model parameters and the environment configuration (like conda.yaml or requirements.txt) via MLflow ensures reproducibility. By capturing the exact package versions and architectural settings during the run, you eliminate the 'it works on my machine' problem. This practice is essential in production workflows where model drift or performance degradation requires auditing the exact conditions under which a specific model version was trained.

Answer

Only log the final model artifacts to the MLflow Model Registry to save disk space.

Answer

Manually copy the training code into a text field in the MLflow UI for every run.

Answer

Use a global variable in your notebook to store all hyperparameters for easy access.

Question 10

Which THREE actions are best practice when deploying a machine learning model using Databricks Model Serving?

Accepted Answer

Ensure the model signature is defined to enable input validation.. Databricks Model Serving provides a managed endpoint for low-latency inference. Adopting best practices for deployment—such as using environment variables, ensuring proper logging, and testing in staging—is essential for maintaining reliable, scalable, and secure production services. These practices ensure that the serving infrastructure is decoupled from the training environment, adheres to security policies, and provides observability into model performance in real-world conditions, effectively bridging the gap between model development and operational deployment.

Answer

Hardcode API credentials directly into the model inference script.

Answer

Perform inference on the same cluster used for training to save costs.

Question 11

Which Databricks ML component is best suited for managing access control for machine learning experiments and models across different teams?

Accepted Answer

Unity Catalog.. Unity Catalog is the centralized governance layer in Databricks. It allows administrators to define fine-grained access controls for experiments and models, ensuring that sensitive IP is protected and that users only have access to what they need. Implementing Unity Catalog is a best practice for security and compliance, ensuring that model assets are governed as strictly as the underlying data they rely on.

Answer

Notebook tags.

Answer

Environment variables in the cluster config.

Answer

The 'git commit' history.

Question 12

Refer to the exhibit. A user attempts to transition a model to production, but the code fails with the provided error. What is the most likely cause?

Accepted Answer

The model has not been registered in the Model Registry.. The error indicates that the Model Registry cannot locate the model name provided. In Databricks, models must be registered before they can be transitioned to specific stages like 'Production'. The user likely misspelled the model name or is attempting to reference a model that has not yet been registered within the current workspace environment. Verifying the Model Registry UI will confirm the correct naming conventions and existing model registrations.

Answer

The cluster does not have sufficient permissions to read the model.

Answer

The model version is archived and cannot be transitioned.

Answer

The model artifact is missing from the underlying DBFS storage.

Question 13

Why is it important to use a 'Feature Store' rather than joining raw tables directly in the training notebook?

Accepted Answer

It prevents training-serving skew by centralizing feature logic.. Using a Feature Store ensures that feature engineering logic is consistent and reusable across different models, preventing 'training-serving skew'. Joining raw tables in a notebook often leads to 're-implementation drift', where the code used in training differs slightly from the production inference pipeline. A Feature Store enforces a single source of truth for features, making models more reliable and reducing the time spent on redundant data cleaning tasks.

Answer

It is faster to write raw SQL joins.

Answer

It automatically deletes old training data.

Answer

It prevents the use of any non-SQL data sources.

Question 14

When performing hyperparameter tuning using Hyperopt with SparkTrials on Databricks, what is the primary advantage of using SparkTrials over the standard Trials object?

Accepted Answer

SparkTrials allows for the distribution of training jobs across multiple workers.. SparkTrials enables the parallel execution of hyperparameter trials across the Spark cluster. By distributing the training tasks, it significantly reduces the time required to complete large grid or random searches. Understanding this distinction is essential for optimizing the development lifecycle, as it prevents the bottleneck of sequential execution on a single node, which is unfeasible for complex models or large datasets common in professional enterprise scenarios.

Answer

SparkTrials automatically selects the best hyperparameters.

Answer

SparkTrials provides built-in visualization of the parameter space.

Answer

SparkTrials forces the use of a GPU-enabled cluster.

Question 15

When logging a model in Databricks, why is it recommended to specify the `pip_requirements` or `conda_env` explicitly instead of relying on the environment's current state?

Accepted Answer

It ensures the model remains portable and reproducible.. Relying on the current notebook environment is risky because it captures all installed packages, not just those required for the model. Specifying dependencies explicitly ensures that the environment is minimal and reproducible, which is vital for preventing environment conflicts in production. This practice ensures that the model can be deployed successfully in clean, isolated environments, a core requirement for stable production model serving and CI/CD pipelines.

Answer

It forces the model to use the latest version of all libraries.

Answer

It significantly reduces the model artifact's memory usage.

Answer

It allows the model to run without any Python libraries.

Question 16

A team is transitioning their model development from a single notebook to a production-grade ML pipeline. Which Databricks feature should they use to manage and coordinate this end-to-end process?

Accepted Answer

Databricks Workflows.. Databricks Workflows allows for the creation of multi-task pipelines that can run notebooks, Python scripts, or JARs in a defined order. This is essential for professional ML development, where data preprocessing, training, and evaluation need to happen sequentially. Moving from ad-hoc notebooks to controlled workflows improves reliability, allows for dependency management, and enables scheduling, which is critical for continuous integration and delivery of machine learning models.

Answer

Databricks Feature Store.

Answer

MLflow Model Registry.

Answer

Databricks SQL.

Question 17

Refer to the exhibit. A developer encounters this error while trying to register a model in the Unity Catalog. What does this error signify about the model deployment process?

Accepted Answer

The model lacks a defined input and output schema.. The error indicates that the model's input and output schema are undefined, preventing the Unity Catalog from verifying data compatibility during inference. A model signature acts as a contract between the model and its consumers. Without it, the model serving environment cannot guarantee that incoming data matches the expected structure, which is a requirement for production-grade models to prevent runtime failures and ensure safe, reliable deployments in a shared enterprise environment.

Answer

The model has not been trained on enough data.

Answer

The user does not have permission to write to the catalog.

Answer

The model file size exceeds the registry's limit.

Question 18

Refer to the exhibit. A model was successfully logged but fails to load in a production environment with the error shown in the exhibit. What is the most likely cause of this issue?

Accepted Answer

The production environment has a different version of scikit-learn than the training environment.. The error indicates a missing dependency or version mismatch in the inference environment. When a model relies on specific sub-modules, these must be available in the underlying Python environment. This issue highlights the importance of correctly specifying dependencies during the logging phase. If the environment is not captured precisely, the inference cluster will fail to load the model because the necessary shared libraries are missing or incompatible.

Answer

The model artifact is corrupted during the transfer to the production environment.

Answer

The model was trained using an incompatible version of the Spark runtime.

Answer

The model requires an external network connection to download the sklearn library during loading.

Question 19

When logging a machine learning model using MLflow, which component is required to capture the environment dependencies (such as library versions) to ensure the model can be reproduced in a different Databricks workspace?

Accepted Answer

A saved requirements file or conda environment definition.. The MLflow 'conda.yaml' or 'requirements.txt' file is the standardized mechanism for tracking environment dependencies. By logging these alongside the model artifact, MLflow creates a reproducible environment signature. This is critical for MLOps, as it ensures that the model runs against the exact versions of libraries it was trained on, preventing runtime errors caused by mismatched dependency versions across different development, staging, and production environments.

Answer

The model's training accuracy metrics.

Answer

The raw training dataset used during training.

Answer

The Spark configuration file (spark-defaults.conf).

Question 20

When deploying a model to a production endpoint, what is the best practice for handling dependencies?

Accepted Answer

Include a requirements.txt file in the model artifact. The best practice is to ensure all dependencies are explicitly defined in the MLflow model artifact. Using custom environment files or letting MLflow infer them ensures that the production container is built using the exact versions of packages used in training. This minimizes the risk of production-level errors caused by version mismatches, ensuring stability and reproducibility across the model lifecycle in the Databricks ecosystem.

Answer

Manually install dependencies in the cluster terminal

Answer

Use the 'latest' tag for all library imports

Answer

Only use libraries that come pre-installed in the Databricks Runtime