Databricks-ML-Assoc ML Workflows Practice Test 3 — 15 Questions

Question 1

You are building a pipeline in Databricks and need to ensure that a training job only runs after the upstream data preparation job has successfully completed. Which Databricks feature should you use?

Accepted Answer

Use Databricks Workflows task dependencies.. Databricks Workflows allows for the creation of complex pipelines using task dependencies. By defining a dependency between the data preparation task and the training task, the orchestrator ensures the correct execution order. This dependency management is foundational for building reliable end-to-end ML pipelines, ensuring that models are always trained on processed, valid data and preventing failures caused by missing or stale input data during the automated training process.

Answer

Use the mlflow.end_run() command at the end of the data prep script.

Answer

Use Delta Live Tables (DLT) expectations to trigger the job.

Answer

Use a cron schedule with a 30-minute delay for the training job.

Question 2

Your team is experiencing 'data drift' in production where the model's accuracy drops over time. What is the most recommended Databricks-native approach to address this?

Accepted Answer

Implement a retraining pipeline that is triggered when performance metrics drop.. Addressing data drift involves monitoring incoming production data and comparing it against the training data distribution. By using Delta Lake's time-travel capabilities and MLflow's experiment tracking, teams can identify when and why model performance degrades. This proactive monitoring allows for timely retraining of the model with updated data, ensuring that production predictions remain accurate and aligned with the current real-world environment, which is vital for long-term model reliability.

Answer

Increase the size of the serving cluster to handle more data points.

Answer

Hard-code the input feature ranges in the inference function to filter out outliers.

Answer

Switch to a more complex model architecture to better fit the production data.

Question 3

Which of the following is an advantage of using Delta Lake for the data storage layer in an ML workflow?

Accepted Answer

It enables time travel to reproduce historical training data sets.. Delta Lake provides ACID transactions and time-travel capabilities, which are essential for ML workflows. Being able to access previous versions of data (time travel) allows data scientists to reproduce exact training results, ensuring consistency across experiments. This reliability is foundational for auditing and maintaining high-quality models, as it guarantees that the data used for training is well-versioned, consistent, and resilient to failures during concurrent read/write operations common in big data environments.

Answer

It automatically cleans up old model versions from the MLflow registry.

Answer

It eliminates the need for feature engineering by auto-generating features.

Answer

It ensures that the model training code runs on a single node.

Question 4

You are deploying a model using MLflow, and you want to log the custom pre-processing logic alongside the model so it is automatically applied during inference. How should you achieve this?

Accepted Answer

Use the mlflow.pyfunc.log_model() function with a custom code wrapper.. MLflow allows you to log custom Python functions or entire pipelines as part of the model using the 'pyfunc' flavor. By wrapping your pre-processing steps and model into a custom pyfunc class and logging it, you encapsulate both the transformation and the prediction logic. This is a critical best practice for production deployments, as it ensures consistent pre-processing between training and inference, eliminating training-serving skew and simplifying the deployment process for the serving endpoint.

Answer

Create a separate inference job that runs the pre-processing code before the model.

Answer

Store the pre-processing logic in a shared Delta table and call it at inference.

Answer

Log the pre-processing parameters as tags in the MLflow run and re-apply them.

Question 5

Which TWO factors should be considered when choosing between Batch Inference and Real-time Inference for a model in Databricks?

Accepted Answer

The required latency for the model predictions to reach the end user.. Choosing between batch and real-time inference depends on latency requirements and data availability. Batch is suited for high-volume, non-time-sensitive tasks, whereas real-time is necessary for low-latency, event-driven predictions. Understanding these trade-offs is essential for ML architects to design cost-effective and performant serving strategies that align with business needs, as they dictate the infrastructure configuration, monitoring complexity, and the overall deployment strategy for the model lifecycle.

Answer

The memory limit of the driver node during the model training phase.

Answer

The number of features used in the machine learning model.

Answer

The programming language used to write the ML model training code.

Question 6

Refer to the exhibit. A data scientist is attempting to log a model to an S3 bucket via MLflow, but they receive the error shown. What is the most likely root cause?

Accepted Answer

The compute cluster's instance profile lacks write access to the S3 bucket.. The 'Permission denied' error indicates that the identity running the Databricks notebook or job lacks the necessary IAM permissions to write to the specified S3 bucket. In Databricks, interacting with external storage requires proper instance profile or service principal configuration. This error underscores the importance of cloud identity and access management (IAM) in ML workflows, as secure, authorized access to storage is foundational for maintaining the integrity and security of model artifacts during the development lifecycle.

Answer

The S3 bucket is full and cannot accept new model artifacts.

Answer

The MLflow model flavor is not compatible with the S3 storage protocol.

Answer

The run_id 'xyz123' already exists and is locked by another user.

Question 7

A data scientist needs to track parameters, metrics, and model artifacts during training on Databricks. Which approach is the industry-standard best practice to ensure reproducibility and lineage?

Accepted Answer

Use the MLflow Tracking API to log parameters and artifacts during the training run.. MLflow Tracking is the core component for logging parameters, metrics, and artifacts in Databricks. By integrating MLflow into the training script, data scientists create a centralized record of every experiment run. This allows for easy comparison between different model versions, facilitates team collaboration, and ensures that the exact code, environment, and hyperparameter configuration used to produce a specific model artifact can be audited and reproduced later in the MLOps lifecycle.

Answer

Manually save model artifacts to DBFS and document parameters in a spreadsheet.

Answer

Write all model logs to a local temporary folder on the driver node.

Answer

Deploy the model directly to production without logging parameters to save compute costs.

Question 8

When configuring a Databricks Workflow to automate a machine learning pipeline, which TWO actions are necessary to ensure the pipeline is robust and manageable?

Accepted Answer

Use Databricks Workflow tasks to modularize data preparation, training, and evaluation.. Robust ML workflows require modularity and error handling. Defining distinct tasks for data preparation, model training, and evaluation allows for granular retries and easier debugging. Furthermore, enabling notifications ensures that failures are addressed promptly. By using job parameters and dependencies, you create a declarative pipeline that is consistent across environments, reducing the risk of manual configuration errors during deployment cycles and improving overall reliability of the production machine learning system.

Answer

Embed all data processing and training logic into a single, massive notebook cell.

Answer

Hardcode all file paths and cluster configuration settings directly in the code.

Answer

Run all pipeline stages on the same shared interactive cluster to save costs.

Question 9

Which Databricks component is specifically designed to manage the full lifecycle of machine learning models, including registration, versioning, and stage transitions?

Accepted Answer

MLflow Model Registry. The MLflow Model Registry provides a centralized model store, APIs, and UI to collaboratively manage the full lifecycle of MLflow models. It handles versioning, stage transitions (e.g., Staging to Production), and model annotations. This component is essential for operationalizing machine learning, as it provides a single source of truth for model artifacts and ensures that only validated models are promoted to production environments after passing necessary checks.

Answer

Delta Lake

Answer

Unity Catalog

Answer

Databricks Feature Store

Question 10

A team is transitioning from local model development to production in Databricks. Which THREE practices should be implemented to ensure a successful MLOps workflow?

Accepted Answer

Always register models in the MLflow Model Registry.. Moving to production requires rigorous automation and governance. Using a centralized model registry ensures version control and auditability. Automated CI/CD pipelines ensure that model training and deployment are consistent and repeatable, reducing the risk of manual errors. Finally, monitoring model performance in production is critical to detect drift and trigger retraining, ensuring the model remains accurate and relevant as the underlying data distribution changes over time in the real-world environment.

Answer

Keep all training and production code in a single notebook for simplicity.

Answer

Allow all team members to have 'Admin' access to production models.

Question 11

Which workflow step is essential before promoting a model from 'Staging' to 'Production' in the MLflow Model Registry?

Accepted Answer

Validating the model performance on a hold-out test set.. Validation against a held-out test set is a mandatory step before any model promotion. This ensures that the model meets performance requirements and hasn't regressed compared to the currently deployed version. This gated approach, combined with the Model Registry's staging transitions, provides a controlled environment for testing, ensuring that only verified, high-quality models enter the production ecosystem, thus mitigating business risk and maintaining model predictive accuracy in critical applications.

Answer

Deleting the original training dataset to save storage space.

Answer

Manually updating the production database credentials in the script.

Answer

Restarting the cluster to clear the memory of the training environment.

Question 12

What is the primary benefit of using a 'Job Cluster' instead of an 'All-Purpose Cluster' for automated ML workflows?

Accepted Answer

Job clusters provide lower costs and better environment isolation.. Job clusters are ephemeral compute resources that are created for a specific job and terminated immediately after completion. They are significantly more cost-effective because they use specialized pricing and ensure that resources are not idling between runs. Using job clusters also ensures complete environment isolation, preventing interference from other users or interactive processes, which is foundational for ensuring reproducible and reliable machine learning pipeline execution in production environments.

Answer

All-purpose clusters are always faster for training large models.

Answer

Job clusters allow for interactive debugging of code during runtime.

Answer

All-purpose clusters are required for scheduling workflows in Databricks.

Question 13

When designing a production-grade machine learning workflow, which THREE of the following are necessary to ensure the pipeline is observable and recoverable?

Accepted Answer

Use Delta Lake to version the training datasets.. Observability and recoverability are pillars of reliable MLOps. Comprehensive logging (via MLflow) provides the 'why' behind a model's state. Versioning datasets ensures you can recreate the input data if a model fails. Finally, robust checkpointing during training allows the job to resume from the last successful state rather than restarting from scratch, saving significant time and resources when failures occur in large, long-running training jobs.

Answer

Configure the job to automatically ignore all failures and continue.

Answer

Run all jobs manually to avoid the risk of automation errors.

Question 14

A data scientist wants to share an MLflow experiment with a teammate. What is the most direct way to ensure the teammate can access the metrics and parameters?

Accepted Answer

Update the 'Permissions' for the experiment in the Databricks UI.. MLflow Experiments are stored within the Databricks workspace and follow standard permission models. By adjusting the 'Permissions' settings on the experiment, the data scientist can grant 'Can View' or 'Can Manage' access to the teammate. This centralized access management ensures that team members can collaboratively review experiment results, compare performance metrics across different runs, and verify the reproducibility of models without needing to manually share raw files or screenshots.

Answer

Export the experiment data as a CSV and email it to the teammate.

Answer

Move the experiment notebook to the teammate's private folder.

Answer

Hardcode the teammate's user ID into the logging script.

Question 15

Which of the following is a core characteristic of 'Model Serving' in Databricks?

Accepted Answer

It automatically scales to handle incoming request volume.. Model Serving in Databricks allows you to deploy models from the Model Registry as low-latency REST endpoints. These endpoints automatically scale based on demand and handle the underlying infrastructure. This enables data scientists to easily expose their models as services for applications, ensuring high availability and consistent performance without needing to manage the complexities of server configuration, manual load balancing, or capacity provisioning.

Answer

It is used strictly for batch processing of large datasets.

Answer

It requires the user to manually manage Kubernetes clusters.

Answer

It stores training data for the model to use at runtime.