Databricks-ML-Assoc ML Workflows Practice Test 4 — 15 Questions

Question 1

Why should you use a dedicated Feature Store for your ML workflows instead of just storing features as Delta tables?

Accepted Answer

It ensures consistency by linking features across training and inference.. While Delta tables provide high-performance storage, a dedicated Feature Store adds a metadata layer that tracks feature lineage, usage, and schema definitions. It ensures that the exact same feature logic is shared between training and inference pipelines. This consistency is critical for preventing training-serving skew, which is a major, often silent, cause of model performance degradation when moving from development to real-world production environments.

Answer

It makes Delta tables run significantly faster during training.

Answer

It automatically cleans missing data in the raw tables.

Answer

It is the only way to store data in the Databricks platform.

Question 2

A data scientist is preparing a feature table in Databricks Feature Store. To ensure the feature table can be used for online inference with low latency, which step is mandatory?

Accepted Answer

Use the publish_table method to sync features to an online store configured in the Feature Store.. To enable online serving, the feature table must be published to a supported online store like Amazon DynamoDB, Azure Cosmos DB, or Google Cloud Bigtable. This process decouples the feature retrieval from the complex logic of feature engineering pipelines, allowing real-time models to fetch pre-computed features in milliseconds rather than recalculating them during the inference request, which is critical for high-throughput production ML applications.

Answer

Register the feature table in the Unity Catalog without any additional configuration.

Answer

Call the write_batch method to export features to an S3 bucket for the model to read at runtime.

Answer

Include the feature table in a Databricks Job that runs every minute to keep the data fresh.

Question 3

You are tracking a deep learning model experiment using MLflow. You want to ensure that the model architecture and all hyperparameters are easily reproducible. Which approach is best practice?

Accepted Answer

Log parameters, metrics, and include the conda environment configuration with the model.. Logging model parameters and the environment configuration (like conda.yaml or requirements.txt) via MLflow ensures reproducibility. By capturing the exact package versions and architectural settings during the run, you eliminate the 'it works on my machine' problem. This practice is essential in production workflows where model drift or performance degradation requires auditing the exact conditions under which a specific model version was trained.

Answer

Only log the final model artifacts to the MLflow Model Registry to save disk space.

Answer

Manually copy the training code into a text field in the MLflow UI for every run.

Answer

Use a global variable in your notebook to store all hyperparameters for easy access.

Question 4

Refer to the exhibit. Why is the 'signature' parameter included in the log_model call?

Accepted Answer

To enforce input data schema validation during model inference.. The model signature defines the expected schema for inputs and outputs. Providing a signature allows Databricks to perform runtime validation of data types, ensuring that the model receives data in the format it expects. This prevents runtime errors during inference and allows for automated documentation and improved user experience within the MLflow Model Registry, which is crucial for scalable model deployment in production.

Answer

To encrypt the model artifacts before saving them to DBFS.

Answer

To specify the hyperparameters used to train the model.

Answer

To compress the model into a smaller binary file for faster deployment.

Question 5

When designing a feature engineering pipeline in Databricks, why should you use the Feature Store instead of standard Delta tables?

Accepted Answer

Feature Store provides automatic point-in-time joins to prevent data leakage.. Feature Store enables feature reuse and point-in-time correctness. Standard Delta tables do not automatically manage feature metadata or linkage between training data and inference features. By using the Feature Store, teams prevent training-serving skew, a common cause of model degradation. It also provides a centralized catalog for discovery, which improves collaboration and prevents duplicate engineering efforts across different machine learning projects within the organization.

Answer

Delta tables do not support versioning of data.

Answer

Delta tables require external storage, whereas Feature Store is local-only.

Answer

Feature Store is the only way to perform SQL queries in Databricks.

Question 6

Which THREE of the following are benefits of using Databricks Workflows for ML model retraining?

Accepted Answer

Integration with MLflow to track parameters and metrics for each automated run.. Databricks Workflows provides a robust orchestration layer to automate the entire ML lifecycle. By automating retraining, teams ensure models remain relevant as data changes over time. Reliability features like retries and failure alerts reduce the operational burden on data scientists, allowing them to focus on model improvement while the infrastructure ensures that production pipelines are consistently refreshed without manual intervention.

Answer

Built-in automated hyperparameter tuning within the workflow orchestrator itself.

Answer

Automatic translation of Python code into SQL for faster execution.

Question 7

When using the Databricks Feature Store for real-time inference, why is it recommended to use a specific online store (e.g., Cosmos DB) instead of querying the offline store?

Accepted Answer

Online stores are designed for low-latency random access lookups.. Offline stores (Delta Lake) are optimized for high-throughput, sequential read/write operations common in batch training, but they suffer from high latency during random access lookups. Online stores are optimized for low-latency point lookups (Key-Value access). Separating these storage tiers allows ML models to achieve the sub-millisecond response times required for real-time applications while still leveraging the massive analytical capabilities of the offline store for training.

Answer

The offline store is not compatible with the Python programming language.

Answer

The offline store cannot handle concurrent requests from multiple inference endpoints.

Answer

The offline store requires a GPU cluster to perform any queries.

Question 8

Which technique should be used to prevent data leakage in ML workflows when performing cross-validation on time-series data?

Accepted Answer

Expanding window cross-validation (time-series split).. In time-series forecasting, standard k-fold cross-validation is inappropriate because it would allow the model to 'see' the future during training, leading to overly optimistic performance estimates. Instead, 'time-series split' or 'walk-forward' validation should be used, where the training set only consists of data points that occur chronologically before the validation set. This preserves the temporal order, providing a realistic assessment of the model's performance on unseen future data.

Answer

Random sampling with replacement across the entire dataset.

Answer

Standard k-fold cross-validation with 5 folds.

Answer

Removing all features that have high correlation with the target variable.

Question 9

What is the primary advantage of using Databricks Model Serving over deploying a model on a standalone web server?

Accepted Answer

It provides managed, auto-scaling infrastructure with built-in model versioning.. Databricks Model Serving provides a managed, serverless infrastructure that scales automatically based on load and provides low-latency inference. It integrates directly with the MLflow Model Registry, ensuring that the model version deployed is exactly the one tested. This managed approach handles complex infrastructure concerns like auto-scaling, high availability, and authentication, reducing operational overhead compared to manual deployments on standalone servers, which require custom management of dependencies, security, and scaling.

Answer

It allows you to write the model logic in any programming language including C++.

Answer

It is cheaper than a dedicated server regardless of the model usage patterns.

Answer

It removes the need to perform any data preprocessing before inference.

Question 10

A data scientist is training a machine learning model on Databricks and needs to log parameters, metrics, and model artifacts. Which tracking component should be used to ensure the reproducibility of the experiment runs?

Accepted Answer

MLflow Tracking. MLflow Tracking is the core component for logging parameters, code versions, metrics, and output files when running machine learning code. By recording these artifacts, teams can compare multiple runs, track model lineage, and ensure that experiments are reproducible across different environments. Integrating MLflow into the workflow is essential for transitioning from local notebook experimentation to production-ready MLOps pipelines within the Databricks ecosystem.

Answer

Databricks Feature Store

Answer

MLflow Model Registry

Answer

Delta Lake Versioning

Question 11

You are building a pipeline where a feature table must be updated daily. Which Databricks construct is the most appropriate for orchestrating this periodic feature engineering job?

Accepted Answer

Databricks Jobs. Databricks Workflows (Jobs) are the recommended tool for orchestrating multi-step data processing tasks, including feature engineering pipelines. By scheduling a Job, you can automate the ingestion, transformation, and write operations to the Feature Store. This ensures that features are refreshed consistently, minimizing data drift and enabling reliable model training or batch inference processes that depend on the most recent feature values.

Answer

MLflow Experiments

Answer

Unity Catalog

Answer

MLflow Model Registry

Question 12

Which TWO of the following are benefits of using the Databricks Feature Store for machine learning workflows?

Accepted Answer

It enables consistent feature definitions across training and inference pipelines.. The Databricks Feature Store facilitates feature reuse across different teams and projects, preventing redundant engineering work. Additionally, it ensures point-in-time correctness by preventing data leakage during training through time-travel capabilities. These features are critical for maintaining consistency between training and inference environments, reducing the likelihood of training-serving skew, and streamlining the overall MLOps lifecycle within the Databricks platform.

Answer

It automatically scales the compute resources for training deep learning models.

Answer

It automatically retrains models when feature data changes.

Answer

It converts unstructured image data into structured feature vectors.

Question 13

Refer to the exhibit. A machine learning engineer wants to promote this model to Production. Which MLflow action should be performed to achieve this while ensuring the model is ready for deployment?

Accepted Answer

Call the transition_model_version_stage API to move the model to Production.. The MLflow Model Registry provides the `transition_model_version_stage` function to promote models between stages like Staging and Production. Promoting a model involves updating its state in the registry, which then allows downstream deployment pipelines to identify the correct model version. This structured approach ensures that only verified models are promoted to production environments, maintaining governance and stability in the model deployment process.

Answer

Use the mlflow.register_model() function with the production flag.

Answer

Delete the model from Staging and re-upload it to the Production path.

Answer

Update the tag 'status' to 'Production' in the model metadata.

Question 14

Which THREE actions are essential when preparing a machine learning model for deployment using the Databricks Model Registry?

Accepted Answer

Transitioning the model version to the appropriate stage.. Preparing a model involves validating its performance, documenting its lineage, and assigning it to the appropriate registry stage. By logging the model with its signature, you ensure that the input/output schema is preserved. Transitioning through stages (Staging, Production) allows for controlled releases, while adding metadata via tags and descriptions provides necessary context for other stakeholders to understand the model's purpose, limitations, and performance characteristics in a production environment.

Answer

Manually downloading the model pickle file to a local machine.

Answer

Hard-coding the model URI in the application inference code.

Question 15

Which Databricks feature allows you to monitor and manage the lineage of data from the source to the final model prediction?

Accepted Answer

Unity Catalog. Unity Catalog provides comprehensive data lineage capabilities that track how data flows through tables, jobs, and models. By visualizing this lineage, data scientists and engineers can understand the dependencies between raw data, feature tables, and trained models. This is crucial for debugging, impact analysis, and meeting compliance requirements, as it allows users to trace a model's input data back to its origins within the Databricks ecosystem.

Answer

MLflow Tracking

Answer

Databricks Delta Live Tables

Answer

Databricks Model Serving