Databricks-ML-Assoc Practice Test 23 — 15 Questions

Question 1

When designing a feature engineering pipeline in Databricks, why should you use the Feature Store instead of standard Delta tables?

Accepted Answer

Feature Store provides automatic point-in-time joins to prevent data leakage.. Feature Store enables feature reuse and point-in-time correctness. Standard Delta tables do not automatically manage feature metadata or linkage between training data and inference features. By using the Feature Store, teams prevent training-serving skew, a common cause of model degradation. It also provides a centralized catalog for discovery, which improves collaboration and prevents duplicate engineering efforts across different machine learning projects within the organization.

Answer

Delta tables do not support versioning of data.

Answer

Delta tables require external storage, whereas Feature Store is local-only.

Answer

Feature Store is the only way to perform SQL queries in Databricks.

Question 2

Which of the following is an advantage of using Delta Lake for the data storage layer in an ML workflow?

Accepted Answer

It enables time travel to reproduce historical training data sets.. Delta Lake provides ACID transactions and time-travel capabilities, which are essential for ML workflows. Being able to access previous versions of data (time travel) allows data scientists to reproduce exact training results, ensuring consistency across experiments. This reliability is foundational for auditing and maintaining high-quality models, as it guarantees that the data used for training is well-versioned, consistent, and resilient to failures during concurrent read/write operations common in big data environments.

Answer

It automatically cleans up old model versions from the MLflow registry.

Answer

It eliminates the need for feature engineering by auto-generating features.

Answer

It ensures that the model training code runs on a single node.

Question 3

When logging a model, you decide to store a 'data_version' tag. What is the benefit of this practice?

Accepted Answer

It allows for easy filtering and tracking of model performance across different data versions.. Tagging models with data versions is a fundamental practice for data lineage. Since model performance is highly dependent on the underlying training data, tracking the exact version of the dataset used allows for better reproducibility and debugging. This enables engineers to trace a model back to the specific raw data state that produced it, which is essential for compliance and impact analysis when retraining models on updated datasets.

Answer

It automatically triggers a new training job whenever the underlying Delta table is updated.

Answer

It compresses the model artifact size by referencing the data instead of embedding it.

Answer

It creates an immutable copy of the dataset within the model registry.

Question 4

A machine learning engineer is using Databricks Feature Store to create a training dataset for a model that predicts customer lifetime value. The feature table includes a timestamp key. Which TWO statements are true regarding point-in-time correctness when creating the training set? (Choose two.)

Accepted Answer

The training set creation process uses the timestamp key to join features as of the label event time, preventing data leakage.. Point-in-time correctness in Feature Store requires a timestamp key and uses it to join features as of the label event time. This prevents data leakage by ensuring only past data is used. The other options incorrectly describe behavior that would either ignore timestamps or introduce future data, which are not how Feature Store operates.

Answer

The training set will include feature values that were recorded after the label event time if they are available.

Answer

If multiple feature values exist for an entity at the same timestamp, the training set will randomly select one.

Answer

The training set will automatically include the latest feature values for each entity, regardless of the timestamp.

Question 5

A machine learning engineer needs to track model parameters, metrics, and artifacts across distributed training runs executed on Databricks. Which component of Databricks Machine Learning should they use to manage and organize this experiment metadata?

Accepted Answer

MLflow Tracking. MLflow tracking provides an API and UI for logging parameters, code versions, metrics, and output files when running machine learning code. It is fully integrated with Databricks to seamlessly record metadata from distributed jobs, enabling reproducibility, model comparison, and centralized artifact storage across multiple cloud environments and teams.

Answer

Databricks Feature Store

Answer

Unity Catalog Volumes

Answer

Databricks Model Serving

Question 6

A data scientist needs to prepare a model for deployment in a highly regulated environment. Which TWO tasks must they complete to ensure the model meets auditability requirements?

Accepted Answer

Registering the model in the MLflow Model Registry.. Auditability in regulated industries requires proof of origin and transparency. Registering the model in the MLflow Model Registry provides a clear version history and change logs, while linking the model back to the specific run, training data, and notebook ensures full lineage. These steps are mandatory for compliance, ensuring that any model prediction can be traced back to its training source, which is critical for legal and business accountability.

Answer

Deleting all training logs after deployment.

Answer

Hard-coding model weights in the inference script.

Answer

Using a local Git repository for versioning.

Question 7

Which THREE of the following are benefits of using Databricks Workflows for ML model retraining?

Accepted Answer

Integration with MLflow to track parameters and metrics for each automated run.. Databricks Workflows provides a robust orchestration layer to automate the entire ML lifecycle. By automating retraining, teams ensure models remain relevant as data changes over time. Reliability features like retries and failure alerts reduce the operational burden on data scientists, allowing them to focus on model improvement while the infrastructure ensures that production pipelines are consistently refreshed without manual intervention.

Answer

Built-in automated hyperparameter tuning within the workflow orchestrator itself.

Answer

Automatic translation of Python code into SQL for faster execution.

Question 8

What is the benefit of using the MLflow 'signature' when logging a model?

Accepted Answer

It defines the input and output schema for the model.. A model signature defines the expected schema of the input data and the structure of the model's output. By logging this, Databricks validates that data sent to the model for inference matches the expected format. This prevents runtime errors in production where incorrectly shaped data could crash the model or lead to silent, invalid predictions, significantly increasing the reliability of deployment pipelines.

Answer

It encrypts the model weights to prevent unauthorized access.

Answer

It automatically scales the cluster size based on input volume.

Answer

It allows the model to be trained on multiple data sources simultaneously.

Question 9

A data scientist is building a feature pipeline and wants to avoid recomputing expensive aggregations on every run. They need the computed feature table to be queryable by other notebooks and jobs, refreshed on a schedule, and stored in Delta Lake. Which Databricks capability should they use to define and materialize these features?

Accepted Answer

Feature Store feature tables created with FeatureStoreClient.create_table.. Reusable, scheduled, queryable features in Delta format are the core purpose of the Databricks Feature Store. Feature tables are Delta tables with declared primary keys and timestamps, enabling point-in-time lookups and training-serving consistency. Other options either provide generic storage or pipeline tooling without the feature-management semantics the scenario calls for.

Answer

A Unity Catalog volume holding Parquet files of the computed features.

Answer

A Delta Live Tables pipeline with expectations defined on each feature.

Answer

An MLflow experiment with logged artifacts containing the feature vectors.

Question 10

A machine learning engineer is using MLflow to track experiments for a model that uses a custom Python function to preprocess data. They want to ensure that the model can be deployed consistently across environments. Which MLflow component should they use to package the preprocessing logic along with the model?

Accepted Answer

MLflow Models with a custom Python function. To bundle custom preprocessing with a model, MLflow Models should be used, specifically by defining a custom Python function that includes both preprocessing and prediction steps. This function is then logged as part of the model, ensuring that any deployment loads the complete pipeline. This approach guarantees consistency across environments and avoids separate preprocessing code.

Answer

MLflow Model Registry

Answer

MLflow Tracking

Answer

MLflow Projects

Question 11

Which of the following is a core characteristic of 'Model Serving' in Databricks?

Accepted Answer

It automatically scales to handle incoming request volume.. Model Serving in Databricks allows you to deploy models from the Model Registry as low-latency REST endpoints. These endpoints automatically scale based on demand and handle the underlying infrastructure. This enables data scientists to easily expose their models as services for applications, ensuring high availability and consistent performance without needing to manage the complexities of server configuration, manual load balancing, or capacity provisioning.

Answer

It is used strictly for batch processing of large datasets.

Answer

It requires the user to manually manage Kubernetes clusters.

Answer

It stores training data for the model to use at runtime.

Question 12

A data scientist is training a model on a large dataset using the Databricks 'pandas_udf' functionality. They notice that the function is failing when processing specific partitions. What is the most likely cause?

Accepted Answer

The data within the partitions contains types that are incompatible with Apache Arrow.. Pandas UDFs (User Defined Functions) operate on Apache Arrow-formatted data batches. When a specific partition is too large or contains unexpected data types that cannot be serialized or deserialized into Arrow, the UDF will fail. Understanding data distribution and ensuring type compatibility is essential when working with vectorized UDFs to ensure stability and performance during distributed model training and inference tasks.

Answer

The cluster does not have enough worker nodes.

Answer

The Python version on the driver is different from the worker nodes.

Answer

The model is too large to fit in the driver memory.

Question 13

When deploying a model to a production environment, why is it critical to create a dedicated 'staging' environment before the 'production' environment?

Accepted Answer

To perform end-to-end integration testing in a production-like environment.. A staging environment acts as a vital quality gate that mirrors the production configuration. By testing the model in a staging environment, developers can identify integration issues, resource bottlenecks, and environmental discrepancies without impacting actual end-users. This practice reduces risk, ensures the model behaves predictably under load, and allows for thorough regression testing, which is essential for maintaining high availability and reliability in mission-critical machine learning applications.

Answer

To increase the cost of the deployment infrastructure.

Answer

To hide the model from the model registry.

Answer

To store backup copies of the training dataset.

Question 14

A data scientist is training a scikit-learn model on Databricks and wants to automatically log parameters, metrics, and models without writing explicit MLflow logging code. Which approach should they use?

Accepted Answer

Enable MLflow autologging by calling mlflow.sklearn.autolog() before training.. MLflow autologging for scikit-learn is enabled by calling mlflow.sklearn.autolog() before training. This automatically logs parameters, metrics, and the model without explicit logging calls. It is the standard way to achieve automatic tracking in Databricks. Other options either require manual code, are for different purposes, or are not valid configurations.

Answer

Use the Databricks AutoML feature to train the model.

Answer

Manually log parameters and metrics using mlflow.log_param and mlflow.log_metric, and log the model with mlflow.sklearn.log_model.

Answer

Configure the cluster to use MLflow integration by setting the environment variable MLFLOW_AUTOLOGGING=true.

Question 15

A data scientist deploys a model to a Databricks Model Serving endpoint and enables inference tables. After a week, they want to analyze prediction drift by joining the logged requests with ground-truth labels that arrive later. Which statement describes how they should access the inference table data for this analysis?

Accepted Answer

Query the inference table using the Delta table name shown in the endpoint's Serving UI, then join it with a labels table on a request identifier.. Inference tables persist request and response payloads as Delta tables, with a fully qualified name visible in the endpoint UI. Analysts can query them directly and join with delayed ground-truth labels using the included request ID and timestamps. This supports drift and accuracy analysis without custom logging. Lakehouse Monitoring can build on these tables for automated metrics.

Answer

Read the endpoint's driver logs from the cluster's log delivery location, parse the JSON entries, and join them with the labels table.

Answer

Call the endpoint's `/metrics` REST API to export inference records, then load them into a Spark DataFrame for joining with labels.

Answer

Enable model monitoring on the endpoint and rely on its automatically generated drift metrics, which replace the need to join with ground-truth labels.