Databricks-ML-Assoc Exam Simulation 1 — 100 Questions

Question 1

Your team is experiencing 'data drift' in production where the model's accuracy drops over time. What is the most recommended Databricks-native approach to address this?

Accepted Answer

Implement a retraining pipeline that is triggered when performance metrics drop.. Addressing data drift involves monitoring incoming production data and comparing it against the training data distribution. By using Delta Lake's time-travel capabilities and MLflow's experiment tracking, teams can identify when and why model performance degrades. This proactive monitoring allows for timely retraining of the model with updated data, ensuring that production predictions remain accurate and aligned with the current real-world environment, which is vital for long-term model reliability.

Answer

Increase the size of the serving cluster to handle more data points.

Answer

Hard-code the input feature ranges in the inference function to filter out outliers.

Answer

Switch to a more complex model architecture to better fit the production data.

Question 2

A machine learning engineer is training a model on a Databricks cluster and wants the training code to run inside a container that they control, with the same Python libraries available on every node. They also want the environment recorded with the MLflow run for reproducibility. Which Databricks capability should they use?

Accepted Answer

A Databricks container services custom Docker image specified for the cluster.. An engineer-controlled, node-consistent runtime is exactly what container services provides: a custom Docker image is used by all nodes, so library and OS versions are fixed. MLflow then records the environment alongside the run, giving both control and traceability. Cluster libraries, init scripts, and Repos each address only part of the problem without delivering an immutable image.

Answer

A Databricks Repos checkout of the training code in the workspace.

Answer

An init script that pip installs a requirements file on each node at startup.

Answer

Cluster libraries installed from PyPI scoped to the notebook.

Question 3

When logging a model, what is the significance of the 'code_path' parameter in mlflow.log_model?

Accepted Answer

It includes additional local files/modules needed for the model to execute correctly.. The 'code_path' parameter allows users to include additional local source code files or directories required by the model, such as custom preprocessing classes. By bundling these dependencies, the model remains self-contained and portable. This is essential when the inference code relies on custom logic defined in external modules, ensuring that those modules are correctly packaged and available whenever the model is loaded in a new runtime environment.

Answer

It specifies the path to the Databricks notebook.

Answer

It tells the system to generate a Git commit for the current training run.

Answer

It enables automatic unit testing of the model code.

Question 4

A machine learning engineer has an existing Databricks Model Serving endpoint named churn-endpoint serving version 3 of a model. The team has validated version 5 and wants to direct live traffic to it while keeping the deployment reversible if quality degrades. What is the most appropriate action?

Accepted Answer

Update the served entity in the endpoint configuration to reference model version 5, allowing rollback by re-pointing to version 3. The endpoint serves whichever model version URI its configuration references, so updating the served entity to version 5 redirects live traffic through a managed rollout and keeps rollback simple by re-pointing to version 3. Deleting and recreating, batch overwrites, and registry stage changes do not achieve reversible live traffic redirection.

Answer

Delete the endpoint and create a new one with a different name that serves model version 5

Answer

Transition model version 5 to Production in the Model Registry and assume the endpoint automatically follows the stage change

Answer

Keep the endpoint on version 3 and write a scheduled job that calls version 5 and overwrites predictions in the serving table

Question 5

Refer to the exhibit. What is the most likely cause of this error in a deployed MLflow model?

Accepted Answer

The client application is sending data that does not conform to the defined input schema.. The error explicitly indicates a schema mismatch between the client's payload and the model's expected input signature. This frequently occurs when downstream applications send data without proper type casting. Validating the input data before sending it to the serving endpoint is a critical step in production MLOps to prevent type-related failures and ensure robust service interaction between disparate software components in a distributed architecture.

Answer

The serving endpoint has reached its maximum memory capacity.

Answer

The model has been corrupted during the transition to Production.

Answer

The serving endpoint is not authenticated to access the data.

Question 6

Refer to the exhibit. A machine learning engineer deployed an MLflow model to Databricks Model Serving, but inference requests are failing with the error shown in the exhibit. How should the engineer resolve this issue?

Accepted Answer

Update the inference client payload to explicitly cast the 'user_age' field to an integer or long type before sending the request.. Databricks Model Serving strict signature validation enforces data types defined during model logging. When incoming payloads contain mismatched types, such as double instead of long, requests fail. The engineer must re-log the model with a correct signature or cast incoming payload data types to match the expected schema.

Answer

Increase the timeout threshold parameter in the Databricks Model Serving endpoint configuration settings.

Answer

Restart the underlying model serving worker nodes to clear stale type caches in the serving runtime container.

Answer

Switch the serving endpoint scaling policy from automatic to manual provisioning to bypass schema validation checks.

Question 7

What is the primary advantage of using Databricks Model Serving over deploying a model on a standalone web server?

Accepted Answer

It provides managed, auto-scaling infrastructure with built-in model versioning.. Databricks Model Serving provides a managed, serverless infrastructure that scales automatically based on load and provides low-latency inference. It integrates directly with the MLflow Model Registry, ensuring that the model version deployed is exactly the one tested. This managed approach handles complex infrastructure concerns like auto-scaling, high availability, and authentication, reducing operational overhead compared to manual deployments on standalone servers, which require custom management of dependencies, security, and scaling.

Answer

It allows you to write the model logic in any programming language including C++.

Answer

It is cheaper than a dedicated server regardless of the model usage patterns.

Answer

It removes the need to perform any data preprocessing before inference.

Question 8

Refer to the exhibit. A Databricks job failed to start, returning the error shown. The job depends on MLflow for tracking. What is the most likely cause of this failure?

Accepted Answer

The cluster library configuration is missing the required MLflow package.. The ClassNotFoundException indicates that the MLflow library is missing from the runtime environment of the job cluster. In Databricks, if a job is configured to use a custom or minimal environment, essential libraries must be explicitly installed. This error highlights the importance of dependency management in production ML workflows, ensuring that all necessary packages are present in the cluster environment to prevent execution failures during automated deployment or batch scoring jobs.

Answer

The Databricks Runtime version is too recent and contains a breaking change.

Answer

The MLflow tracking server is currently unreachable due to network security policies.

Answer

The job cluster has insufficient memory to load the MLflow dependency.

Question 9

A data scientist is preparing a feature table in Databricks Feature Store. To ensure the feature table can be used for online inference with low latency, which step is mandatory?

Accepted Answer

Use the publish_table method to sync features to an online store configured in the Feature Store.. To enable online serving, the feature table must be published to a supported online store like Amazon DynamoDB, Azure Cosmos DB, or Google Cloud Bigtable. This process decouples the feature retrieval from the complex logic of feature engineering pipelines, allowing real-time models to fetch pre-computed features in milliseconds rather than recalculating them during the inference request, which is critical for high-throughput production ML applications.

Answer

Register the feature table in the Unity Catalog without any additional configuration.

Answer

Call the write_batch method to export features to an S3 bucket for the model to read at runtime.

Answer

Include the feature table in a Databricks Job that runs every minute to keep the data fresh.

Question 10

Refer to the exhibit. The logs indicate a persistent connection failure for a Databricks Model Serving endpoint. What is the most likely cause?

Accepted Answer

The endpoint is overloaded or incorrectly configured.. A 'Connection refused' error coupled with a request timeout typically indicates that the serving endpoint is either overloaded, configured incorrectly with insufficient resources, or facing network connectivity issues. Since the error persists despite retries, it points to a failure in the endpoint infrastructure or scaling capacity, which requires an investigation of the endpoint's resource allocation and the network configuration within the Databricks workspace to restore service reliability.

Answer

The model artifacts are missing.

Answer

The input data format is incorrect.

Answer

The model version is archived.

Question 11

A data scientist is using Databricks to train a deep learning model. They need to monitor training loss and accuracy in real-time. Which tool is best suited for this task?

Accepted Answer

MLflow log_metric API.. MLflow's logging API allows users to log metrics at each step of the training loop. By calling `mlflow.log_metric()` during the epochs of a deep learning model, the scientist can visualize the training progress in the MLflow UI. This real-time feedback loop is essential for detecting issues like vanishing gradients or overfitting early in the development lifecycle, preventing wasted compute hours on non-converging or poor-performing models.

Answer

Databricks File System (DBFS) logs.

Answer

Spark UI metrics tab.

Answer

Unity Catalog lineage.

Question 12

A data scientist needs to track parameters, metrics, and model artifacts during training on Databricks. Which component is the primary tool for managing the entire lifecycle of these ML experiments?

Accepted Answer

MLflow Tracking. MLflow Tracking is the dedicated component within Databricks for recording experiments. By logging parameters, metrics, and artifacts, data scientists can reproduce results and compare different model versions effectively. This is crucial for maintaining model lineage and ensuring reproducibility across distributed training jobs in production environments. MLflow is integrated natively into the Databricks platform, providing a seamless experience for tracking machine learning workflows from experimentation to final deployment.

Answer

Databricks Feature Store

Answer

Databricks Model Serving

Answer

Unity Catalog

Question 13

A data scientist is training a model using MLflow on Databricks. They need to ensure that the model artifacts and metrics are logged automatically without adding manual logging code to the training script. Which approach should they use?

Accepted Answer

Execute mlflow.autolog() at the start of the notebook cell before running the model training code.. MLflow provides autologging capabilities that automatically capture parameters, metrics, and models when using popular machine learning libraries like Scikit-learn, TensorFlow, or PyTorch. By calling mlflow.autolog() before the training code, the framework instruments the library calls to record telemetry automatically. This approach minimizes boilerplate code and ensures consistency across experiments, which is essential for auditability and model reproducibility in collaborative Databricks environments, as it prevents human error in manual logging.

Answer

Call mlflow.set_tracking_uri() inside the training function to redirect logs to the workspace.

Answer

Wrap the training logic within an mlflow.start_run() block without any additional configuration.

Answer

Configure the Databricks cluster environment variable MLFLOW_TRACKING_ENABLED to true.

Question 14

A data scientist is comparing multiple hyperparameter configurations for a model and wants to view the resulting metrics side by side in a single interface, sort runs by accuracy, and drill into individual run details. Which MLflow component provides this capability?

Accepted Answer

MLflow Tracking UI, which lists runs within an experiment and supports sorting and filtering by metrics.. The MLflow Tracking UI is designed for experiment comparison. It presents runs in a sortable table with metrics and parameters, supports filtering, and allows drilling into individual runs. The Model Registry UI, Projects, and Jobs run history serve different purposes and do not offer the same run comparison and metric sorting features.

Answer

MLflow Model Registry UI, which shows model versions and their stage transitions.

Answer

MLflow Projects dashboard, which lists available projects and their entry points.

Answer

Databricks Jobs run history, which shows task durations and statuses for scheduled workflows.

Question 15

Refer to the exhibit. A data scientist is attempting to deploy a model using the MLflow client. The error above occurs during the deployment script. What is the most likely cause of this failure?

Accepted Answer

The model has not been registered in the Model Registry with the specified name and version.. This error indicates that the specified model version does not exist in the Registry, either because it was never registered, was deleted, or the name/version number was referenced incorrectly. In a Databricks context, verify that the model has been successfully logged and registered using mlflow.register_model. This is critical for deployment pipelines as it validates that the artifact exists before the serving infrastructure attempts to load the model file.

Answer

The cluster does not have the necessary MLflow libraries installed.

Answer

The user lacks permissions to read the model version from the Registry.

Answer

The model version is still in the 'Archived' state and cannot be accessed.

Question 16

A machine learning engineer is using MLflow to track experiments. They want to compare multiple runs and identify the run that produced the best model based on a custom metric called 'weighted_f1'. They have logged this metric using mlflow.log_metric. Which MLflow UI feature allows them to sort and filter runs by this metric to quickly find the best run?

Accepted Answer

The runs table with column sorting and the filter box using metric.weighted_f1.. The MLflow UI runs table provides a sortable and filterable view of all runs in an experiment. By sorting on the 'weighted_f1' metric column or using a filter expression, the engineer can instantly locate the top-performing run. This is the standard way to compare runs and select the best model.

Answer

The experiment notes field where you can manually record the best run ID.

Answer

The model registry's stage transitions, which automatically promote the run with the highest metric.

Answer

The artifact viewer, which displays metric plots and allows sorting by value.

Question 17

A data scientist is training a deep learning model on Databricks using Horovod for distributed training. They find that the model is converging slowly. What is the most likely cause related to the distributed configuration?

Accepted Answer

The learning rate was not adjusted for the distributed batch size.. In Horovod distributed training, the learning rate must often be scaled relative to the number of workers, because each worker processes a batch of data. A common mistake is failing to adjust the learning rate or optimizer settings to compensate for the aggregate batch size across the cluster. This results in ineffective gradient updates, slowing down convergence significantly compared to a single-node setup.

Answer

The cluster has too much memory per worker.

Answer

The storage throughput of the DBFS mount is too high.

Answer

The number of epochs is too low for the current model size.

Question 18

A data scientist registered a model in Unity Catalog and now wants to serve it as a low-latency REST endpoint for an application. They need automatic scaling, a secure endpoint URL, and the ability to update the served model version without redeploying infrastructure. Which Databricks capability should they use?

Accepted Answer

Model Serving with a served entity pointing at the registered model version.. Model Serving provides managed, autoscaling REST endpoints backed by registered model versions. Configuring a served entity that references a Unity Catalog model and version gives a secure URL and lets the team change the served version without rebuilding the endpoint, satisfying low-latency, secure, and updatable serving needs in one capability.

Answer

A SQL warehouse with a user-defined function wrapping the model.

Answer

An all-purpose cluster running an MLflow model server manually.

Answer

A Databricks job that runs a notebook on a schedule to score requests.

Question 19

A data scientist is using Spark MLlib and wants to perform feature scaling on a large dataset. Which transformer should they use within a Pipeline to ensure that the scaling logic is correctly applied during both training and inference?

Accepted Answer

StandardScaler from pyspark.ml.feature.. Using a Pipeline with a scaler like StandardScaler or MinMaxScaler ensures that the scaling parameters (like mean and standard deviation) are captured as part of the model object. This is critical because the exact same scaling must be applied to new, unseen data during inference. Without this, the model will receive improperly scaled inputs, leading to incorrect predictions, as the model expects data to follow the same distribution used during training.

Answer

Manually calculate the mean and divide the DataFrame columns.

Answer

Pandas transformation functions via a UDF.

Answer

The VectorAssembler utility to normalize the input vector.

Question 20

A data scientist is using Databricks Feature Store to create a feature table for a machine learning model. They want to ensure that the features used during training are consistent with those used during inference. Which Databricks Feature Store capability should they use?

Accepted Answer

Feature Store's integration with MLflow to log the model with feature specifications.. The correct answer is Feature Store's integration with MLflow to log the model with feature specifications. When a model is trained and logged using Databricks Feature Store, the feature specifications are stored with the model. During inference, the model automatically retrieves features from the Feature Store using those specifications, ensuring that the same features and transformations are applied. This eliminates training-serving skew. Other capabilities like lineage, point-in-time lookups, and online stores are valuable but do not directly enforce consistency.

Answer

Feature Store's point-in-time lookups to avoid data leakage during training.

Answer

Feature Store's ability to materialize features to an online store for low-latency serving.

Answer

Feature Store's automatic lineage tracking to trace feature transformations.