Databricks-ML-Assoc Quick Quiz — 10 Questions

Question 1

Your team is experiencing 'data drift' in production where the model's accuracy drops over time. What is the most recommended Databricks-native approach to address this?

Accepted Answer

Implement a retraining pipeline that is triggered when performance metrics drop.. Addressing data drift involves monitoring incoming production data and comparing it against the training data distribution. By using Delta Lake's time-travel capabilities and MLflow's experiment tracking, teams can identify when and why model performance degrades. This proactive monitoring allows for timely retraining of the model with updated data, ensuring that production predictions remain accurate and aligned with the current real-world environment, which is vital for long-term model reliability.

Answer

Increase the size of the serving cluster to handle more data points.

Answer

Hard-code the input feature ranges in the inference function to filter out outliers.

Answer

Switch to a more complex model architecture to better fit the production data.

Question 2

A machine learning engineer is training a model on a Databricks cluster and wants the training code to run inside a container that they control, with the same Python libraries available on every node. They also want the environment recorded with the MLflow run for reproducibility. Which Databricks capability should they use?

Accepted Answer

A Databricks container services custom Docker image specified for the cluster.. An engineer-controlled, node-consistent runtime is exactly what container services provides: a custom Docker image is used by all nodes, so library and OS versions are fixed. MLflow then records the environment alongside the run, giving both control and traceability. Cluster libraries, init scripts, and Repos each address only part of the problem without delivering an immutable image.

Answer

A Databricks Repos checkout of the training code in the workspace.

Answer

An init script that pip installs a requirements file on each node at startup.

Answer

Cluster libraries installed from PyPI scoped to the notebook.

Question 3

When logging a model, what is the significance of the 'code_path' parameter in mlflow.log_model?

Accepted Answer

It includes additional local files/modules needed for the model to execute correctly.. The 'code_path' parameter allows users to include additional local source code files or directories required by the model, such as custom preprocessing classes. By bundling these dependencies, the model remains self-contained and portable. This is essential when the inference code relies on custom logic defined in external modules, ensuring that those modules are correctly packaged and available whenever the model is loaded in a new runtime environment.

Answer

It specifies the path to the Databricks notebook.

Answer

It tells the system to generate a Git commit for the current training run.

Answer

It enables automatic unit testing of the model code.

Question 4

A machine learning engineer has an existing Databricks Model Serving endpoint named churn-endpoint serving version 3 of a model. The team has validated version 5 and wants to direct live traffic to it while keeping the deployment reversible if quality degrades. What is the most appropriate action?

Accepted Answer

Update the served entity in the endpoint configuration to reference model version 5, allowing rollback by re-pointing to version 3. The endpoint serves whichever model version URI its configuration references, so updating the served entity to version 5 redirects live traffic through a managed rollout and keeps rollback simple by re-pointing to version 3. Deleting and recreating, batch overwrites, and registry stage changes do not achieve reversible live traffic redirection.

Answer

Delete the endpoint and create a new one with a different name that serves model version 5

Answer

Transition model version 5 to Production in the Model Registry and assume the endpoint automatically follows the stage change

Answer

Keep the endpoint on version 3 and write a scheduled job that calls version 5 and overwrites predictions in the serving table

Question 5

Refer to the exhibit. What is the most likely cause of this error in a deployed MLflow model?

Accepted Answer

The client application is sending data that does not conform to the defined input schema.. The error explicitly indicates a schema mismatch between the client's payload and the model's expected input signature. This frequently occurs when downstream applications send data without proper type casting. Validating the input data before sending it to the serving endpoint is a critical step in production MLOps to prevent type-related failures and ensure robust service interaction between disparate software components in a distributed architecture.

Answer

The serving endpoint has reached its maximum memory capacity.

Answer

The model has been corrupted during the transition to Production.

Answer

The serving endpoint is not authenticated to access the data.

Question 6

Refer to the exhibit. A machine learning engineer deployed an MLflow model to Databricks Model Serving, but inference requests are failing with the error shown in the exhibit. How should the engineer resolve this issue?

Accepted Answer

Update the inference client payload to explicitly cast the 'user_age' field to an integer or long type before sending the request.. Databricks Model Serving strict signature validation enforces data types defined during model logging. When incoming payloads contain mismatched types, such as double instead of long, requests fail. The engineer must re-log the model with a correct signature or cast incoming payload data types to match the expected schema.

Answer

Increase the timeout threshold parameter in the Databricks Model Serving endpoint configuration settings.

Answer

Restart the underlying model serving worker nodes to clear stale type caches in the serving runtime container.

Answer

Switch the serving endpoint scaling policy from automatic to manual provisioning to bypass schema validation checks.

Question 7

What is the primary advantage of using Databricks Model Serving over deploying a model on a standalone web server?

Accepted Answer

It provides managed, auto-scaling infrastructure with built-in model versioning.. Databricks Model Serving provides a managed, serverless infrastructure that scales automatically based on load and provides low-latency inference. It integrates directly with the MLflow Model Registry, ensuring that the model version deployed is exactly the one tested. This managed approach handles complex infrastructure concerns like auto-scaling, high availability, and authentication, reducing operational overhead compared to manual deployments on standalone servers, which require custom management of dependencies, security, and scaling.

Answer

It allows you to write the model logic in any programming language including C++.

Answer

It is cheaper than a dedicated server regardless of the model usage patterns.

Answer

It removes the need to perform any data preprocessing before inference.

Question 8

Refer to the exhibit. A Databricks job failed to start, returning the error shown. The job depends on MLflow for tracking. What is the most likely cause of this failure?

Accepted Answer

The cluster library configuration is missing the required MLflow package.. The ClassNotFoundException indicates that the MLflow library is missing from the runtime environment of the job cluster. In Databricks, if a job is configured to use a custom or minimal environment, essential libraries must be explicitly installed. This error highlights the importance of dependency management in production ML workflows, ensuring that all necessary packages are present in the cluster environment to prevent execution failures during automated deployment or batch scoring jobs.

Answer

The Databricks Runtime version is too recent and contains a breaking change.

Answer

The MLflow tracking server is currently unreachable due to network security policies.

Answer

The job cluster has insufficient memory to load the MLflow dependency.

Question 9

A data scientist is preparing a feature table in Databricks Feature Store. To ensure the feature table can be used for online inference with low latency, which step is mandatory?

Accepted Answer

Use the publish_table method to sync features to an online store configured in the Feature Store.. To enable online serving, the feature table must be published to a supported online store like Amazon DynamoDB, Azure Cosmos DB, or Google Cloud Bigtable. This process decouples the feature retrieval from the complex logic of feature engineering pipelines, allowing real-time models to fetch pre-computed features in milliseconds rather than recalculating them during the inference request, which is critical for high-throughput production ML applications.

Answer

Register the feature table in the Unity Catalog without any additional configuration.

Answer

Call the write_batch method to export features to an S3 bucket for the model to read at runtime.

Answer

Include the feature table in a Databricks Job that runs every minute to keep the data fresh.

Question 10

Refer to the exhibit. The logs indicate a persistent connection failure for a Databricks Model Serving endpoint. What is the most likely cause?

Accepted Answer

The endpoint is overloaded or incorrectly configured.. A 'Connection refused' error coupled with a request timeout typically indicates that the serving endpoint is either overloaded, configured incorrectly with insufficient resources, or facing network connectivity issues. Since the error persists despite retries, it points to a failure in the endpoint infrastructure or scaling capacity, which requires an investigation of the endpoint's resource allocation and the network configuration within the Databricks workspace to restore service reliability.

Answer

The model artifacts are missing.

Answer

The input data format is incorrect.

Answer

The model version is archived.