Databricks-ML-Assoc Databricks Machine Learning Practice Test 3 — 15 Questions

Question 1

A data scientist is monitoring model drift in Databricks. Which TWO approaches are recommended to detect performance degradation in a production model?

Accepted Answer

Regularly compare current prediction metrics against the baseline training metrics.. Monitoring model drift is essential to ensure the continued accuracy of production models. Comparing current model performance metrics against a baseline established during training allows for proactive retraining. Similarly, tracking the distribution of input features (data drift) helps identify changes in data patterns that may undermine the model's reliability. Combining these methods ensures a comprehensive view of the model's health and readiness for redeployment or adjustment.

Answer

Delete the original training data to force the model to learn new patterns.

Answer

Automate model retraining to run every hour, regardless of drift.

Answer

Manually inspect every prediction in the production logs for errors.

Question 2

Which Databricks ML component is best suited for managing access control for machine learning experiments and models across different teams?

Accepted Answer

Unity Catalog.. Unity Catalog is the centralized governance layer in Databricks. It allows administrators to define fine-grained access controls for experiments and models, ensuring that sensitive IP is protected and that users only have access to what they need. Implementing Unity Catalog is a best practice for security and compliance, ensuring that model assets are governed as strictly as the underlying data they rely on.

Answer

Notebook tags.

Answer

Environment variables in the cluster config.

Answer

The 'git commit' history.

Question 3

When a data scientist needs to share an MLflow experiment with a team member, what is the best practice for ensuring collaborative access within Databricks?

Accepted Answer

Granting appropriate permissions on the experiment within the MLflow UI.. Sharing experiments is done by managing permissions on the experiment object itself. In Databricks, you can grant specific permissions (e.g., CAN_VIEW, CAN_MANAGE) to individual users or groups. This allows for controlled collaboration where team members can see experiment results without necessarily having the ability to modify or delete them, adhering to the principle of least privilege while fostering efficient teamwork during the development process.

Answer

Exporting the experiment to a CSV file and emailing it.

Answer

Moving the experiment to a public folder in DBFS.

Answer

Giving everyone admin access to the workspace.

Question 4

Which approach is most efficient for handling high-cardinality categorical features in a machine learning model while maintaining compatibility with standard Databricks model serving?

Accepted Answer

Using the Feature Store to store pre-computed embeddings.. Using Feature Store to pre-compute and transform high-cardinality features allows you to store them as embeddings or encoded vectors. This shift moves the expensive computation from the inference phase to an offline batch process, significantly reducing latency. This approach is compatible with standard model serving, as the model only receives the pre-calculated features, ensuring consistent and performant real-time inference within the Databricks ecosystem.

Answer

One-hot encoding the features inside the model inference function.

Answer

Converting features to strings and letting the model handle them natively.

Answer

Running a Spark job on every prediction request to re-encode the features.

Question 5

A machine learning engineer needs to track hyperparameter tuning runs and log artifacts using MLflow inside a Databricks Notebook. Which approach should be used to ensure runs are automatically nested under a parent run?

Accepted Answer

Utilize mlflow.start_run(nested=True) inside the hyperparameter optimization loop while a parent run is active.. Using `mlflow.start_run()` with a `nested=True` parameter ensures that child runs are correctly organized beneath an active parent run within the MLflow tracking server. This hierarchical structuring is essential for organizing complex hyperparameter optimization sweeps, enabling data scientists to easily compare child performance metrics against the overarching parent experiment trial in the Databricks UI.

Answer

Call mlflow.start_run() inside a loop without any arguments while an active run exists.

Answer

Set the MLFLOW_PARENT_RUN_ID environment variable manually before invoking mlflow.start_run().

Answer

Configure the MLflow client to use a hierarchical tracking URI scheme before logging parameters.

Question 6

A data science team is preparing to deploy a custom machine learning model to Databricks Model Serving. Which TWO steps are required to ensure the model can successfully load and serve predictions using MLflow? Choose 2 answers.

Accepted Answer

Log the model using mlflow.sklearn.log_model() or equivalent flavor with a defined input example and model signature.. Deploying models to Databricks Model Serving requires logging the model with a valid signature and environment specification, and registering it to the Unity Catalog or Workspace Model Registry. These steps ensure the serving infrastructure can automatically provision the correct scoring environment, handle incoming JSON payloads, and validate data types against expected schemas.

Answer

Manually install all Python dependencies on every serving endpoint worker node via a custom startup script.

Answer

Export the model artifact into a raw Hadoop Distributed File System directory without using the MLflow format.

Answer

Configure Apache Spark streaming jobs to continuously push payload batches into the model serving container endpoint.

Question 7

Refer to the exhibit. A machine learning engineer deployed an MLflow model to Databricks Model Serving, but inference requests are failing with the error shown in the exhibit. How should the engineer resolve this issue?

Accepted Answer

Update the inference client payload to explicitly cast the 'user_age' field to an integer or long type before sending the request.. Databricks Model Serving strict signature validation enforces data types defined during model logging. When incoming payloads contain mismatched types, such as double instead of long, requests fail. The engineer must re-log the model with a correct signature or cast incoming payload data types to match the expected schema.

Answer

Increase the timeout threshold parameter in the Databricks Model Serving endpoint configuration settings.

Answer

Restart the underlying model serving worker nodes to clear stale type caches in the serving runtime container.

Answer

Switch the serving endpoint scaling policy from automatic to manual provisioning to bypass schema validation checks.

Question 8

A data scientist needs to track parameters, metrics, and model artifacts during training on Databricks. Which component is the primary tool for managing the entire lifecycle of these ML experiments?

Accepted Answer

MLflow Tracking. MLflow Tracking is the dedicated component within Databricks for recording experiments. By logging parameters, metrics, and artifacts, data scientists can reproduce results and compare different model versions effectively. This is crucial for maintaining model lineage and ensuring reproducibility across distributed training jobs in production environments. MLflow is integrated natively into the Databricks platform, providing a seamless experience for tracking machine learning workflows from experimentation to final deployment.

Answer

Databricks Feature Store

Answer

Databricks Model Serving

Answer

Unity Catalog

Question 9

Which TWO of the following are primary benefits of using the Databricks Feature Store for machine learning workflows?

Accepted Answer

Eliminating training-serving skew by using the same feature definitions for both training and inference.. The Databricks Feature Store facilitates feature reuse across teams and prevents training-serving skew. By centralizing features, organizations ensure that the exact data used during model training is consistently applied during real-time inference. This eliminates the need for redundant feature engineering pipelines and provides a unified lineage, which is essential for auditability and ensuring that models perform reliably across different production environments.

Answer

Providing a platform for distributed model training using Spark MLlib exclusively.

Answer

Automating the deployment of machine learning models to production environments.

Answer

Directly replacing the need for SQL-based data warehousing in Databricks.

Question 10

Refer to the exhibit. A user attempts to transition a model to production, but the code fails with the provided error. What is the most likely cause?

Accepted Answer

The model has not been registered in the Model Registry.. The error indicates that the Model Registry cannot locate the model name provided. In Databricks, models must be registered before they can be transitioned to specific stages like 'Production'. The user likely misspelled the model name or is attempting to reference a model that has not yet been registered within the current workspace environment. Verifying the Model Registry UI will confirm the correct naming conventions and existing model registrations.

Answer

The cluster does not have sufficient permissions to read the model.

Answer

The model version is archived and cannot be transitioned.

Answer

The model artifact is missing from the underlying DBFS storage.

Question 11

Which Databricks feature provides a managed environment specifically optimized for machine learning libraries like TensorFlow, PyTorch, and XGBoost?

Accepted Answer

Databricks Runtime for Machine Learning. Databricks Runtime for Machine Learning (ML Runtime) is pre-configured with popular machine learning libraries and optimized versions of deep learning frameworks. It includes pre-installed dependencies and optimized binaries for distributed training, which saves time for data scientists who would otherwise need to manually configure clusters. This runtime simplifies the setup process and ensures compatibility between the infrastructure and the most common data science toolkits used in production machine learning projects.

Answer

Databricks SQL

Answer

Delta Live Tables

Answer

Unity Catalog

Question 12

Which approach is most efficient for deploying a high-throughput, low-latency model in Databricks?

Accepted Answer

Using Databricks Model Serving. Databricks Model Serving is the recommended service for production environments requiring low latency and high scalability. It automatically manages scaling and infrastructure, ensuring that models are served in a highly available manner. By abstracting away the server management and load balancing, it allows developers to focus on model performance rather than infrastructure maintenance, which is essential for maintaining service level agreements in production-grade ML applications.

Answer

Running a custom Flask app on a standard notebook

Answer

Batch processing using Spark streaming

Answer

Manual deployment to an external cloud VM

Question 13

What is the primary function of the 'Model Registry' in the Databricks ML ecosystem?

Accepted Answer

To provide a centralized platform for model lifecycle management. The Model Registry provides a centralized hub for managing the full lifecycle of a machine learning model. It allows teams to track versions, manage model stages (Staging, Production, Archived), and facilitate collaboration. By serving as a 'source of truth' for model status, it ensures that stakeholders can confidently transition models from development to production while maintaining complete audit trails and lineage of all changes applied to the model artifacts.

Answer

To store raw training datasets for feature engineering

Answer

To execute distributed hyperparameter tuning experiments

Answer

To monitor real-time inference drift in production

Question 14

A data scientist wants to speed up the process of finding the optimal hyperparameters for a machine learning model. Which Databricks-supported library is optimized for distributed hyperparameter tuning?

Accepted Answer

Hyperopt. Hyperopt is a widely used Python library for distributed hyperparameter optimization. In Databricks, it integrates seamlessly with Spark, allowing the distribution of trial runs across a cluster of nodes. This dramatically reduces the time required to search through large hyperparameter spaces, enabling data scientists to train more complex models and achieve better performance in a fraction of the time compared to serial tuning.

Answer

Pandas

Answer

Matplotlib

Answer

MLflow Tracking

Question 15

Refer to the exhibit. A user attempts to load a model using the MLflow Python API, but the load fails. Based on the JSON snippet, what is the most likely issue?

Accepted Answer

The model is not in a ready state for inference.. The model status is listed as 'PENDING_REGISTRATION'. Models in this state are not ready for use because they are still being processed or finalized by the backend. MLflow will prevent loading models that haven't successfully completed registration. The user must wait for the registration process to complete, changing the status to a ready state, before the model artifact can be successfully loaded and used for inference.

Answer

The model name is misspelled in the load request.

Answer

The user lacks permissions to read the model.

Answer

The version number provided is outdated.