Databricks-ML-Assoc Databricks Machine Learning — Timed 10 Questions

Question 1

Refer to the exhibit. An administrator is configuring a Unity Catalog access policy to restrict experiment deletion. Given the JSON snippet provided, what is the impact of this policy configuration?

Accepted Answer

It allows users to delete experiments.. The policy logic defines an 'allow' effect for the 'DeleteExperiment' action. In many security configurations, especially when using explicit deny-all defaults, this allows the designated action. It is critical to understand how Databricks permissions and Unity Catalog policies intersect with MLflow. Misconfiguring these policies can lead to unauthorized data destruction, which is why strict adherence to principle-of-least-privilege is required when defining experiment lifecycle management permissions.

Answer

It denies users the ability to delete experiments.

Answer

It restricts the policy only to the 'mlflow' namespace.

Answer

The policy is invalid and will be rejected by Databricks.

Question 2

When logging a model with MLflow, which THREE of the following are essential components of a model signature?

Accepted Answer

Input schema definition. Model signatures define the expected schema for inputs and outputs, which is vital for validation and deployment. By defining the input schema, output schema, and parameter types, MLflow can perform automatic type checking during inference requests. This prevents runtime errors in production when an API receives unexpected data types, ensuring the model behaves reliably when integrated into larger application architectures or served via a REST API endpoint.

Answer

Model training loss metrics

Answer

Model hyperparameters

Question 3

An ML engineer wants to compute features with point-in-time correctness to prevent data leakage when training a fraud detection model. Which Databricks Feature Store capability should be utilized?

Accepted Answer

Feature lookup function in training set creation using timestamp keys. Point-in-time joins are critical for preventing data leakage by ensuring that training datasets only include feature values that were known at the exact timestamp of each observation. The Databricks Feature Store automatically handles these temporal joins when creating training sets from feature tables containing timestamps.

Answer

Automated online feature sync via Databricks Jobs

Answer

Feature table time-travel queries using Delta Lake versions

Answer

Feature Store point-in-time training set creation API

Question 4

A team is designing a feature engineering pipeline in Databricks. Which TWO considerations are essential when using Feature Store to ensure data consistency between training and inference?

Accepted Answer

Defining a unique primary key for every feature table.. Feature Store ensures that the exact same transformation logic is applied during model training and real-time inference. By using a centralized feature table, the team avoids the 'training-serving skew' that occurs when features are calculated differently in offline and online environments. This consistency is vital for maintaining model performance and reliability, as it prevents the model from receiving features that diverge from the distribution it observed during training.

Answer

Re-calculating features manually in the inference code.

Answer

Always storing features as raw parquet files.

Answer

Ignoring the time-series nature of data.

Question 5

A machine learning engineer needs to tune a deep learning model using Hyperopt on Databricks. Which THREE steps are required to implement distributed hyperparameter tuning effectively?

Accepted Answer

Define a search space using Hyperopt's hp functions.. Distributed tuning with Hyperopt requires configuring the search space, the objective function, and the Trials object to handle parallelism across the cluster. By offloading individual trials to different workers, the process significantly reduces training time. Proper configuration ensures that the driver node orchestrates the search efficiently while workers execute the heavy computation, which is vital for complex models that would otherwise take too long to train on a single node.

Answer

Hard-code all hyperparameters within the training loop.

Answer

Restrict training to a single CPU core only.

Question 6

A team is building a real-time churn prediction system. Which THREE requirements are critical for the Online Store in this Databricks Feature Store architecture?

Accepted Answer

Sub-millisecond latency for feature lookups.. The Online Store must support low-latency lookups, high availability, and efficient point-in-time joins to be effective for real-time inference. These features ensure that when a customer triggers an event, the system can immediately fetch their current profile and history to generate an accurate, real-time prediction. Failure to meet these criteria results in unacceptable latency and inaccurate model scores, defeating the goal of a real-time service.

Answer

Daily batch processing capabilities for bulk updates.

Answer

Direct integration with local CSV storage.

Question 7

During a model deployment test, you notice that the model's inference performance is inconsistent. What is the most likely cause, and how can you mitigate it?

Accepted Answer

The model is not logged with its environment dependencies.. Performance inconsistencies often arise from environment differences between training and serving. Databricks handles this by capturing the exact environment configuration, including library versions, in the MLflow model artifact. Ensuring that these dependencies are explicitly logged and replicated in the production environment is key to consistent inference performance. This practice mitigates 'it works on my machine' issues and stabilizes the model's behavior across different computational stages in the MLOps lifecycle.

Answer

The model is too large for the network.

Answer

The input data has too many missing values.

Answer

The model was trained on a GPU cluster.

Question 8

A data scientist wants to share their notebook with a team member, but they want to restrict access so the team member can only view the results without modifying the code. What is the correct sharing permission setting?

Accepted Answer

Can Edit. The 'Can View' permission in Databricks allows users to execute the notebook and see results, but prevents them from changing the underlying code. This is essential for collaborative environments where stakeholders need to audit findings or review model performance without accidentally disrupting the development process. Understanding these permission levels is vital for maintaining security and integrity in shared workspaces during machine learning development projects.

Answer

Can Run

Answer

Can Manage

Answer

Owner

Question 9

An organization is preparing to deploy a machine learning model into production using Databricks Model Serving. Which TWO actions must the user perform to ensure the model is ready for high-availability inference?

Accepted Answer

Register the model in the MLflow Model Registry. To deploy models for production, the model must be registered in the Model Registry. Once registered, it must be transitioned to the 'Production' stage or specifically versioned for deployment. Databricks Model Serving handles the infrastructure, but the user must provide the environment configuration, such as defining compute resources and ensuring the model dependencies are correctly specified, to ensure consistent and scalable inference performance in a production environment.

Answer

Manually copy model artifacts to a persistent S3/DBFS bucket

Answer

Disable authentication on the serving endpoint

Answer

Convert the model to a flat JSON file

Question 10

A machine learning engineer has a scikit-learn model registered in Unity Catalog as `prod_ml.churn.final_model` with version 3 tagged `"champion"`. The batch scoring job reads the model with `mlflow.pyfunc.spark_udf(spark, model_uri="models:/prod_ml.churn.final_model/3")`. When a data scientist registers version 4 and sets the alias `champion` to it, the batch job starts scoring with version 4 without any code change. The engineer must guarantee the batch job always scores with the reviewed version 3 until a new version is explicitly approved. What should the engineer do?

Accepted Answer

Score with `models:/prod_ml.churn.final_model/3`, and only update the job to a new version after the version is approved and the alias is moved, keeping promotion as an explicit registry operation.. Immutable numeric version URIs prevent silent model changes, while aliases are movable pointers that can drift. To ensure the job always uses the reviewed version 3 until an explicit approval, the engineer should keep the version-pinned URI and make promotion a separate registry operation. This preserves reproducibility and makes the switch to version 4 an intentional, auditable step.

Answer

Change the model URI to `models:/prod_ml.churn.final_model/3` and rely on Unity Catalog permissions to block access to all later versions.

Answer

Keep the numeric version URI `models:/prod_ml.churn.final_model/3` and require an explicit code or configuration change to move the job to a newly approved version.

Answer

Replace the model URI with `models:/prod_ml.churn.final_model@champion` so the alias resolves consistently in every environment.