Databricks-ML-Pro Practice Exam 2 — 20 Questions

Question 1

You are developing a machine learning pipeline where you need to perform feature engineering on a large dataset using Spark, then train a model using Scikit-Learn. Which workflow is most efficient?

Accepted Answer

Perform feature engineering using Spark transformations, then collect to Pandas for training.. The most efficient workflow involves leveraging Spark for distributed data transformation and feature engineering, followed by collecting the processed data into a Pandas DataFrame for Scikit-Learn training. This approach uses the strengths of both frameworks, ensuring that computationally expensive transformations are parallelized across the cluster, while Scikit-Learn handles the specific modeling logic that is not natively distributed.

Answer

Convert the raw Spark DataFrame to Pandas immediately, then perform feature engineering.

Answer

Use a custom UDF to execute Scikit-Learn code on every partition of the Spark DataFrame.

Answer

Rewrite all feature engineering logic using only Scikit-Learn transformers.

Question 2

A machine learning team is using `mlflow.autolog()` to track experiments. They notice that certain custom metrics are not being captured. What is the most effective way to address this?

Accepted Answer

Implement a custom callback in the training loop that uses mlflow.log_metric for the specific metrics.. While autologging captures standard metrics like accuracy, custom metrics require explicit logging calls using `mlflow.log_metric`. This is important because business-specific KPIs, such as profit margin or specific domain-based error rates, often require custom logic that framework-specific autologgers cannot infer automatically. Explicit logging ensures comprehensive experiment visibility and allows for precise model selection based on business goals rather than just technical performance.

Answer

Disable autologging and manually log every single parameter and metric.

Answer

Increase the logging frequency of the autologger via the configuration file.

Answer

Create a custom Python class that inherits from the MLflow Autologger base class.

Question 3

An ML engineer is training an XGBoost model on Databricks and wants to leverage hyperparameter tuning using Hyperopt while automatically logging all trial parameters, metrics, and models to MLflow. Which built-in MLflow function should be used to achieve this automatic integration?

Accepted Answer

mlflow.xgboost.autolog(). mlflow.xgboost.autolog() automatically logs parameters, metrics, and trained artifacts during XGBoost training routines without requiring manual logging statements inside the training loop. This function streamlines model development workflows by ensuring complete lineage tracking and experiment reproducibility across extensive hyperparameter tuning sweeps.

Answer

mlflow.spark.autolog()

Answer

mlflow.sklearn.autolog()

Answer

mlflow.register_model()

Question 4

A data scientist registers a new model version to Unity Catalog and wants to promote it to Production after validation. Which action accomplishes this in the current Databricks recommendation?

Accepted Answer

Assign the alias 'champion' to the validated model version using the MLflow client or Catalog Explorer.. In Unity Catalog, model promotion is done with aliases rather than the deprecated stages. Assigning an alias such as 'champion' to a validated version marks it as the one that serving endpoints and jobs should consume, and endpoints referencing that alias automatically serve the newly promoted version without changing their configuration.

Answer

Set the model version's stage to Production using the MLflow Model Registry stage transition API.

Answer

Add a tag named 'stage' with the value 'Production' to the model version and restart the serving endpoint.

Answer

Create a new registered model with the same name plus a '-prod' suffix and copy the artifacts into it.

Question 5

You are implementing model monitoring to detect data drift. Which Databricks feature should you use to automatically track and alert on changes in the distribution of input data features over time?

Accepted Answer

Databricks Lakehouse Monitoring. Databricks Lakehouse Monitoring provides automated insights into data quality and drift. By tracking statistical properties of incoming data against a baseline, it generates alerts when significant shifts are detected. This is a crucial component of MLOps, as it proactively identifies when a model's performance might degrade due to environmental changes, allowing teams to retrain or adjust models before they negatively impact business outcomes.

Answer

MLflow Experiment Tracking

Answer

Delta Live Tables Expectations

Answer

Databricks SQL Alerts

Question 6

Refer to the exhibit. A machine learning team has updated their model serving endpoint configuration as shown in the JSON. Which deployment strategy is being implemented, and what is the primary risk associated with this specific configuration?

Accepted Answer

Canary deployment; the primary risk is increased 'cold start' latency for the v2 model due to low traffic volume.. The exhibit demonstrates a Canary deployment where a small fraction of traffic (10%) is routed to a new model version (v2) while the majority remains on the stable version (v1). This allows for real-world testing with minimal impact. However, since both versions are set to scale-to-zero, the 10% traffic might not be frequent enough to keep v2 warm, leading to high latency for those users.

Answer

Blue/Green deployment; the primary risk is the high cost of running two identical clusters simultaneously.

Answer

A/B testing; the primary risk is that the workload size 'Small' is insufficient for 90% of the traffic.

Answer

Shadow deployment; the primary risk is that v2 will interfere with the predictions returned by v1.

Question 7

A machine learning engineer is using MLflow to track experiments on Databricks. They notice that when they run `mlflow.log_artifact` with a local file path inside a notebook, the artifact is stored in the run's artifact location, but when they run the same code in a job cluster, the artifact is missing. The job cluster uses the same MLflow tracking server and experiment. What is the most likely reason for the missing artifact?

Accepted Answer

The local file path used in the job cluster points to a location that is not accessible from the driver, such as a path on the local filesystem of a different node, so the file does not exist when `log_artifact` is called.. In a Databricks job cluster, code may execute on the driver, but local filesystem paths are not shared across nodes. If the artifact file is created on an executor or a different node, the driver cannot access it when `log_artifact` is called. To ensure artifacts are logged, write them to a distributed storage location such as DBFS or a Unity Catalog volume, then log from there.

Answer

The MLflow tracking server rejects artifacts from job clusters because they lack an interactive user session, so the artifact is discarded.

Answer

The artifact location is configured with a short-lived credential that expires before the job cluster completes, causing the artifact upload to fail silently.

Answer

The job cluster does not have the MLflow library installed, so `log_artifact` silently fails without logging an error.

Question 8

Which practice is most effective for managing dependencies to ensure consistent model training and inference results across different Databricks clusters?

Accepted Answer

Include a requirements.txt file with the notebook or project and specify it in the MLflow model logging process.. Using environment management files (e.g., requirements.txt or conda.yaml) ensures that the exact library versions used during development are replicated in the training and serving environments. This consistency is critical for preventing 'works on my machine' issues, where discrepancies in library versions lead to different numerical outputs or runtime crashes during inference, thus maintaining the reliability and reproducibility of the machine learning pipeline.

Answer

Manually install libraries on each cluster node before starting the job.

Answer

Rely on the default Databricks Runtime library set for all projects.

Answer

Use broad version constraints like '>=1.0' in the environment configuration.

Question 9

A machine learning engineer needs to track model experiments and ensure that all training parameters and metrics are captured in a reproducible way. What is the best practice for using MLflow within Databricks notebooks?

Accepted Answer

Use MLflow with 'mlflow.start_run()' and 'mlflow.autolog()' to ensure all runs are tracked automatically.. Using 'mlflow.autolog()' or explicit 'mlflow.log_params()' within a context manager ensures that every run is isolated and documented. This practice allows for easy comparison of different hyperparameter configurations, preventing data loss and providing a clear lineage from the raw data to the final model artifact, which is crucial for compliance and debugging in enterprise ML environments.

Answer

Manually log metrics to a shared Excel file stored on DBFS after the run completes.

Answer

Only log the final evaluation metric at the end of the training loop to minimize storage.

Answer

Print the parameters to the notebook output cell and rely on the notebook's revision history.

Question 10

Your organization requires that all models deployed to production must be signed by a security officer. How can you enforce this requirement within the Databricks MLflow Model Registry?

Accepted Answer

Restrict 'CAN_MANAGE' permissions on the model, and use an automated CI/CD pipeline for promotion.. Enforcing approval workflows is crucial for compliance and risk management in MLOps. By using MLflow's permissions and stages, you can restrict who can promote models to 'Production'. Combining this with programmatic checks or external CI/CD gates ensures that a model cannot be deployed without the necessary authorization, preventing unauthorized or unvetted code from reaching production inference services.

Answer

Delete all models in the Production stage and only re-upload the signed models.

Answer

Grant 'CAN_MANAGE' permissions on the registry to everyone to ensure transparency.

Answer

Set the model version description to 'Signed by Security' after manual inspection.

Question 11

Refer to the exhibit. Your automated CI/CD pipeline triggered a model deployment to production, but the job failed with the error shown. What is the most likely cause?

Accepted Answer

The deployment job is referencing a model version that hasn't been created yet.. The error indicates that the deployment pipeline is attempting to access a model version that does not exist in the Model Registry. This usually happens when the pipeline triggers before the registration process completes or when a race condition occurs between the training job and the deployment job. Validating the existence of the model version before initiating deployment is essential for pipeline reliability.

Answer

The model was registered, but the cluster lacks permissions to read it.

Answer

The model serving endpoint is already occupied by another model version.

Answer

The training cluster ran out of memory during the model artifact upload.

Question 12

What is the primary purpose of registering a model in the MLflow Model Registry?

Accepted Answer

To provide a structured workflow for versioning, stage management, and model governance.. The MLflow Model Registry provides a centralized hub for managing the model lifecycle, including versioning, stage transitions (e.g., Staging to Production), and lineage tracking. This is foundational for MLOps because it provides a single source of truth for all stakeholders, enabling controlled deployments, auditability, and the ability to easily revert to previous model versions if performance regressions are detected in production.

Answer

To increase the training speed of the machine learning model.

Answer

To automatically retrain the model when data drift is detected.

Answer

To convert Python code into high-performance C++ code.

Question 13

A fraud detection model is served on a Databricks Model Serving endpoint. You notice that predictions for the same input vector differ between two consecutive requests within seconds, and there is no feature store or external cache involved. The model was logged with a fixed random seed and deterministic inference code. Which action should you take first to diagnose the inconsistency?

Accepted Answer

Inspect the endpoint's request logs to confirm the payloads are identical and check whether the model version serving traffic changed between requests.. When a deterministic model returns different outputs for the same input, the fastest path to the cause is to verify the two requests were truly identical and to confirm which model version handled each. A version transition during a rollout, or a payload difference such as field ordering or missing values, explains the symptom without any model retraining. Retraining, scaling, or changing flavors are premature and do not produce diagnostic evidence.

Answer

Convert the model to a different flavor such as ONNX and re-register it, because the original flavor cannot guarantee deterministic inference.

Answer

Increase the endpoint's concurrency and enable autoscaling, since differing predictions indicate the replicas are running different code.

Answer

Retrain the model with a different random seed and redeploy, because seed instability is the likely cause of varying predictions.

Question 14

When auditing an ML pipeline in Databricks for compliance and governance, which THREE of the following should be verified?

Accepted Answer

The Git commit hash associated with the specific training run.. Auditing requires proof of data lineage, code versioning, and access control. Verifying these components ensures that the organization can prove how a model was built, what data was used, who approved it, and that the code was properly reviewed. This level of traceability is non-negotiable for regulated industries and essential for enterprise-grade MLOps maturity.

Answer

The personal credentials of the data scientist who manually ran the training.

Answer

The raw text of every email sent between the data scientists.

Question 15

Your organization is implementing an MLOps strategy that requires strict model governance. You need to ensure that no model is deployed to production unless it has been tagged with 'validated=true' in the MLflow Model Registry. How can you enforce this policy within your CI/CD workflow?

Accepted Answer

Add a validation script in the CI/CD pipeline that queries the model version tags.. Implementing a policy-based deployment gate in your CI/CD pipeline ensures that governance requirements are met before code or models hit production. By querying the model's tags using the MLflow client before attempting a deployment, you create a hard stop for non-compliant models. This is a critical security and compliance practice, preventing unauthorized or untested models from being served to end-users or critical business processes.

Answer

Use Databricks workspace permissions to prevent unauthorized users from deploying models.

Answer

Rely on the MLflow UI to visually verify the tag before clicking 'Deploy'.

Answer

Set the default stage of all new models to 'Production' via a global config.

Question 16

Which of the following describes the purpose of a 'Gold' table in the Medallion architecture within an MLOps pipeline?

Accepted Answer

It contains validated, business-level data ready for ML model training.. The Gold layer contains highly processed, business-level data that is ready for consumption by downstream ML models or analytical applications. By ensuring data is clean, aggregated, and validated at this stage, MLOps teams can rely on high-quality features for training, which directly improves model performance and reduces the complexity of the feature engineering step in the training pipeline.

Answer

It stores raw data ingested directly from external sources.

Answer

It serves as a transient staging area for schema evolution.

Answer

It stores model artifacts and hyperparameters for versioning.

Question 17

A data scientist wants to compare multiple runs within the same MLflow experiment to identify the best-performing model based on a custom metric. What is the most efficient way to do this in the MLflow UI?

Accepted Answer

Use the MLflow UI's experiment page to sort runs by the custom metric and compare them side by side.. The MLflow UI experiment page is designed for comparing runs: it displays all runs in a table, supports sorting by any metric, and allows selecting multiple runs for side-by-side comparison of parameters, metrics, and artifacts. Manual recording, CSV export, or custom API scripts are less efficient and unnecessary for this common task.

Answer

Export all runs to a CSV file using the MLflow CLI and then analyze the CSV in a separate tool.

Answer

Query the MLflow tracking server's REST API and write a custom script to parse and rank the runs.

Answer

Open each run individually and manually record the custom metric values in a spreadsheet.

Question 18

A team is using Databricks Feature Store to manage features for a real-time model served via Databricks Model Serving. They need to ensure that the online feature values used at inference time are consistent with the training data. Which TWO practices should they implement? (Choose two.)

Accepted Answer

Use point-in-time lookups when creating the training dataset to avoid leaking future data.. Consistency between online and offline features is achieved by using the same pipeline to publish to both stores and by using point-in-time lookups during training. These practices ensure that the transformations and temporal alignment match between training and inference. Manual copying or direct Delta queries do not provide the required consistency or performance.

Answer

Log the model with the feature store's training set specification to enable automatic feature lookup at serving time.

Answer

Store all features in a single Delta table and query it directly from the model serving endpoint.

Answer

Manually copy feature values from the offline store to the online store on a daily basis using a notebook.

Question 19

A data scientist is training a machine learning model on Databricks using MLflow. They need to track hyperparameter tuning experiments while ensuring that each iteration is uniquely identifiable and reproducible. Which feature should they use to group related runs within a single experiment?

Accepted Answer

MLflow Nested Runs via the 'parent_run_id' parameter.. MLflow nested runs are the industry-standard approach for hierarchical organization of hyperparameter tuning tasks. By creating a parent run for the overall optimization process and child runs for individual parameter sets, data scientists gain clear visibility into model performance metrics across the entire search space, simplifying comparative analysis and facilitating efficient model selection during the development lifecycle.

Answer

MLflow Tags to append metadata for each run iteration.

Answer

MLflow Experiment IDs for every parameter variation.

Answer

MLflow Model Registry versions to track iterative progress.

Question 20

Which component of Databricks ML is best suited for tracking model hyperparameters, metrics, and code versions during the experimentation phase of the ML lifecycle?

Accepted Answer

MLflow Tracking. MLflow Tracking is the dedicated component designed to record every experiment's parameters, metrics, and code state. By capturing these elements, data scientists can compare different iterations of a model to identify the best-performing configuration. This visibility is vital in MLOps, as it creates an audit trail of how a final model was derived, supporting reproducibility and informed decision-making before promoting a model to the registry.

Answer

Databricks SQL

Answer

Delta Lake

Answer

Unity Catalog