Databricks-ML-Assoc Databricks Machine Learning Practice Test 4 — 15 Questions

Question 1

What is the primary benefit of using 'AutoML' in Databricks for a machine learning project?

Accepted Answer

Automating the model training and tuning process.. Databricks AutoML automatically explores various algorithms, hyperparameters, and preprocessing techniques to identify the best-performing model for a given dataset. This significantly accelerates the prototyping phase, allowing data scientists to establish a baseline model quickly. By automating the tedious parts of the machine learning pipeline, AutoML frees up time for data scientists to focus on complex feature engineering, business logic integration, and model interpretation rather than manual trial-and-error workflows.

Answer

Automatically replacing all human data scientists.

Answer

Providing the only way to register models in Databricks.

Answer

Enabling the direct deployment of models without testing.

Question 2

When sharing a Databricks ML experiment with another team, what is the best way to ensure they can reproduce your results exactly?

Accepted Answer

Sharing the Git hash and the MLflow logged environment.. To ensure full reproducibility, you must log both the code version (often via Git hash) and the exact environment configuration (the Conda or pip environment) using MLflow. By capturing the library versions, the Python runtime environment, and the specific code state, you provide the necessary metadata for another environment to rebuild your exact setup, thereby guaranteeing that the same inputs will lead to the same model outputs consistently.

Answer

Sharing a screenshot of the training results.

Answer

Exporting the model binary to a local CSV file.

Answer

Writing the code in a standard Jupyter notebook.

Question 3

Which THREE of the following are supported methods for serving machine learning models in Databricks?

Accepted Answer

Real-time REST API endpoints. Databricks provides multiple pathways for model serving, catering to different latency and throughput requirements. Real-time serving provides low-latency REST endpoints for interactive applications. Batch inference allows for high-throughput processing on large datasets using Spark. Finally, user-defined functions (UDFs) allow for embedding model logic directly into SQL or DataFrame transformations, which is highly useful for integrating machine learning models within existing data engineering pipelines and analytics workflows.

Answer

Manual model training in a local Excel file

Answer

Streaming model updates to public web hosting

Question 4

Which component in Databricks is used to manage the lineage of machine learning data, ensuring that you can trace a model back to the exact version of the data it was trained on?

Accepted Answer

Unity Catalog. Unity Catalog provides comprehensive lineage and governance for data and AI assets. It tracks how data is transformed and used, linking datasets to the models they trained. This lineage is vital for auditing, compliance, and debugging, as it allows teams to verify that models were trained on the correct, compliant, and current version of the data, maintaining high standards of data integrity in AI workflows.

Answer

MLflow Tracking

Answer

Databricks Jobs

Answer

Delta Lake

Question 5

What is the primary technical limitation when deploying an MLflow model that has custom Python dependencies not included in the standard Databricks Runtime?

Accepted Answer

The serving container will fail due to missing runtime libraries.. When using custom libraries, the inference environment must be able to install and manage these dependencies. MLflow handles this by utilizing environment specifications (like Conda or pip requirements). If these dependencies are not explicitly defined or cannot be resolved at deployment time, the serving container will fail to start. This highlights the importance of properly managing the environment specification to ensure the target serving infrastructure has the necessary software components available.

Answer

The model will automatically install the missing libraries.

Answer

The model will be rejected by the registry.

Answer

The model cannot be used with MLflow.

Question 6

Why is it important to use a 'Feature Store' rather than joining raw tables directly in the training notebook?

Accepted Answer

It prevents training-serving skew by centralizing feature logic.. Using a Feature Store ensures that feature engineering logic is consistent and reusable across different models, preventing 'training-serving skew'. Joining raw tables in a notebook often leads to 're-implementation drift', where the code used in training differs slightly from the production inference pipeline. A Feature Store enforces a single source of truth for features, making models more reliable and reducing the time spent on redundant data cleaning tasks.

Answer

It is faster to write raw SQL joins.

Answer

It automatically deletes old training data.

Answer

It prevents the use of any non-SQL data sources.

Question 7

A machine learning engineer needs to track model parameters, metrics, and artifacts across distributed training runs executed on Databricks. Which component of Databricks Machine Learning should they use to manage and organize this experiment metadata?

Accepted Answer

MLflow Tracking. MLflow tracking provides an API and UI for logging parameters, code versions, metrics, and output files when running machine learning code. It is fully integrated with Databricks to seamlessly record metadata from distributed jobs, enabling reproducibility, model comparison, and centralized artifact storage across multiple cloud environments and teams.

Answer

Databricks Feature Store

Answer

Unity Catalog Volumes

Answer

Databricks Model Serving

Question 8

A data scientist is training a model using MLflow on Databricks. They need to ensure that the model artifacts, environment dependencies, and signature are automatically captured to facilitate seamless deployment to Databricks Model Serving. Which command should they use within the training script?

Accepted Answer

mlflow.sklearn.log_model(). The mlflow.spark.log_model or mlflow.sklearn.log_model functions are critical for capturing the model flavor, environment, and signature. By automatically logging these components, Databricks Model Serving can identify the required dependencies and input schema, allowing for a standardized deployment process. This automation is essential for reducing manual configuration errors and ensuring that the model behaves identically in production as it did during the training phase.

Answer

mlflow.save_model()

Answer

mlflow.log_artifact()

Answer

mlflow.set_tracking_uri()

Question 9

Refer to the exhibit. A model is failing to deploy to Databricks Model Serving. The error log indicates 'Schema Mismatch'. Based on the JSON signature provided, what is the most likely cause of the deployment failure?

Accepted Answer

The input data types do not match the expected integer/double types.. The error occurs because the input data sent to the serving endpoint does not match the defined signature. The signature strictly enforces types; if the incoming request sends a string instead of an integer for 'age', or if a field is missing, the serving layer rejects the payload. Validating the schema against the expected MLflow signature is critical for preventing runtime inference errors when integrating with external client applications.

Answer

The model environment is missing.

Answer

The output type is too large to process.

Answer

The model version is not registered.

Question 10

Which Databricks component should be used to track parameters, code versions, metrics, and output files when running machine learning experiments?

Accepted Answer

MLflow Tracking. MLflow Tracking is the primary component for logging the inputs and outputs of machine learning runs. It allows data scientists to organize experiments and compare performance across different iterations. By centralizing this information, teams can ensure reproducibility and visibility into the model development process, which is foundational for maintaining high-quality machine learning workflows and facilitating collaboration within the Databricks environment.

Answer

Databricks Model Registry

Answer

Databricks Feature Store

Answer

Unity Catalog

Question 11

A data science team is transitioning from local model development to Databricks. They want to ensure their models are portable across different Databricks workspaces. What is the recommended practice for managing models in this environment?

Accepted Answer

Use MLflow Model Registry with Unity Catalog.. Using the MLflow Model Registry within Unity Catalog is the best practice for cross-workspace model management. Unity Catalog provides a unified namespace and governance, allowing models to be registered and then accessed from different workspaces with appropriate permissions. This practice eliminates the need for manual migration of artifacts and ensures that model lineage, versions, and metadata remain synchronized and governed, which is critical for enterprise-grade MLOps and compliance.

Answer

Export models as pickle files to DBFS.

Answer

Email model artifacts to other team members.

Answer

Re-train the model in each workspace.

Question 12

A user is experiencing 'Out of Memory' (OOM) errors during the evaluation phase of a large XGBoost model on Databricks. What is the most effective way to address this while utilizing the distributed nature of Databricks?

Accepted Answer

Use a Spark-native implementation of the algorithm.. Using Spark-based distributed training, such as the `sparkdl` or native XGBoost spark estimator, allows the data to be partitioned across the cluster nodes. This prevents the driver from attempting to hold the entire dataset in memory. By distributing the workload, the system can handle datasets that exceed the memory capacity of a single machine, which is fundamental for scaling machine learning applications on Databricks.

Answer

Increase the driver node memory indefinitely.

Answer

Downsample the data until it fits in memory.

Answer

Convert the data to a single JSON file.

Question 13

Which approach is most efficient for tracking hyperparameter tuning metrics across thousands of runs on Databricks?

Accepted Answer

Using MLflow Experiments UI.. Using the MLflow Search API or the Experiments UI is the standard approach to manage and analyze large volumes of experiment results. These tools provide filtering, sorting, and visualization capabilities that allow data scientists to quickly identify the best performing models from thousands of candidates. This efficiency is necessary for iterative machine learning, where the ability to derive insights from vast amounts of experiment data drives faster and more accurate model development.

Answer

Logging results to a text file.

Answer

Printing metrics to the notebook logs.

Answer

Manually updating a spreadsheet.

Question 14

A data scientist needs to prepare a model for deployment in a highly regulated environment. Which TWO tasks must they complete to ensure the model meets auditability requirements?

Accepted Answer

Registering the model in the MLflow Model Registry.. Auditability in regulated industries requires proof of origin and transparency. Registering the model in the MLflow Model Registry provides a clear version history and change logs, while linking the model back to the specific run, training data, and notebook ensures full lineage. These steps are mandatory for compliance, ensuring that any model prediction can be traced back to its training source, which is critical for legal and business accountability.

Answer

Deleting all training logs after deployment.

Answer

Hard-coding model weights in the inference script.

Answer

Using a local Git repository for versioning.

Question 15

Refer to the exhibit. The logs indicate a persistent connection failure for a Databricks Model Serving endpoint. What is the most likely cause?

Accepted Answer

The endpoint is overloaded or incorrectly configured.. A 'Connection refused' error coupled with a request timeout typically indicates that the serving endpoint is either overloaded, configured incorrectly with insufficient resources, or facing network connectivity issues. Since the error persists despite retries, it points to a failure in the endpoint infrastructure or scaling capacity, which requires an investigation of the endpoint's resource allocation and the network configuration within the Databricks workspace to restore service reliability.

Answer

The model artifacts are missing.

Answer

The input data format is incorrect.

Answer

The model version is archived.