Databricks-ML-Pro Model Development — Timed 10 Questions

Question 1

A data scientist is training a Random Forest model on Databricks. They want to ensure that the hyperparameter tuning process is efficient while preventing overfitting during the training phase. Which approach best achieves this goal using MLflow and Hyperopt?

10 minute time limit — choose an answer to begin.

Accepted Answer

Configure Hyperopt with the Tree of Parzen Estimators (TPE) algorithm and include cross-validation in the objective function.. Using Hyperopt with MLflow allows for parallelized hyperparameter optimization, which is crucial for efficient search spaces. By incorporating cross-validation within the objective function, the model is evaluated on multiple data folds, effectively preventing overfitting. This integrated approach ensures that models are both performant and robust, leveraging Databricks' distributed compute clusters to minimize training time while maintaining high-quality hyperparameter selection.

Answer

Perform a grid search on a single node without cross-validation.

Answer

Utilize MLflow autologging to automatically log all hyperparameter trials during a random search.

Answer

Manually tune hyperparameters by iterating through individual values in a notebook loop.

Question 2

A machine learning engineer needs to handle imbalanced datasets for a fraud detection model using PySpark and MLlib. Which TWO techniques are valid for mitigating this issue within the Databricks environment?

Accepted Answer

Increase the weight of the minority class samples using the weight column in the classifier.. Addressing class imbalance is critical for fraud detection where the minority class is the primary focus. Oversampling the minority class or undersampling the majority class are standard statistical practices. Implementing these directly within the Spark pipeline ensures they scale across large distributed datasets, which is vital for maintaining model integrity in big data environments where manual sampling techniques would fail or be inefficient.

Answer

Apply SMOTE (Synthetic Minority Over-sampling Technique) using standard scikit-learn libraries.

Answer

Filter out majority class rows to create a balanced dataset before training.

Answer

Use the standard cross-validation object with no modification.

Question 3

Refer to the exhibit. A data scientist is deploying a model to the Model Registry. What is the impact of the registered_model_name parameter in the log_model function?

Accepted Answer

It creates a new version of the registered model if the name already exists.. The registered_model_name parameter instructs MLflow to create or update a registered model entry in the Model Registry. This is a critical step for transitioning from training to deployment, as it creates a centralized location for managing model versions. By providing this parameter, the model is automatically cataloged, allowing downstream systems to reference the latest version in production automatically.

Answer

It forces the model to immediately transition to the 'Production' stage.

Answer

It saves the model locally to the driver node's disk.

Answer

It deletes all existing versions of the model with that name.

Question 4

A data scientist is training a deep learning model using TensorFlow on Databricks. They observe that training speed is slow despite using a GPU cluster. Which action should they prioritize to optimize performance?

Accepted Answer

Convert the dataset into TFRecords format and use tf.data API for efficient loading.. Deep learning models in Databricks often suffer from I/O bottlenecks when data is not optimally staged or formatted. Using the Petastorm library or converting data into TFRecords allows for efficient, parallelized loading of large datasets directly into the GPU memory. This minimizes idle time for the GPUs, ensuring that the computational power of the cluster is fully utilized during the training phase of the neural network.

Answer

Increase the number of threads on the driver node.

Answer

Switch from GPU to CPU instances to reduce costs.

Answer

Reduce the batch size to the smallest possible value.

Question 5

A machine learning engineer needs to deploy a custom model that uses a non-standard pre-processing library. How should they package the model to ensure the environment is correctly replicated during inference?

Accepted Answer

Pass a dictionary of dependencies to the 'conda_env' argument in the log_model function.. When using non-standard libraries, the MLflow 'conda_env' or 'pip_requirements' parameter in 'log_model' is critical. It explicitly defines the environment dependencies required to run the model. This ensures that the inference environment is an exact mirror of the training environment, which is the most reliable way to prevent 'it works on my machine' issues when deploying models into production clusters or serving endpoints.

Answer

Rely on the cluster's pre-installed libraries and assume they are present.

Answer

Manually install the required library on every node of the inference cluster.

Answer

Only log the model object and omit the environment specification.

Question 6

When sharing a Databricks notebook that contains sensitive model training logic, which feature should be used to provide users access without exposing the underlying source code?

Accepted Answer

Use the 'Run as owner' credential passthrough for the notebook.. Providing access to model results and visualizations without exposing the underlying source code is handled via Workspace permissions and 'Run as owner' notebook workflows. This allows authorized users to interact with the model's outputs (like plots, logs, or metrics) without compromising the intellectual property stored in the code. This is essential for secure collaboration in large organizations where different roles have different access needs.

Answer

Convert the notebook to a PDF and email it to the users.

Answer

Share the notebook with 'Can View' permissions for all users.

Answer

Copy the code into a public GitHub repository.

Question 7

A data scientist is training a PyTorch model on Databricks using MLflow. They need to ensure that the model architecture and training parameters are automatically logged without explicitly calling mlflow.pytorch.autolog() in every notebook. Which approach is the most efficient?

Accepted Answer

Call mlflow.autolog() at the start of the notebook session.. Databricks Runtime for Machine Learning includes pre-configured MLflow autologging. By setting the environment-wide configuration via Spark properties or using the mlflow.autolog() function at the beginning of the session, the environment automatically captures model artifacts, parameters, and metrics for supported frameworks. This reduces boilerplate code and prevents oversight, ensuring experiment reproducibility and auditability across the entire team's experimentation lifecycle within the workspace.

Answer

Manually wrap every training loop in a with mlflow.start_run() block to capture parameters.

Answer

Call mlflow.pytorch.autolog() at the start of the notebook cell.

Answer

Configure the MLflow tracking URI to a remote server using a custom tracking client.

Question 8

Which TWO of the following steps are required to properly register a custom Python model in the Unity Catalog Model Registry using the MLflow Fluent API?

Accepted Answer

Use the 'uc:' prefix in the model_uri parameter during the registration process.. Registering models in Unity Catalog requires a specific workflow to ensure governance and lineage. First, you must log the model using a supported flavor or custom pyfunc. Second, you must use the 'uc:' URI prefix in the log_model or register_model call to direct the artifact to the Unity Catalog rather than the workspace-local registry. This ensures the model is discoverable and governable.

Answer

Call mlflow.register_model() using a standard 'models:/' URI.

Answer

Manually upload model pickle files to an external S3 bucket before registration.

Answer

Convert the model to an ONNX format before registering it to the catalog.

Question 9

When training a model using Scikit-Learn in a Databricks notebook, which MLflow component should a data scientist use to group multiple related training runs under a single experiment?

Accepted Answer

mlflow.set_experiment(). MLflow Experiments serve as the primary organizational unit for model development. By associating runs with a specific experiment, teams can compare performance across different iterations, track progress, and manage metadata. Proper use of experiments is essential for maintainable machine learning workflows, as it prevents the cluttering of run history and enables effective result visualization in the MLflow UI.

Answer

mlflow.start_run()

Answer

mlflow.log_param()

Answer

mlflow.register_model()

Question 10

Which THREE of the following are valid ways to improve the performance of a model during the development phase in Databricks?

Accepted Answer

Using Hyperopt for automated hyperparameter tuning.. Model performance is improved through a combination of feature engineering, hyperparameter optimization, and proper data sampling. Hyperopt provides automated search for parameters, feature stores ensure consistency and reuse, and cross-validation provides a robust estimate of model performance. Using these tools within the Databricks ecosystem ensures that improvements are statistically sound and easily reproducible for production deployment.

Answer

Deploying the model to a Multi-Model Serving endpoint.

Answer

Increasing the number of hidden layers in a neural network blindly.