Databricks-ML-Assoc Model Development Practice Test 5 — 15 Questions

Question 1

Refer to the exhibit. A data scientist is logging a model to MLflow. Why is including an 'input_example' highly recommended in this specific code snippet?

Accepted Answer

It allows MLflow to validate the schema and ensures the model is compatible with deployment endpoints.. The input_example acts as a validation mechanism that MLflow uses to verify that the model can successfully process incoming data. It also enables automatic schema inference, which is crucial for downstream services like Model Serving. By providing this example, developers ensure that the model registry has metadata that allows for schema validation at serving time, reducing the risk of runtime errors when the model is deployed to production endpoints.

Answer

It forces the model to retrain every time it is loaded into production.

Answer

It automatically encrypts the model artifacts for security compliance.

Answer

It creates a dummy model version that cannot be used for inference.

Question 2

Which THREE steps are essential for preparing a dataset for training using the Databricks Feature Store?

Accepted Answer

Define a FeatureTable with a primary key to enable lookups.. Preparing data for the Feature Store involves defining features, registering them in a catalog, and then utilizing the Feature Store client to perform joins for training. This structured workflow ensures that all features are documented, discoverable, and versioned. By standardizing these steps, data scientists can maintain a robust lineage for their data, which is critical for model auditing and ensuring that training data remains consistent across different projects and team members.

Answer

Manually copy raw training data into each local node's disk.

Answer

Delete all source tables after registering the features.

Question 3

When hyperparameter tuning using 'Hyperopt' on Databricks, what is the primary benefit of using the 'Trials' object?

Accepted Answer

It enables the storage and retrieval of results from the hyperparameter search.. The Trials object records the results of every model evaluation run during the hyperparameter search. By persisting these results, it allows for post-hoc analysis, visualization of the search space, and the ability to resume interrupted tuning jobs. This is critical for managing expensive compute tasks, as it prevents the loss of progress and provides insights into the model's sensitivity to different parameter combinations, ultimately leading to more informed model development decisions.

Answer

It automatically deletes the worst-performing models from the registry.

Answer

It forces the cluster to use 100% of available cores for training.

Answer

It prevents the model from overfitting to the validation set.

Question 4

A data scientist is using Spark MLlib and wants to perform feature scaling on a large dataset. Which transformer should they use within a Pipeline to ensure that the scaling logic is correctly applied during both training and inference?

Accepted Answer

StandardScaler from pyspark.ml.feature.. Using a Pipeline with a scaler like StandardScaler or MinMaxScaler ensures that the scaling parameters (like mean and standard deviation) are captured as part of the model object. This is critical because the exact same scaling must be applied to new, unseen data during inference. Without this, the model will receive improperly scaled inputs, leading to incorrect predictions, as the model expects data to follow the same distribution used during training.

Answer

Manually calculate the mean and divide the DataFrame columns.

Answer

Pandas transformation functions via a UDF.

Answer

The VectorAssembler utility to normalize the input vector.

Question 5

When developing a machine learning model on Databricks, why is it recommended to use 'mlflow.log_param' for tracking model configurations like learning rate?

Accepted Answer

It enables easy comparison of experiment runs in the MLflow UI.. Tracking hyperparameters with log_param allows for full transparency and reproducibility of the experiment. When comparing model versions later, these parameters are indexed in the MLflow UI, enabling data scientists to correlate specific settings with performance outcomes. This is essential for iterative experimentation, as it provides a structured history that makes it easy to identify which configuration settings resulted in the best model performance, facilitating a data-driven approach to model optimization.

Answer

It automatically optimizes the hyperparameter for the next run.

Answer

It encrypts the model to prevent unauthorized access.

Answer

It is required to save the model artifact to DBFS.

Question 6

Refer to the exhibit. A developer encounters this error while trying to register a model in the Unity Catalog. What does this error signify about the model deployment process?

Accepted Answer

The model lacks a defined input and output schema.. The error indicates that the model's input and output schema are undefined, preventing the Unity Catalog from verifying data compatibility during inference. A model signature acts as a contract between the model and its consumers. Without it, the model serving environment cannot guarantee that incoming data matches the expected structure, which is a requirement for production-grade models to prevent runtime failures and ensure safe, reliable deployments in a shared enterprise environment.

Answer

The model has not been trained on enough data.

Answer

The user does not have permission to write to the catalog.

Answer

The model file size exceeds the registry's limit.

Question 7

When using MLflow to manage the lifecycle of a model in Databricks, why should you use the Model Registry instead of just saving model files to DBFS?

Accepted Answer

It allows for versioning and stage management of models.. The Model Registry provides versioning, stage transitions (e.g., Staging to Production), and centralized access control, which are essential for governed model deployment. Directly saving to DBFS ignores these enterprise features, making it impossible to track lineage or manage model lifecycle status effectively. Using the Registry creates an audit trail and standardizes the deployment workflow, which is critical for compliance and ensuring that only validated models move into production environments.

Answer

It automatically compresses the model files to save storage space.

Answer

It allows models to be trained directly on the registry.

Answer

It converts models into a proprietary format for faster inference.

Question 8

Which TWO of the following are common pitfalls when using 'Pandas UDFs' for distributed inference on large datasets in Databricks?

Accepted Answer

Memory exhaustion due to large batch sizes in the UDF.. Pandas UDFs are powerful but can lead to memory pressure if the data batches are too large, or cause performance degradation if the serialization overhead becomes significant. Choosing the right batch size is critical for balancing throughput and memory usage. Furthermore, developers often overlook the fact that UDFs run inside Python processes managed by Spark, meaning that heavy dependencies or inefficient code can lead to node-level OOM errors if not carefully optimized.

Answer

The inability to use Spark SQL functions inside the UDF.

Answer

Spark automatically parallelizes all non-vectorized Python code.

Answer

Pandas UDFs are only available for Scala-based models.

Question 9

Which of the following is the recommended workflow for developing a scalable model on Databricks?

Accepted Answer

Perform EDA, feature engineering, distributed training, and register with MLflow.. The iterative cycle of data exploration, feature engineering, distributed training, and model registry management is the standard Databricks practice. By utilizing MLflow throughout, scientists ensure reproducibility. Scaling is handled by Spark, and the Feature Store ensures the same data definitions are used for both training and inference. This workflow bridges the gap between ad-hoc experimentation and production-ready machine learning, ensuring that the model is robust, documented, and easily deployable via standard enterprise pipelines.

Answer

Train a model on a local machine, then upload the final artifact to Databricks.

Answer

Use a single-node cluster for all stages to avoid network latency.

Answer

Skip logging metrics to save space and improve training speed.

Question 10

Which TWO actions should be taken to ensure reproducibility of a Databricks ML model experiment?

Accepted Answer

Log the Git commit hash along with experiment metadata in MLflow.. Reproducibility in Databricks is achieved by capturing the state of the code, the environment, and the data. By utilizing Git integration and MLflow tracking, data scientists can point to the exact version of the code and environment used for an experiment. Using versioned Delta tables ensures that the data state can also be reconstructed, preventing 'data drift' from invalidating the results of historical experiments as underlying data tables change.

Answer

Hardcode the data file paths to local desktop directories.

Answer

Only log the model artifact and ignore the environment dependencies.

Answer

Manually delete all previous MLflow runs to keep the tracking server clean.

Question 11

What is the primary role of the 'Model Signature' in a Databricks ML lifecycle?

Accepted Answer

To enforce input schema validation at serving time.. The Model Signature defines the schema of the inputs and outputs, serving as a formal contract. This contract is used by the serving infrastructure to validate incoming requests, ensuring that they match the expected format. It helps catch errors early in the deployment lifecycle, protecting production endpoints from malformed data. By providing this metadata, developers ensure that their model is compatible with the standard Databricks serving interfaces, enabling seamless integration into production applications.

Answer

To identify which user trained the model for audit logs.

Answer

To increase the prediction accuracy by normalizing inputs.

Answer

To compress the serialized model file size for faster loading.

Question 12

A machine learning engineer needs to track model experiments in Databricks and wants to ensure that model artifacts are versioned automatically. Which approach best leverages Databricks-native capabilities for this requirement?

Accepted Answer

Invoke mlflow.autolog() at the start of the training script to capture parameters, metrics, and model artifacts automatically.. MLflow tracking is the standard in Databricks for recording experiments. Using mlflow.autolog() automatically captures parameters, metrics, and artifacts during model training runs, ensuring consistency and reproducibility across team members. This is essential for managing the model lifecycle, as it eliminates manual logging errors and provides a clear lineage from source code to the registered model artifact within the Unity Catalog or Model Registry environment.

Answer

Manually save model weights to a DBFS mount point using a standard Python dictionary to track parameters.

Answer

Write a custom function to append training results to a Delta table and store serialized model objects as binary columns.

Answer

Use the standard Python logging module to output training metrics to a text file saved in the user home directory.

Question 13

When performing hyperparameter tuning using Hyperopt on Databricks, which function is primarily used to distribute the training task across the cluster?

Accepted Answer

SparkTrials(). Hyperopt leverages the SparkTrials class to distribute tuning tasks. By using SparkTrials, Databricks orchestrates multiple training trials in parallel across the cluster nodes, significantly reducing the time required for grid or random search. This integration is vital for efficiently exploring complex hyperparameter spaces, allowing data scientists to iterate faster on model architectures without manual resource management or complex parallelization code.

Answer

fmin()

Answer

parallel_task()

Answer

distributed_fit()

Question 14

When using MLflow to track experiments, what happens if you invoke mlflow.end_run() inside a nested loop when the parent run is already active?

Accepted Answer

The active run is terminated, and subsequent logging calls outside the loop will fail if they assume the run is active.. Calling end_run() within a nested loop terminates the current active run. If it is part of a parent-child structure, ending the child prematurely could lead to incomplete data or orphaned metrics. Proper management requires careful scoping, often using context managers (with statements), to ensure that the run lifecycle is handled cleanly and that all sub-runs correctly report back to the primary experiment tracking context.

Answer

The entire experiment is deleted from the workspace.

Answer

The parent run automatically restarts to compensate for the closed child run.

Answer

The nested loop continues, but logging is redirected to the default root run.

Question 15

Which technique is most effective for handling high-cardinality categorical features when training a tree-based model on Databricks?

Accepted Answer

Target encoding, replacing labels with the mean of the target variable.. Target encoding or utilizing native categorical support in libraries like LightGBM or CatBoost is highly effective for high-cardinality features. These methods prevent the dimensionality explosion associated with one-hot encoding, which would otherwise lead to sparse, massive feature matrices that degrade training performance and memory efficiency. By handling categories internally, models maintain predictive power while remaining performant in distributed Databricks environments.

Answer

One-hot encoding for all categorical variables.

Answer

Standardization using a StandardScaler.

Answer

Removing all categorical features entirely.