PMLE Scaling Prototypes into ML Models Practice Test 2 — 15 Questions

Question 1

A data scientist wants to train a TensorFlow model on Vertex AI using a pre-built container. Which of the following pre-built containers is NOT available for custom training in Vertex AI?

Accepted Answer

Apache Spark. Vertex AI provides pre-built containers for TensorFlow, PyTorch, scikit-learn, and XGBoost. There is no pre-built container for Apache Spark in the Vertex AI training service; Spark jobs are typically run on Dataproc.

Answer

TensorFlow

Answer

PyTorch

Answer

scikit-learn

Question 2

You need to run a distributed training job on Vertex AI using TensorFlow with MirroredStrategy on a single machine with 4 GPUs. Which training configuration should you use?

Accepted Answer

Use MirroredStrategy with a single workerPoolSpec containing a machine_type with 4 GPUs. For single-machine multi-worker training with multiple GPUs, TensorFlow's MirroredStrategy is appropriate. The workerPoolSpec should have a single worker pool with a machine type that has multiple GPUs.

Answer

Use MultiWorkerMirroredStrategy with multiple workerPools

Answer

Use MirroredStrategy with two workerPoolSpecs, each with 2 GPUs

Answer

Use ParameterServerStrategy with a chief and a parameter server

Question 3

You have a very large language model that does not fit on a single GPU. You need to train it efficiently across multiple GPUs on a single machine. Which approach should you use?

Accepted Answer

Model parallelism using pipeline parallelism. When a model is too large for a single GPU, model parallelism (specifically pipeline parallelism) splits the model across GPUs. Data parallelism would require each GPU to hold the full model, which is not possible.

Answer

Data parallelism with MirroredStrategy

Answer

Data parallelism with MultiWorkerMirroredStrategy

Answer

Use TPU training as TPUs have more memory

Question 4

You want to reduce training costs by using preemptible VMs on Vertex AI for a fault-tolerant distributed training job that uses checkpointing. Which machine type should you choose in the worker pool configuration?

Accepted Answer

Use spot VMs by setting 'spot' to true in the machine spec. Vertex AI supports spot VMs (formerly preemptible) for training. By setting 'spot' to true, you use preemptible instances at a discount. The training must handle preemption via checkpointing.

Answer

Use custom machine types with preemptible flag

Answer

Use standard VMs and rely on Vertex AI auto-restart

Answer

Use TPU VMs because they are cheaper

Question 5

You are performing hyperparameter tuning on Vertex AI with Vizier. You want to maximize the accuracy of your model, and you have a budget of 50 trials. Which algorithm should you choose to best explore the search space?

Accepted Answer

Bayesian optimization. Bayesian optimization is the default and recommended algorithm for most use cases as it balances exploration and exploitation efficiently. For a budget of 50 trials, Bayesian optimization is suitable.

Answer

No algorithm; use default Vertex AI tuning

Answer

Grid search

Answer

Random search

Question 6

You need to preprocess a large dataset (terabytes) for training a TensorFlow model. The preprocessing includes scaling and bucketizing features, and the same transformations must be applied during serving. Which tool should you use?

Accepted Answer

Dataflow with Apache Beam and tf.Transform. TensorFlow Transform (tf.Transform) allows you to define preprocessing pipelines that are applied consistently during training and serving. It computes statistics over the full dataset and creates a TensorFlow graph for serving.

Answer

Dataproc with Spark ML

Answer

Vertex AI Feature Store

Answer

BigQuery ML

Question 7

You are fine-tuning a pre-trained BERT model from Hugging Face for a sentiment analysis task using Vertex AI training. The dataset has 100k examples. To avoid catastrophic forgetting, which layer freezing strategy should you apply?

Accepted Answer

Unfreeze all layers and fine-tune the entire model. For fine-tuning with a sufficiently large dataset, it is common to unfreeze all layers to adapt the model to the new task. Freezing many layers is typical for very small datasets. With 100k examples, full fine-tuning is appropriate.

Answer

Freeze the first 6 layers, fine-tune the last 6 layers

Answer

Freeze all layers except the classification head

Answer

Use transfer learning only on the embeddings layer

Question 8

Which Vertex AI service allows you to discover, fine-tune, and deploy foundation models with a few clicks, including models like Llama and Gemma?

Accepted Answer

Vertex AI JumpStart. Vertex AI JumpStart (now part of Model Garden) provides one-click deployment and fine-tuning of foundation models. Model Garden is the broader model discovery hub, but JumpStart is the feature for quick start.

Answer

Vertex AI Prediction

Answer

Vertex AI Vizier

Answer

Vertex AI Model Garden

Question 9

You want to deploy a trained scikit-learn model to Vertex AI for online predictions. The model file is 2 GB. Which option should you use?

Accepted Answer

Use a custom container with the scikit-learn model. Vertex AI supports custom containers for deploying models. For scikit-learn, you can use a pre-built container for scikit-learn, but the model size (2 GB) may exceed the default limits; using a custom container gives you more control. However, the pre-built scikit-learn container supports up to 2 GB model size, but it's safer to use a custom container for large models. The recommended approach for scikit-learn >500 MB is to use a custom container.

Answer

Use AI Platform (now Vertex AI) with a large model VM

Answer

Use Cloud Functions to host the model

Answer

Upload the model to Vertex AI Model Registry and deploy using pre-built scikit-learn container

Question 10

You are designing a distributed training job on Vertex AI for a PyTorch model using DataDistributedParallel (DDP). You have 4 nodes, each with 4 GPUs. What is the total number of workers that should be configured in the TF_CONFIG equivalent for PyTorch?

Accepted Answer

16. In PyTorch DDP on Vertex AI, each GPU typically runs one process. With 4 nodes each with 4 GPUs, the world size is 16 (total GPUs). Vertex AI distributed training uses TF_CONFIG to set up the cluster; for PyTorch, you need to set the number of workers to the total number of processes, which is 16.

Answer

4

Answer

8

Answer

1

Question 11

You have an edge device with limited compute resources. You need to deploy a deep learning model for real-time inference. Which model compression technique should you apply to reduce the model size and latency with minimal accuracy loss?

Accepted Answer

Post-training quantization to INT8. Post-training quantization (e.g., INT8) is the easiest and most effective method for reducing model size and latency on edge devices. Quantization-aware training can yield better accuracy but is more complex. Pruning and distillation also help, but quantization often gives the best trade-off.

Answer

Pruning only

Answer

Knowledge distillation only

Answer

Use full precision FP32 to maintain accuracy

Question 12

You want to use Vertex AI Vizier for hyperparameter tuning. You have 2 categorical parameters and 3 continuous parameters. Which algorithm is best suited for this mixed parameter space?

Accepted Answer

Bayesian optimization. Bayesian optimization can handle mixed parameter types. Grid search cannot handle continuous parameters efficiently; random search can, but Bayesian is more sample-efficient.

Answer

Evolutionary algorithm

Answer

Random search

Answer

Grid search

Question 13

You are using tf.Transform to preprocess data at scale. Which TWO services are required to run tf.Transform on Google Cloud? (Choose 2)

Accepted Answer

Dataflow. tf.Transform requires Apache Beam for execution, which on GCP is typically run on Dataflow. The processed data and transform artifacts are stored in Cloud Storage.

Answer

Cloud Functions

Answer

Vertex AI Training

Answer

BigQuery

Question 14

You need to reduce the cost of training a large model on Vertex AI while maintaining fault tolerance. Which THREE actions should you take? (Choose 3)

Accepted Answer

Use spot VMs. Spot VMs are cheaper but can be preempted; using checkpointing and saving to a durable storage (like GCS) allows recovery. Also, using a single node with multiple GPUs may be cheaper than multiple nodes.

Answer

Use MultiWorkerMirroredStrategy

Answer

Use TPUs instead of GPUs

Question 15

You are fine-tuning a Gemma model using Vertex AI JumpStart. You want to combine the fine-tuned model with a custom output layer for a unique task. Which TWO components are required to deploy the combined model? (Choose 2)

Accepted Answer

Vertex AI Model Registry. To customize the output layer, you need a custom container that loads both the fine-tuned base model and your custom head. The model must be registered in Vertex AI Model Registry for deployment.

Answer

Vertex AI Feature Store

Answer

Cloud Run

Answer

Pre-built container for Gemma