NCP-GENL Fine-Tuning Practice Test 2 — 15 Questions

Question 1

Which THREE factors significantly influence the memory consumption during LLM fine-tuning? (Choose three)

Accepted Answer

The precision of the optimizer states. Memory consumption is driven by the model parameters, the optimizer states (which are often larger than the model weights), and the activations generated during the forward pass. Efficient management of these components is critical for scaling to larger models. By optimizing these three areas, practitioners can successfully fit large models into limited VRAM, ensuring stability throughout the fine-tuning process.

Answer

The number of CPU cores available for data loading

Answer

The version of the operating system kernel

Question 2

What is the primary function of the 'rank' parameter in LoRA?

Accepted Answer

It defines the dimension of the low-rank decomposition. The rank parameter ('r') determines the dimensionality of the update matrices injected into the model. A lower rank results in a smaller number of trainable parameters, which is more efficient but less expressive. A higher rank allows for more complex adaptations to the data. Balancing this rank is essential to achieve the desired model performance while staying within hardware memory limits.

Answer

It sets the total number of layers that are trainable

Answer

It dictates the number of epochs the model will train

Answer

It determines the learning rate for the adapter weights

Question 3

Why is gradient checkpointing useful when fine-tuning a model on a single GPU?

Accepted Answer

It saves GPU memory by recomputing activations during the backward pass. Gradient checkpointing trades computation for memory by not storing all intermediate activations during the forward pass. Instead, it recomputes them during the backward pass. This is extremely valuable when working on hardware with limited VRAM, as it allows for larger batch sizes or longer sequences that would otherwise cause OOM errors, though it does increase the total training time slightly due to the recomputation overhead.

Answer

It speeds up the training process by calculating gradients in parallel

Answer

It automatically adjusts the learning rate for each layer

Answer

It prevents the model from using the CPU during training

Question 4

Refer to the exhibit. What is the effective batch size for this fine-tuning job?

Accepted Answer

16. The effective batch size is calculated by multiplying the per-device batch size by the gradient accumulation steps. In this case, 1 * 16 equals 16. Gradient accumulation allows the model to simulate a larger batch size by running multiple forward and backward passes before performing a single optimizer step, which helps in achieving more stable gradient updates without increasing the immediate memory overhead for activations.

Answer

1

Answer

15

Answer

17

Question 5

Which of the following describes the purpose of a 'System Prompt' in Instruction Fine-Tuning?

Accepted Answer

To act as a persistent instruction defining the model's persona. The system prompt provides a high-level instruction or persona for the model, which guides its overall behavior throughout the conversation. It sets expectations for tone, safety constraints, and task-specific roles. Effectively designing the system prompt is essential for ensuring that the fine-tuned model consistently adheres to the required persona or operational boundaries in real-world production deployments.

Answer

To increase the number of tokens processed in the output

Answer

To replace the need for domain-specific fine-tuning entirely

Answer

To compress the training dataset size

Question 6

What is the primary role of the 'Learning Rate Scheduler' during LLM fine-tuning?

Accepted Answer

To control the weight updates over the training duration. A scheduler adjusts the learning rate throughout the training process, typically starting with a warmup phase to stabilize the weights and then decaying the rate to allow for fine-grained convergence. This prevents the model from overshooting optimal solutions early on and helps it settle into a good local minimum, which is critical for achieving high-quality results without divergence.

Answer

To increase the batch size dynamically

Answer

To automatically detect the optimal training loss

Answer

To determine which layers should be frozen

Question 7

Refer to the exhibit. In the context of a distributed multi-GPU fine-tuning job, what is the most likely cause of this error?

Accepted Answer

The MASTER_ADDR or MASTER_PORT environment variables are misconfigured. This error indicates that the NCCL (NVIDIA Collective Communications Library) is failing to communicate between GPU nodes or processes. It is typically caused by a misconfiguration of the environment variables (like MASTER_ADDR or MASTER_PORT) or a firewall blocking the necessary ports. In distributed training, these network configurations are essential for synchronizing gradients across all participating GPUs during the training process.

Answer

The model weights are too large for the GPU memory

Answer

The learning rate is too high, causing gradient explosion

Answer

The dataset is missing required training samples

Question 8

An enterprise is fine-tuning a large language model using NVIDIA NeMo Framework and encounters GPU out-of-memory errors during the backward pass. The training configuration already uses mixed-precision training (FP16). Which architectural intervention should be applied to resolve memory pressure while retaining the optimizer state precision?

Accepted Answer

Implement activation checkpointing to recompute intermediate activations during backward passes.. Applying activation checkpointing trades off compute for memory by recalculating activations during the backward pass instead of storing them all. This directly mitigates out-of-memory errors on NVIDIA GPUs during LLM fine-tuning without requiring a reduction in batch size or model accuracy, making it a standard best practice in NeMo Framework workflows.

Answer

Switch the global precision setting from FP16 to INT8 quantization.

Answer

Disable gradient accumulation completely to process each micro-batch independently.

Answer

Migrate the optimizer states from FP32 to FP8 format.

Question 9

When fine-tuning a base LLM using Parameter-Efficient Fine-Tuning (PEFT) on an NVIDIA H100 GPU, what is the primary advantage of utilizing LoRA compared to full fine-tuning?

Accepted Answer

It reduces the memory footprint by freezing base weights and training only low-rank adapter matrices.. LoRA reduces memory overhead by freezing pre-trained model weights and injecting trainable rank-decomposition matrices into transformer layers. This approach significantly lowers the VRAM requirements, enabling fine-tuning on consumer or enterprise hardware without needing to load the entire parameter set into the optimizer state. This method is critical for deploying domain-specific models efficiently while maintaining performance parity with full fine-tuning, thus optimizing resource utilization across high-performance NVIDIA compute clusters.

Answer

It increases the number of trainable parameters to improve model convergence speed.

Answer

It eliminates the need for any gradient calculation during the backpropagation process.

Answer

It forces the model to ignore long-range dependencies to accelerate training time.

Question 10

Refer to the exhibit. An engineer observes that a model fine-tuned with this LoRA configuration is failing to converge on a highly complex legal document domain. What is the most likely cause of this issue?

Accepted Answer

The rank value is too low to represent the complex patterns of the domain.. The rank of 8 is likely too low for capturing the intricate, nuanced patterns required for legal documentation. While low-rank adaptation is efficient, complex domains often necessitate higher rank values to provide enough expressive capacity within the trainable adapter layers. This configuration mismatch limits the model's ability to learn the specific syntactic and semantic structures inherent in specialized legal texts, leading to poor convergence and inadequate performance.

Answer

The dropout value is set too high, causing the model to underfit.

Answer

The target modules are incorrectly specified, leading to a loss of attention.

Answer

The alpha parameter is too high, causing gradient explosion.

Question 11

In the context of NVIDIA NeMo, why is it recommended to use FP8 precision during the fine-tuning process on H100 GPUs?

Accepted Answer

It significantly improves memory throughput and speed via Hopper-specific hardware.. FP8 precision leverages the Transformer Engine on NVIDIA Hopper architecture, providing a significant boost in throughput while reducing memory usage. By using FP8, developers can fit larger models or increase batch sizes without sacrificing significant numerical stability. This optimization is essential for modern fine-tuning workflows where computational efficiency directly impacts the speed of iteration and the scalability of training across multi-GPU nodes in an enterprise environment.

Answer

It guarantees 100% precision parity with full-precision floating-point training.

Answer

It disables the need for gradient scaling during the backward pass.

Answer

It forces the model to use only CPU-based memory for training weights.

Question 12

Which metric is the most reliable indicator that an LLM is overfitting during the fine-tuning phase?

Accepted Answer

A decrease in training loss with a simultaneous increase in validation loss.. An increasing validation loss alongside a decreasing training loss is the classic indicator of overfitting. The model is essentially memorizing the training samples rather than learning generalized language patterns. Monitoring this divergence is critical in NVIDIA-based training pipelines, as it allows researchers to implement early stopping or adjust regularization strategies before the model's performance on unseen tasks degrades significantly.

Answer

A consistent increase in both training and validation loss.

Answer

A plateau in the training loss while the validation loss remains stagnant.

Answer

The model generates text that matches the training set exactly.

Question 13

Which of the following describes the purpose of 'gradient accumulation' in fine-tuning scenarios?

Accepted Answer

To enable training with larger effective batch sizes on memory-constrained hardware.. Gradient accumulation allows for simulating larger batch sizes when GPU VRAM is limited. By performing multiple forward and backward passes without updating the weights, the model can aggregate gradients across several smaller steps. This is crucial when working on hardware with restricted memory, as it enables the model to benefit from the statistical stability of larger batches, improving the overall quality of the fine-tuned model's convergence.

Answer

To increase the speed of the training process by bypassing the GPU's bottleneck.

Answer

To automatically optimize the learning rate based on the model's gradient magnitude.

Answer

To reduce the number of parameters being fine-tuned in the model.

Question 14

Refer to the exhibit. Which adjustment is the most immediate and effective way to resolve this OOM error while maintaining the same training architecture?

Accepted Answer

Decrease the batch size per GPU.. The error indicates that the current batch size is too large for the available VRAM. Reducing the batch size is the most direct solution to free up enough memory for the model to continue training. If a larger effective batch size is required for convergence, the user can subsequently enable gradient accumulation to compensate for the reduced per-step batch size without increasing the memory footprint.

Answer

Increase the sequence length of the inputs.

Answer

Switch from mixed precision to full FP32 precision.

Answer

Disable the optimizer state checkpointing.

Question 15

Which component in the NVIDIA NeMo framework is specifically designed to manage the configuration and orchestration of large-scale fine-tuning jobs?

Accepted Answer

NeMo Framework Launcher. The NeMo Framework Launcher is the dedicated tool for managing multi-node, large-scale training jobs. It abstracts the complexities of cluster scheduling, environment setup, and hyperparameter management. By using the launcher, engineers ensure that fine-tuning tasks are executed efficiently across NVIDIA compute clusters, allowing for reproducible and scalable experiments that align with enterprise-grade development standards and best practices for large model management.

Answer

TensorRT-LLM

Answer

NVIDIA Triton Inference Server

Answer

CUDA Toolkit