NCP-GENL Practice Test 23 — 15 Questions

Question 1

Refer to the exhibit. The model is encountering an OOM error during long-context processing. Which architectural adjustment is most appropriate to resolve this while maintaining context length?

Accepted Answer

Switch to FlashAttention-2 kernels to optimize memory usage.. When sequence lengths scale to 128k, the attention matrix size grows quadratically, consuming massive memory. Implementing FlashAttention-2 or similar memory-efficient attention kernels is the industry-standard solution. These kernels optimize the memory layout and tile operations to compute attention without materializing the massive N×N matrix, drastically reducing peak memory usage and enabling the processing of very long sequences within existing GPU capacity.

Answer

Increase the number of hidden layers.

Answer

Reduce the embedding dimension size.

Answer

Disable the KV cache entirely.

Question 2

Which of the following describes the purpose of a 'System Prompt' in Instruction Fine-Tuning?

Accepted Answer

To act as a persistent instruction defining the model's persona. The system prompt provides a high-level instruction or persona for the model, which guides its overall behavior throughout the conversation. It sets expectations for tone, safety constraints, and task-specific roles. Effectively designing the system prompt is essential for ensuring that the fine-tuned model consistently adheres to the required persona or operational boundaries in real-world production deployments.

Answer

To increase the number of tokens processed in the output

Answer

To replace the need for domain-specific fine-tuning entirely

Answer

To compress the training dataset size

Question 3

In the context of NVIDIA Tensor Cores, what is the primary benefit of using BF16 (Bfloat16) over FP16 during model training and inference?

Accepted Answer

BF16 offers a larger dynamic range for gradients.. BF16 uses the same exponent range as FP32, which prevents overflow issues commonly encountered in deep learning training when using FP16. This increased dynamic range makes it more robust for gradient calculations and weight updates. By providing a wider range while maintaining the same performance advantages of half-precision, BF16 has become the industry standard for stabilizing training and inference of modern large language models.

Answer

BF16 provides double the precision of FP16.

Answer

BF16 requires significantly less memory than FP16.

Answer

BF16 is faster on non-NVIDIA hardware.

Question 4

Refer to the exhibit. What prompt engineering strategy ensures the model consistently maintains its persona and technical expertise throughout this multi-turn dialogue?

Accepted Answer

Use a persistent system prompt that defines the persona and constraints.. In multi-turn conversations, the model can 'drift' away from its original instructions. Re-affirming constraints or using a 'System Prompt' that is explicitly included in the context of every turn is critical. For an NVIDIA code optimizer, the model must maintain its technical persona, specifically focusing on CUDA performance, regardless of how complex the dialogue becomes, ensuring the expertise level remains consistent throughout.

Answer

Append the persona instruction to every user turn.

Answer

Increase the temperature to 1.0 to keep the model 'active'.

Answer

Force the model to provide a summary of its own persona at the end of each turn.

Question 5

Which architectural component is responsible for projecting the model's hidden states back into the vocabulary space to predict the next token?

Accepted Answer

The LM Head linear layer.. The language model head (LM Head) is a final linear projection layer that maps the high-dimensional hidden states from the Transformer blocks into a vector representing the probability distribution over the entire vocabulary. This projection is the final step in the forward pass, converting the learned internal representation into actionable predictions that can be sampled to generate text.

Answer

The Feed-Forward Network.

Answer

The Softmax normalization layer.

Answer

The positional embedding layer.

Question 6

Which of the following is considered a best practice for logging in a production LLM environment?

Accepted Answer

Using structured JSON logs. Structured logging (typically in JSON format) is the gold standard for production environments because it allows for efficient searching, indexing, and automated analysis. In LLM applications, keeping track of request metadata, model versions, and latency in a structured way is essential for debugging and auditing. This approach enables operations teams to quickly correlate specific issues with model outputs and performance metrics across thousands of requests.

Answer

Logging only full chat transcripts

Answer

Logging all data to standard output only

Answer

Disabling logging to save disk space

Question 7

Refer to the exhibit. You are reviewing the configuration file for a data preprocessing pipeline. Why is the 'min_words' filter set to 50 in the context of LLM training?

Accepted Answer

It removes low-quality snippets to ensure meaningful semantic context.. The 'min_words' filter removes low-information or malformed snippets that lack sufficient context for effective transformer learning. In large-scale training, such as those performed on NVIDIA H100 GPU clusters, including very short strings increases noise and consumes valuable compute cycles without contributing to meaningful semantic representation. Setting a minimum length ensures the model learns from coherent passages rather than disjointed fragments, promoting better structural understanding of the training corpus.

Answer

It limits the memory footprint of the dataloader.

Answer

It enables faster tokenization by reducing the number of input files.

Answer

It forces the model to ignore PII-heavy documents.

Question 8

In the context of NVIDIA NeMo, why is it recommended to use FP8 precision during the fine-tuning process on H100 GPUs?

Accepted Answer

It significantly improves memory throughput and speed via Hopper-specific hardware.. FP8 precision leverages the Transformer Engine on NVIDIA Hopper architecture, providing a significant boost in throughput while reducing memory usage. By using FP8, developers can fit larger models or increase batch sizes without sacrificing significant numerical stability. This optimization is essential for modern fine-tuning workflows where computational efficiency directly impacts the speed of iteration and the scalability of training across multi-GPU nodes in an enterprise environment.

Answer

It guarantees 100% precision parity with full-precision floating-point training.

Answer

It disables the need for gradient scaling during the backward pass.

Answer

It forces the model to use only CPU-based memory for training weights.

Question 9

A media company is using a large language model to generate news article headlines. They want to evaluate the diversity of the generated headlines to ensure they are not overly repetitive. Which metric should they use to quantify the lexical diversity of the generated headlines?

Accepted Answer

Distinct-n. Distinct-n is a metric that calculates the proportion of unique n-grams in the generated text, directly quantifying lexical diversity. It is commonly used to evaluate repetition in generated outputs. BLEU, ROUGE-L, and perplexity assess translation quality, summarization overlap, or fluency, respectively, and do not measure diversity across multiple generations. Therefore, Distinct-n is the correct choice.

Answer

Perplexity

Answer

ROUGE-L

Answer

BLEU

Question 10

In the context of NVIDIA AI Enterprise, what is the primary purpose of using 'NVIDIA Triton Model Analyzer'?

Accepted Answer

To automate performance optimization and configuration. The Model Analyzer is a critical tool for determining the optimal configuration for models deployed on Triton Inference Server. By automating the testing of various batch sizes and concurrency levels, it ensures that models are tuned for maximum throughput and minimum latency. This tuning is essential for maintaining reliability and cost-efficiency in large-scale production, preventing performance degradation caused by suboptimal configuration settings that often go unnoticed in manual deployments.

Answer

To perform real-time model training

Answer

To detect GPU hardware failures

Answer

To encrypt model weights at rest

Question 11

Which THREE factors should be considered when choosing an optimal batch size for LLM inference on NVIDIA GPUs?

Accepted Answer

Available GPU VRAM. Selecting an optimal batch size involves a balance between hardware saturation, memory capacity, and latency requirements. Larger batches improve throughput by better utilizing GPU compute cores but increase memory demand and individual request latency. The goal is to reach the highest throughput possible while staying within the VRAM limit and meeting the required latency SLA for the specific application.

Answer

Model Training Loss

Answer

CPU Clock Speed

Question 12

You are evaluating a text generation model using NVIDIA NeMo Evaluation and want to measure how well the generated text matches a reference translation. Which metric is specifically designed for this purpose?

Accepted Answer

BLEU. BLEU is the standard metric for machine translation, measuring n-gram precision with a brevity penalty. It directly compares generated text to reference translations. Perplexity measures fluency without references, ROUGE is for summarization, and METEOR, while translation-oriented, is less commonly used in NeMo Evaluation. Thus, BLEU is the correct metric for this scenario.

Answer

METEOR

Answer

Perplexity

Answer

ROUGE

Question 13

A startup is deploying a small LLM for a chatbot on a single NVIDIA L4 GPU using NVIDIA Triton Inference Server. They want to ensure the model is automatically loaded when Triton starts and can be updated without restarting the server. Which Triton feature should they configure?

Accepted Answer

Model repository with version policy and model control API.. The model repository with version policy allows Triton to automatically load models at startup, and the model control API enables loading and unloading models at runtime. This combination provides both automatic initialization and dynamic updates without server restarts. Other options address inference scheduling or parallelism, not model lifecycle management.

Answer

Instance groups with multiple model instances per GPU.

Answer

Dynamic batching with preferred batch sizes.

Answer

Ensemble scheduler with a custom preprocessing model.

Question 14

A research team is evaluating a large language model's robustness to adversarial attacks. They want to use NVIDIA NeMo Evaluator to measure how often the model's output changes when small, semantically preserving perturbations are applied to input prompts. Which evaluation metric or method should they implement?

Accepted Answer

Calculate the semantic similarity between the two outputs using an embedding-based metric like BERTScore.. To measure robustness to semantically preserving perturbations, the team should compare the semantic similarity of outputs from original and perturbed inputs. BERTScore provides a semantic similarity score, making it suitable. BLEU and exact match are lexical and too brittle, while perplexity does not assess output consistency.

Answer

Use exact match to compare the outputs from original and perturbed prompts.

Answer

Measure the perplexity of the model on the perturbed prompts.

Answer

Compute the BLEU score between outputs from original and perturbed prompts.

Question 15

A team is preparing a Llama-based chatbot for production and wants to reduce GPU memory and latency without retraining. They decide to apply post-training quantization. Which TensorRT-LLM workflow correctly produces an INT8 or FP8 quantized engine from an existing FP16 checkpoint?

Accepted Answer

Run the quantization toolkit to produce a quantized checkpoint, then build the TensorRT-LLM engine with the appropriate quantization flags.. Post-training quantization in TensorRT-LLM is a two-stage process: first produce a quantized checkpoint with calibration or scaling data, then build the engine with the matching quantization flags so the builder selects INT8 or FP8 kernels. This avoids retraining and yields memory and latency improvements. The other options either attempt unsupported post-build modification, rely on runtime precision switching that does not exist, or bypass the required engine compilation step.

Answer

Build the FP16 engine first, then apply a post-build conversion script that rewrites the engine plan to INT8 weights.

Answer

Convert the checkpoint to ONNX with INT8 operators and load it directly into the TensorRT-LLM runtime without an engine build.

Answer

Enable automatic mixed precision in the runtime and let the inference server choose INT8 kernels dynamically at request time.