NCP-GENL Practice Exam 3 — 20 Questions

Question 1

A team is preparing a mixed-language corpus for continued pretraining of an NVIDIA NeMo Megatron model. The corpus contains English, Japanese, and Arabic documents. Tokenizer analysis shows the current English-centric BPE vocabulary produces very long token sequences for Japanese and Arabic, inflating sequence length and compute cost. The team wants to reduce sequence length for non-English text without retraining the tokenizer from scratch and without degrading English performance. Which data preparation action best achieves this?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Extend the existing BPE vocabulary with additional merges learned from a balanced multilingual sample, then retrain only the embedding and output layers while freezing the rest of the model.. The high token counts for Japanese and Arabic stem from a vocabulary that lacks subword units for those scripts. Extending the BPE vocabulary with multilingual merges shortens their token sequences while preserving English merges, and retraining only the embedding and output layers adapts the new entries without perturbing the pretrained transformer. This lowers compute cost and keeps English behavior stable.

Answer

Lowercase and strip diacritics from all Japanese and Arabic text so that the English-centric vocabulary can represent it more efficiently.

Answer

Transliterate all Japanese and Arabic documents into Latin script using a standard romanization scheme before tokenization.

Answer

Increase the model's maximum sequence length and positional embedding size so that long token sequences for Japanese and Arabic fit without truncation.

Question 2

Which THREE factors significantly influence the memory consumption during LLM fine-tuning? (Choose three)

Accepted Answer

The precision of the optimizer states. Memory consumption is driven by the model parameters, the optimizer states (which are often larger than the model weights), and the activations generated during the forward pass. Efficient management of these components is critical for scaling to larger models. By optimizing these three areas, practitioners can successfully fit large models into limited VRAM, ensuring stability throughout the fine-tuning process.

Answer

The number of CPU cores available for data loading

Answer

The version of the operating system kernel

Question 3

A bank's model risk committee is reviewing an LLM-based loan-adverse-action notice generator built on NVIDIA NeMo. Regulators require that the system produce a human-readable rationale for each denial and that the rationale be reproducible for any prior decision. Which architectural choice most directly meets both obligations?

Accepted Answer

Persist the exact prompt, model version, decoding parameters, retrieved context, and random seed for every decision so the notice can be regenerated identically.. Auditable generative decisions require capturing the full provenance chain: prompt, model version, decoding configuration, retrieval context, and seed. Storing those artifacts lets the bank reconstruct any prior notice byte-for-byte during an examination while keeping the natural-language rationale the regulation demands. Changing the model class, raising temperature, or merely caching outputs each fails one of the two obligations the committee must satisfy.

Answer

Increase the model temperature so the generator explores multiple rationales and select the most favorable one for each applicant.

Answer

Cache the generated notice text in a database keyed by applicant ID and serve the cached copy whenever the same applicant is re-scored.

Answer

Replace the LLM with a logistic regression scorecard so that every denial has a coefficient-based explanation by construction.

Question 4

When evaluating an LLM's response to a complex prompt, what is the 'Persona Adoption' technique?

Accepted Answer

A method to assign an expert identity to improve response quality.. Persona adoption involves assigning a specific role, expertise level, or professional identity to the LLM within the system prompt. This technique helps calibrate the tone, vocabulary, and depth of the response to match the user's expectations. For NVIDIA applications, this ensures that the model speaks with the authority and technical precision required for engineering and developer-facing communications.

Answer

A method to verify if the model has memorized personal data.

Answer

A way to force the model to identify the user's persona.

Answer

A technique to reduce the model's context window usage.

Question 5

A company is using NVIDIA NeMo Guardrails to enforce safety policies in its LLM application. A developer wants to ensure that the model does not generate content that violates the company's policy against discussing competitor products. Which type of guardrail should the developer configure to prevent the model from mentioning competitor names in its responses?

Accepted Answer

Output rail that detects and blocks responses containing competitor names. To prevent the model from generating competitor names in its responses, the developer should use an output rail. Output rails in NeMo Guardrails inspect the LLM's response and can block or modify it based on defined policies. Input, dialog, and retrieval rails address other parts of the pipeline and do not directly control the final output content.

Answer

Input rail that filters user queries containing competitor names

Answer

Dialog rail that redirects the conversation if a competitor is mentioned

Answer

Retrieval rail that filters the knowledge base for competitor information

Question 6

Which of the following describes the purpose of 'Kernel Fusion' in the context of optimizing a Deep Learning inference pipeline?

Accepted Answer

To reduce redundant global memory read/write cycles.. Kernel fusion combines multiple small operations into a single GPU kernel to reduce the overhead of launching kernels and accessing global memory. Every kernel launch involves CPU-side overhead, and global memory accesses are costly in terms of energy and time. Fusion minimizes both, significantly increasing the effective throughput of the GPU by keeping data in high-speed, on-chip storage for as long as possible.

Answer

To increase the number of parallel GPU threads.

Answer

To enable multi-GPU distributed training.

Answer

To improve model accuracy through extra precision.

Question 7

An engineer is deploying a 70B parameter model and needs to serve many concurrent users on a single GPU with limited memory. They want to store the attention keys and values for past tokens efficiently so that generation does not recompute them at every step. Which technique should they implement?

Accepted Answer

A key-value cache that stores the projected keys and values for previously processed tokens.. Autoregressive decoding generates one token at a time, and without caching the model would recompute keys and values for the entire prefix at every step, wasting compute. A key-value cache stores those projections so each step only processes the new token, which is the standard way to make long-context generation practical.

Answer

Quantization-aware training that reduces weight precision before deployment.

Answer

Speculative decoding that uses a smaller draft model to propose tokens.

Answer

Gradient checkpointing that recomputes activations during the backward pass.

Question 8

What is the primary function of the 'TensorRT' optimization engine in the NVIDIA AI software stack?

Accepted Answer

It performs architecture-specific model optimization.. TensorRT optimizes neural network models by performing layer fusion, precision calibration (e.g., to FP8 or INT8), and kernel selection optimized for the specific GPU architecture. By transforming the model into a highly efficient, platform-specific format, TensorRT significantly reduces latency and increases throughput for production inference. It is the core tool for moving from research-grade PyTorch models to production-ready deployments on NVIDIA hardware.

Answer

It automates the training of complex models.

Answer

It provides a Python API for model debugging.

Answer

It converts models to run on mobile CPUs.

Question 9

Refer to the exhibit. The engineer is attempting to deploy on an NVIDIA Orin platform but encounters a runtime error. What is the most likely cause of the failure?

Accepted Answer

Unsupported operators are being targeted for the DLA. The inclusion of '--dla 0' forces the engine to run on the Deep Learning Accelerator (DLA) core. Many complex LLM operations, such as specific activation functions or advanced attention mechanisms, are not supported by the DLA's fixed-function logic. If the model graph contains unsupported operators, the build will either fail or generate a non-functional plan, as the DLA has a more restricted operator set than the primary GPU cores.

Answer

The workspace memory is too large

Answer

The DLA hardware is not enabled on this device

Answer

FP16 precision is not supported on DLA

Question 10

In the context of the Transformer architecture, what is the primary function of the Feed-Forward Network (FFN) layers applied after the attention mechanism?

Accepted Answer

To process the hidden state representations with non-linear activations.. The FFN layers provide non-linear transformations that allow the model to process information extracted by the attention mechanism. While attention focuses on relationships between tokens, the FFN applies point-wise non-linearities to project these features into higher-dimensional spaces. This is essential for learning complex representations and mappings that ultimately drive the model's predictive accuracy and reasoning capabilities across diverse input patterns.

Answer

To calculate the attention scores between different tokens in the sequence.

Answer

To manage the memory allocation for the KV cache during multi-token generation.

Answer

To reduce the sequence length of the input tokens to a fixed size.

Question 11

Refer to the exhibit. Which adjustment is the most immediate and effective way to resolve this OOM error while maintaining the same training architecture?

Accepted Answer

Decrease the batch size per GPU.. The error indicates that the current batch size is too large for the available VRAM. Reducing the batch size is the most direct solution to free up enough memory for the model to continue training. If a larger effective batch size is required for convergence, the user can subsequently enable gradient accumulation to compensate for the reduced per-step batch size without increasing the memory footprint.

Answer

Increase the sequence length of the inputs.

Answer

Switch from mixed precision to full FP32 precision.

Answer

Disable the optimizer state checkpointing.

Question 12

Which optimization method should be prioritized when the model's inference performance is bottlenecked by the CPU-to-GPU data transfer overhead?

Accepted Answer

GPU-based Pre-processing. When data transfer between the host and GPU is the bottleneck, the most effective strategy is to move the pre-processing logic onto the GPU itself. Using CUDA-accelerated kernels to perform operations like tokenization or normalization directly on the GPU avoids moving data across the PCIe bus, which is a slow operation that stalls the GPU during the inference pipeline.

Answer

Quantization

Answer

Model Pruning

Answer

Operator Fusion

Question 13

A team is fine-tuning a 13B-parameter Llama model with NVIDIA NeMo Framework on a single A100 80GB GPU. They apply LoRA adapters to the attention projection layers, but the adapters are producing negligible changes to model behavior even after several epochs, and the loss curve stays flat. They confirm the dataset is clean and the tokenizer is correct. Which LoRA configuration issue is the most likely cause?

Accepted Answer

The LoRA alpha scaling value is set extremely low relative to the rank, so the adapter's effective update magnitude is near zero.. LoRA updates are scaled by alpha divided by rank, so an alpha that is very small relative to rank shrinks the adapter's effective contribution and can leave the loss nearly unchanged. Correcting the alpha-to-rank ratio restores meaningful adapter influence, allowing the fine-tune to actually shift model behavior on the target task.

Answer

The optimizer was configured with a momentum value of zero, preventing the adapter weights from accumulating updates.

Answer

The LoRA target modules were set to the embedding layer rather than the attention projection layers.

Answer

The base model weights were accidentally left trainable, so gradients are flowing into the full model instead of the adapters.

Question 14

An enterprise deploying a large language model on an NVIDIA A100 GPU experiences high memory bandwidth bottlenecks during autoregressive token generation. Which optimization technique specifically addresses this memory-bound phase by merging element-wise operations and reducing global memory round-trips?

Accepted Answer

Enabling TensorRT-LLM custom kernel fusion for multi-head attention and activation blocks.. Kernel fusion combines multiple successive GPU operations, such as bias additions and activations, into a single CUDA kernel. This drastically reduces high-latency global memory read and write operations, directly mitigating the memory bandwidth bottleneck characteristic of autoregressive transformer decoding phases on NVIDIA hardware.

Answer

Applying static INT8 post-training quantization to all linear layers.

Answer

Increasing the global batch size to maximize arithmetic intensity.

Answer

Switching from FlashAttention to standard vanilla self-attention mechanisms.

Question 15

Which hardware component of an NVIDIA GPU is most responsible for accelerating matrix-multiply-accumulate (MMA) operations used in transformer layers?

Accepted Answer

Tensor Cores.. Tensor Cores are specialized hardware units designed to perform high-speed matrix-multiply-accumulate operations in a single clock cycle. By accelerating these core operations, Tensor Cores provide the massive compute throughput needed for deep learning. Understanding the role of Tensor Cores is vital because they define the performance limits for modern LLMs, and optimizing code to utilize them is the single most important task in GPU performance tuning.

Answer

CUDA Cores.

Answer

Streaming Multiprocessor (SM) Scheduler.

Answer

L2 Cache controller.

Question 16

Which prompt engineering strategy helps the model maintain focus when processing an extremely long document within a single context window?

Accepted Answer

Instruct the model to analyze the document in sections and summarize each.. Long context windows can lead to the 'Lost in the Middle' phenomenon, where the model performs better on the beginning and end of the document but ignores the middle. Using 'attention-focusing' instructions or prompting the model to summarize segments before synthesizing a final answer helps maintain performance across the entire document. This is critical for NVIDIA engineers working with large-scale technical whitepapers and documentation.

Answer

Always increase the model's temperature to 1.0.

Answer

Remove all system-level instructions to save tokens.

Answer

Limit the context window size to 1024 tokens.

Question 17

An enterprise is fine-tuning a large language model using NVIDIA NeMo Framework and encounters GPU out-of-memory errors during the backward pass. The training configuration already uses mixed-precision training (FP16). Which architectural intervention should be applied to resolve memory pressure while retaining the optimizer state precision?

Accepted Answer

Implement activation checkpointing to recompute intermediate activations during backward passes.. Applying activation checkpointing trades off compute for memory by recalculating activations during the backward pass instead of storing them all. This directly mitigates out-of-memory errors on NVIDIA GPUs during LLM fine-tuning without requiring a reduction in batch size or model accuracy, making it a standard best practice in NeMo Framework workflows.

Answer

Switch the global precision setting from FP16 to INT8 quantization.

Answer

Disable gradient accumulation completely to process each micro-batch independently.

Answer

Migrate the optimizer states from FP32 to FP8 format.

Question 18

Refer to the exhibit. What is the most likely cause of the failure based on the log entries?

Accepted Answer

The KV cache size is exceeding the allocated GPU memory limit.. The logs indicate high processing latency followed by KV cache eviction and finally an OOM error. This sequence suggests that the system is running out of VRAM due to the growing KV cache during long-context generation. As the context length increases, the memory required for the KV cache exceeds the available capacity, forcing evictions, slowing down processing, and ultimately triggering an Out of Memory crash.

Answer

The model weights are corrupted in the repository.

Answer

Network latency is causing the client-side timeout.

Answer

The GPU driver version is incompatible with TensorRT.

Question 19

In the context of LLM deployment, why is it recommended to use a dedicated inference server like Triton rather than a basic Flask or FastAPI wrapper?

Accepted Answer

Triton manages concurrent model execution and hardware utilization.. While basic web frameworks are easy to implement, they lack the sophisticated features required for production AI. Triton offers hardware-optimized concurrency, automatic dynamic batching, support for multiple backends (TensorRT, PyTorch, ONNX), and advanced metrics. These features are critical for handling the high computational demands and low-latency requirements of LLMs, providing better scalability and reliability compared to custom-built wrappers that do not natively manage GPU streams and queues.

Answer

Flask is incompatible with the NVIDIA CUDA drivers.

Answer

Custom wrappers require more memory than Triton servers.

Answer

Triton is the only way to support REST API endpoints.

Question 20

What is the primary function of data 'normalization' in the context of preparing inputs for a Transformer model?

Accepted Answer

Standardizing the text to ensure consistent interpretation of tokens.. Normalization, such as standardizing whitespace, handling special tokens, and ensuring consistent character encodings, ensures that the model interprets input text in a predictable manner. By removing noise that doesn't contribute to semantic meaning, the model can focus its capacity on learning complex linguistic patterns. This is a standard and essential step in any high-performance AI data pipeline using NVIDIA accelerated computing.

Answer

Increasing the complexity of the input text to help the model learn more features.

Answer

Encrypting the dataset to protect sensitive information during training.

Answer

Compressing the dataset to reduce storage space on the GPU disk.