NCP-GENL Practice Test 2 — 30 Questions

Question 1

A global bank runs an NVIDIA NeMo Guardrails-protected assistant for its tellers. During a compliance audit, the auditor asks how the bank can prove that the guardrail configuration itself has not been silently altered between releases. Which practice best satisfies this requirement?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Store the Colang guardrail files and their configuration in a version-controlled repository with signed commits, and record the commit hash in the deployment manifest.. Guardrail integrity is a configuration-management problem, not an inference or logging problem. Signed, version-controlled Colang files with commit hashes recorded in the deployment manifest give auditors a verifiable, reproducible record of exactly which safety rules were active. This is the only approach that can detect silent tampering and withstand regulatory scrutiny.

Answer

Ask the model to self-report at startup which guardrails it believes are enabled, and archive that self-report as evidence.

Answer

Rely on the NVIDIA NIM container image digest alone, because the guardrail policy is compiled into the model weights.

Answer

Enable verbose logging of every user prompt and model response so the auditor can infer the guardrail rules from observed behavior.

Question 2

A team is optimizing an NVIDIA TensorRT-LLM deployment of a 70B model on multiple GPUs. They want to reduce inter-GPU communication overhead and improve throughput. Which two techniques should they consider? (Choose two.)

Accepted Answer

Enable pipeline parallelism to split layers into stages.. Tensor parallelism benefits from NVLink's high bandwidth to reduce all-reduce overhead, while pipeline parallelism lowers communication frequency by staging layers across GPUs. Together they address the communication bottleneck for large multi-GPU models. KV cache block size, disabling in-flight batching, and FP32 precision do not reduce inter-GPU communication and can hurt throughput.

Answer

Disable in-flight batching to simplify scheduling.

Answer

Use FP32 precision for all weights to improve numerical stability.

Answer

Increase the KV cache block size to 256 tokens.

Question 3

You are preparing a dataset for supervised fine-tuning (SFT) of an NVIDIA NeMo LLM to follow instructions. Which TWO data preparation practices are essential to ensure the model learns to generalize rather than memorize? (Choose two.)

Accepted Answer

Include a diverse set of instruction types and domains in the training data rather than repeating a few templates.. Disjoint data splits prevent leakage and give honest evaluation, while diverse instruction types and domains teach the model to follow instructions generally rather than memorize templates. Together, these practices reduce overfitting and improve generalization. The other options either fail to address memorization, actively encourage it, or unnecessarily restrict the data distribution.

Answer

Increase the learning rate significantly to force the model to escape memorization of individual examples.

Answer

Duplicate the most common instruction-response pairs to reinforce the desired behavior.

Answer

Use only English instructions to simplify tokenization and avoid multilingual complexity.

Question 4

Why is gradient checkpointing useful when fine-tuning a model on a single GPU?

Accepted Answer

It saves GPU memory by recomputing activations during the backward pass. Gradient checkpointing trades computation for memory by not storing all intermediate activations during the forward pass. Instead, it recomputes them during the backward pass. This is extremely valuable when working on hardware with limited VRAM, as it allows for larger batch sizes or longer sequences that would otherwise cause OOM errors, though it does increase the total training time slightly due to the recomputation overhead.

Answer

It speeds up the training process by calculating gradients in parallel

Answer

It automatically adjusts the learning rate for each layer

Answer

It prevents the model from using the CPU during training

Question 5

Which strategy is most effective for optimizing an LLM that is too large to fit into a single GPU's VRAM?

Accepted Answer

Implement tensor parallelism. Model parallelism, specifically tensor parallelism, is the standard approach for splitting a large model across multiple GPUs. By partitioning individual layers across different devices, the computation can be distributed, and the total memory requirement is spread proportionally. This allows for the deployment of models that exceed the capacity of a single GPU, enabling high-performance inference for massive parameter models that would otherwise be impossible to load.

Answer

Increase the inference batch size

Answer

Apply dynamic quantization to the weights

Answer

Convert the model to a CPU-only format

Question 6

Refer to the exhibit. An engineer receives these logs while converting a Transformer model to a TensorRT engine. What is the most appropriate action to resolve this build failure?

Accepted Answer

Increase the builder workspace size. The error indicates that the workspace memory allocated to the TensorRT builder is insufficient to explore the search space of kernels for specific operations. Increasing the workspace size allows the builder to allocate larger temporary memory buffers, which is necessary for complex Transformer operations that require high-memory intermediate calculations to optimize effectively on NVIDIA hardware.

Answer

Reduce the input batch size

Answer

Switch to a smaller base model

Answer

Disable INT8 calibration

Question 7

Refer to the exhibit. An engineer observes that memory utilization spikes during inference, causing OOM errors. Given the configuration, what is the most likely cause of the failure?

Accepted Answer

The instance group count of 2 causes redundant loading of weights, exceeding VRAM.. The instance group configuration defines two concurrent instances on the same GPU. Each instance attempts to load a separate copy of the model weights into the GPU memory. If the model size is large, doubling the instances exceeds the available VRAM capacity. This configuration is a common mistake when deploying LLMs where model footprint is significant relative to total available device memory.

Answer

The count of 2 causes the GPU to oversubscribe its thermal limits.

Answer

Triton requires KIND_CPU for concurrent instance execution.

Answer

The gpus index [0] is invalid for multi-instance deployment.

Question 8

An enterprise deploying a large language model on NVIDIA Triton Inference Server needs to track GPU utilization, memory allocation, and custom inference latency histograms in Prometheus. Which approach should the MLOps engineer implement to ensure robust production observability without overloading the inference execution threads?

Accepted Answer

Enable the native Prometheus metrics endpoint in Triton Inference Server configuration and configure Prometheus to scrape it.. Enabling Triton's native Prometheus metrics endpoint allows the server to expose internal hardware and performance counters directly over an HTTP port. This scraping mechanism operates asynchronously from the main inference pipeline, preventing metric collection overhead from degrading GPU compute efficiency or increasing inference request latency.

Answer

Write a custom Python wrapper around every generate call to log execution duration directly to a shared text file.

Answer

Query the NVIDIA Management Library via a cron job every second to poll current GPU statistics and write them to a database.

Answer

Disable all internal instrumentation layers to maximize raw throughput, relying solely on external black-box API health probes.

Question 9

A production LLM service on NVIDIA Triton Inference Server uses dynamic batching. During peak load, the 99th percentile latency increases significantly, but GPU utilization remains at 60%. Which configuration change is most likely to improve latency while maintaining throughput?

Accepted Answer

Decrease the maximum batch size and adjust the batch timeout to reduce waiting. When GPU utilization is low but latency is high, the bottleneck is often the batching mechanism waiting to accumulate requests. Reducing the maximum batch size and batch timeout allows requests to be processed sooner, lowering queue time and P99 latency. Since the GPU has spare capacity, this change can improve latency without sacrificing throughput.

Answer

Enable model instances to increase parallelism on the same GPU

Answer

Switch to a larger GPU with more memory bandwidth

Answer

Increase the maximum batch size in the dynamic batching configuration

Question 10

A production LLM inference service on NVIDIA Triton Inference Server runs on a multi-GPU node. You observe that one GPU reports ECC XID errors and the model's throughput gradually degrades. Which NVIDIA tool should you use to monitor GPU health and set up alerts for these errors?

Accepted Answer

NVIDIA Data Center GPU Manager (DCGM). NVIDIA DCGM is the standard tool for monitoring GPU health in data centers. It tracks ECC and XID errors, temperature, power, and other metrics, and can trigger alerts. For a production LLM service experiencing hardware errors, DCGM provides the necessary observability to detect and respond to GPU failures.

Answer

NVIDIA TensorRT

Answer

NVIDIA Nsight Systems

Answer

NVIDIA Triton Model Analyzer

Question 11

A team is preparing a mixed-language corpus for continued pretraining of an NVIDIA NeMo Megatron model. The corpus contains English, Japanese, and Arabic documents. Tokenizer analysis shows the current English-centric BPE vocabulary produces very long token sequences for Japanese and Arabic, inflating sequence length and compute cost. The team wants to reduce sequence length for non-English text without retraining the tokenizer from scratch and without degrading English performance. Which data preparation action best achieves this?

Accepted Answer

Extend the existing BPE vocabulary with additional merges learned from a balanced multilingual sample, then retrain only the embedding and output layers while freezing the rest of the model.. The high token counts for Japanese and Arabic stem from a vocabulary that lacks subword units for those scripts. Extending the BPE vocabulary with multilingual merges shortens their token sequences while preserving English merges, and retraining only the embedding and output layers adapts the new entries without perturbing the pretrained transformer. This lowers compute cost and keeps English behavior stable.

Answer

Lowercase and strip diacritics from all Japanese and Arabic text so that the English-centric vocabulary can represent it more efficiently.

Answer

Transliterate all Japanese and Arabic documents into Latin script using a standard romanization scheme before tokenization.

Answer

Increase the model's maximum sequence length and positional embedding size so that long token sequences for Japanese and Arabic fit without truncation.

Question 12

Which THREE factors significantly influence the memory consumption during LLM fine-tuning? (Choose three)

Accepted Answer

The precision of the optimizer states. Memory consumption is driven by the model parameters, the optimizer states (which are often larger than the model weights), and the activations generated during the forward pass. Efficient management of these components is critical for scaling to larger models. By optimizing these three areas, practitioners can successfully fit large models into limited VRAM, ensuring stability throughout the fine-tuning process.

Answer

The number of CPU cores available for data loading

Answer

The version of the operating system kernel

Question 13

A bank's model risk committee is reviewing an LLM-based loan-adverse-action notice generator built on NVIDIA NeMo. Regulators require that the system produce a human-readable rationale for each denial and that the rationale be reproducible for any prior decision. Which architectural choice most directly meets both obligations?

Accepted Answer

Persist the exact prompt, model version, decoding parameters, retrieved context, and random seed for every decision so the notice can be regenerated identically.. Auditable generative decisions require capturing the full provenance chain: prompt, model version, decoding configuration, retrieval context, and seed. Storing those artifacts lets the bank reconstruct any prior notice byte-for-byte during an examination while keeping the natural-language rationale the regulation demands. Changing the model class, raising temperature, or merely caching outputs each fails one of the two obligations the committee must satisfy.

Answer

Increase the model temperature so the generator explores multiple rationales and select the most favorable one for each applicant.

Answer

Cache the generated notice text in a database keyed by applicant ID and serve the cached copy whenever the same applicant is re-scored.

Answer

Replace the LLM with a logistic regression scorecard so that every denial has a coefficient-based explanation by construction.

Question 14

When evaluating an LLM's response to a complex prompt, what is the 'Persona Adoption' technique?

Accepted Answer

A method to assign an expert identity to improve response quality.. Persona adoption involves assigning a specific role, expertise level, or professional identity to the LLM within the system prompt. This technique helps calibrate the tone, vocabulary, and depth of the response to match the user's expectations. For NVIDIA applications, this ensures that the model speaks with the authority and technical precision required for engineering and developer-facing communications.

Answer

A method to verify if the model has memorized personal data.

Answer

A way to force the model to identify the user's persona.

Answer

A technique to reduce the model's context window usage.

Question 15

A company is using NVIDIA NeMo Guardrails to enforce safety policies in its LLM application. A developer wants to ensure that the model does not generate content that violates the company's policy against discussing competitor products. Which type of guardrail should the developer configure to prevent the model from mentioning competitor names in its responses?

Accepted Answer

Output rail that detects and blocks responses containing competitor names. To prevent the model from generating competitor names in its responses, the developer should use an output rail. Output rails in NeMo Guardrails inspect the LLM's response and can block or modify it based on defined policies. Input, dialog, and retrieval rails address other parts of the pipeline and do not directly control the final output content.

Answer

Input rail that filters user queries containing competitor names

Answer

Dialog rail that redirects the conversation if a competitor is mentioned

Answer

Retrieval rail that filters the knowledge base for competitor information

Question 16

Which of the following describes the purpose of 'Kernel Fusion' in the context of optimizing a Deep Learning inference pipeline?

Accepted Answer

To reduce redundant global memory read/write cycles.. Kernel fusion combines multiple small operations into a single GPU kernel to reduce the overhead of launching kernels and accessing global memory. Every kernel launch involves CPU-side overhead, and global memory accesses are costly in terms of energy and time. Fusion minimizes both, significantly increasing the effective throughput of the GPU by keeping data in high-speed, on-chip storage for as long as possible.

Answer

To increase the number of parallel GPU threads.

Answer

To enable multi-GPU distributed training.

Answer

To improve model accuracy through extra precision.

Question 17

An engineer is deploying a 70B parameter model and needs to serve many concurrent users on a single GPU with limited memory. They want to store the attention keys and values for past tokens efficiently so that generation does not recompute them at every step. Which technique should they implement?

Accepted Answer

A key-value cache that stores the projected keys and values for previously processed tokens.. Autoregressive decoding generates one token at a time, and without caching the model would recompute keys and values for the entire prefix at every step, wasting compute. A key-value cache stores those projections so each step only processes the new token, which is the standard way to make long-context generation practical.

Answer

Quantization-aware training that reduces weight precision before deployment.

Answer

Speculative decoding that uses a smaller draft model to propose tokens.

Answer

Gradient checkpointing that recomputes activations during the backward pass.

Question 18

What is the primary function of the 'TensorRT' optimization engine in the NVIDIA AI software stack?

Accepted Answer

It performs architecture-specific model optimization.. TensorRT optimizes neural network models by performing layer fusion, precision calibration (e.g., to FP8 or INT8), and kernel selection optimized for the specific GPU architecture. By transforming the model into a highly efficient, platform-specific format, TensorRT significantly reduces latency and increases throughput for production inference. It is the core tool for moving from research-grade PyTorch models to production-ready deployments on NVIDIA hardware.

Answer

It automates the training of complex models.

Answer

It provides a Python API for model debugging.

Answer

It converts models to run on mobile CPUs.

Question 19

Refer to the exhibit. The engineer is attempting to deploy on an NVIDIA Orin platform but encounters a runtime error. What is the most likely cause of the failure?

Accepted Answer

Unsupported operators are being targeted for the DLA. The inclusion of '--dla 0' forces the engine to run on the Deep Learning Accelerator (DLA) core. Many complex LLM operations, such as specific activation functions or advanced attention mechanisms, are not supported by the DLA's fixed-function logic. If the model graph contains unsupported operators, the build will either fail or generate a non-functional plan, as the DLA has a more restricted operator set than the primary GPU cores.

Answer

The workspace memory is too large

Answer

The DLA hardware is not enabled on this device

Answer

FP16 precision is not supported on DLA

Question 20

In the context of the Transformer architecture, what is the primary function of the Feed-Forward Network (FFN) layers applied after the attention mechanism?

Accepted Answer

To process the hidden state representations with non-linear activations.. The FFN layers provide non-linear transformations that allow the model to process information extracted by the attention mechanism. While attention focuses on relationships between tokens, the FFN applies point-wise non-linearities to project these features into higher-dimensional spaces. This is essential for learning complex representations and mappings that ultimately drive the model's predictive accuracy and reasoning capabilities across diverse input patterns.

Answer

To calculate the attention scores between different tokens in the sequence.

Answer

To manage the memory allocation for the KV cache during multi-token generation.

Answer

To reduce the sequence length of the input tokens to a fixed size.