NCP-GENL Practice Exam 2 — 20 Questions

Question 1

A financial institution uses NVIDIA NeMo Guardrails to enforce ethical guidelines in its customer-facing LLM. During testing, the model occasionally generates responses that violate the company's policy against offering investment advice. The guardrails are configured with a set of dialog flows and safety checks. What is the most effective way to address this issue?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Enhance the NeMo Guardrails configuration with a custom action that checks the model's output against a compliance rule set and triggers a safe fallback response when a violation is detected.. The most effective solution is to enhance NeMo Guardrails with a custom action that evaluates the model's output against compliance rules and triggers a safe fallback. This leverages the extensibility of NeMo Guardrails to enforce policy dynamically and reliably, ensuring that any investment advice is intercepted and replaced.

Answer

Fine-tune the base LLM on a dataset of compliant responses to reduce the likelihood of generating investment advice.

Answer

Implement a post-processing filter that uses a separate LLM to classify responses as advice or non-advice and redacts them accordingly.

Answer

Add a custom guardrail that detects and blocks any mention of specific financial terms like 'invest' or 'stock'.

Question 2

Refer to the exhibit. Which prompt engineering technique would best force the model to prioritize technical detail over marketing language?

Accepted Answer

Add a constraint: 'Exclude marketing language and include specific architectural metrics like TDP, memory bandwidth, and interconnect speeds.'. The model is failing to adhere to the implicit expectation of 'technical depth.' By explicitly defining a structural constraint—such as requiring specific architectural metrics or removing marketing terminology—the model is forced to prioritize the technical aspects requested. This type of constraint-driven prompting is essential for professional NVIDIA technical writers and engineers who need precise documentation summaries.

Answer

Ask the model to 'Write a shorter summary' in the user prompt.

Answer

Decrease the temperature to 0.0 to make the model more factual.

Answer

Use few-shot prompting with generic summaries.

Question 3

When building an NVIDIA NeMo LLM application for automated document review, which THREE of the following prompt design choices are critical for ensuring high-quality output? (Select exactly THREE)

Accepted Answer

Use standardized delimiters to isolate user-provided documents.. Effective document review requires accuracy, traceability, and consistency. Using clear delimitation prevents data corruption, requiring structured output (like JSON) allows for downstream programmatic integration, and chain-of-thought prompts ensure the model validates its conclusions against the text. These choices together create a robust, production-ready pipeline that minimizes errors and provides the necessary structure for automated workflows in enterprise environments.

Answer

Include instructions that prioritize speed over accuracy.

Answer

Use a high temperature setting to ensure diverse review perspectives.

Question 4

In the context of model optimization, why is 'graph surgery' sometimes required before building a TensorRT engine?

Accepted Answer

To resolve unsupported operator compatibility. Graph surgery is the process of modifying the model's computational graph to replace unsupported or inefficient operations with more optimized, TensorRT-compliant versions. Some frameworks export nodes that TensorRT cannot parse or optimize effectively. By manually editing the graph to fuse operations or simplify the structure before building, engineers can ensure that the engine builder produces a high-performance execution plan that effectively utilizes the underlying hardware capabilities.

Answer

To increase the model's parameter count

Answer

To improve the quality of training data

Answer

To automatically quantize the model to INT8

Question 5

Why is 'tokenization stability' a critical metric when preparing data for NVIDIA-based LLM deployment?

Accepted Answer

It prevents unexpected input shifts between training and inference environments.. Tokenization stability ensures that the same input text consistently maps to the same sequence of tokens across different environments or library versions. If tokenization is inconsistent, the model might receive unexpected inputs compared to what it observed during training, leading to severe performance degradation. For NVIDIA-based deployments, deterministic tokenization is essential for maintaining production-level reliability and predictable model behavior across various inference pipelines.

Answer

It guarantees that the model will always generate the same output for a given prompt.

Answer

It ensures that the GPU memory usage remains constant during the training process.

Answer

It reduces the total number of parameters required for the embedding layer.

Question 6

Which THREE architectural features are essential for enabling efficient inference of massive LLMs on multi-GPU systems?

Accepted Answer

KV Caching to store previous sequence states.. Efficient inference at scale requires techniques that address memory constraints, compute latency, and communication overhead. Model parallelism, KV caching, and weight quantization are fundamental pillars that allow large models to fit within limited memory pools while maintaining high throughput. These techniques collectively ensure that the model remains responsive and cost-effective when serving large-scale requests in a production environment.

Answer

Batch Size reduction to increase memory throughput.

Answer

Increasing the learning rate during inference.

Question 7

When using QLoRA for fine-tuning, what is the primary purpose of using the 4-bit NormalFloat (NF4) data type?

Accepted Answer

To reduce the memory footprint of the model weights. The NF4 data type is mathematically optimal for weights that follow a normal distribution, which is typical for pre-trained language model weights. By quantizing weights to 4 bits, QLoRA significantly reduces the memory footprint, allowing large models to fit onto GPUs with lower VRAM. This efficiency does not significantly sacrifice performance, provided the weights are dequantized during the forward pass to maintain precision for activations.

Answer

To increase the training speed by using integer-only arithmetic

Answer

To improve the convergence speed of the optimizer

Answer

To enable training without the need for gradient accumulation

Question 8

When designing an AI application for the public sector, which ethical principle must be prioritized regarding transparency?

Accepted Answer

Clearly disclosing that the user is interacting with an AI system.. Transparency in public sector AI is critical for maintaining democratic accountability and public trust. Citizens have a right to know when they are interacting with an AI rather than a human, and they should understand the logic behind decisions that affect them. By clearly disclosing AI usage and providing explainable outputs, organizations meet their legal obligations and demonstrate ethical responsibility, ensuring that public-facing systems remain fair, accountable, and open to scrutiny.

Answer

Maximizing the model's speed to provide instantaneous public service responses.

Answer

Concealing the use of AI to prevent user bias and ensure natural interactions.

Answer

Using proprietary, closed-source models to prevent external scrutiny.

Question 9

When fine-tuning an LLM to follow specific safety protocols, why is the inclusion of 'adversarial' examples in the training data considered a best practice?

Accepted Answer

To ensure the model learns to refuse requests that violate established safety policies.. Adversarial examples test the model's ability to maintain safety boundaries even when prompted with manipulative or malicious inputs. By training on these examples, the model learns to identify and refuse requests that violate safety protocols. This proactive preparation is essential for deploying LLMs in enterprise environments where maintaining strict safety and compliance standards is required, protecting against sophisticated prompt injection and bypass techniques.

Answer

To artificially inflate the model's perplexity scores during evaluation.

Answer

To increase the model's fluency in generating complex technical instructions.

Answer

To allow the model to learn and reproduce the adversarial techniques during generation.

Question 10

What is the function of the 'Masked' component in a Decoder-only Transformer's self-attention during training?

Accepted Answer

To prevent the model from attending to future tokens in the sequence.. The mask ensures that each token can only attend to itself and the tokens that precede it in the sequence. This autoregressive property is essential for training decoder models, as it prevents the model from 'cheating' by looking at future tokens. This ensures that the model learns to predict the next word based solely on the context that would be available during actual inference.

Answer

To filter out stop words from the input text.

Answer

To increase the randomness of the model's predictions.

Answer

To reduce the computation of the attention mechanism by 50%.

Question 11

A global bank runs an NVIDIA NeMo Guardrails-protected assistant for its tellers. During a compliance audit, the auditor asks how the bank can prove that the guardrail configuration itself has not been silently altered between releases. Which practice best satisfies this requirement?

Accepted Answer

Store the Colang guardrail files and their configuration in a version-controlled repository with signed commits, and record the commit hash in the deployment manifest.. Guardrail integrity is a configuration-management problem, not an inference or logging problem. Signed, version-controlled Colang files with commit hashes recorded in the deployment manifest give auditors a verifiable, reproducible record of exactly which safety rules were active. This is the only approach that can detect silent tampering and withstand regulatory scrutiny.

Answer

Ask the model to self-report at startup which guardrails it believes are enabled, and archive that self-report as evidence.

Answer

Rely on the NVIDIA NIM container image digest alone, because the guardrail policy is compiled into the model weights.

Answer

Enable verbose logging of every user prompt and model response so the auditor can infer the guardrail rules from observed behavior.

Question 12

A team is optimizing an NVIDIA TensorRT-LLM deployment of a 70B model on multiple GPUs. They want to reduce inter-GPU communication overhead and improve throughput. Which two techniques should they consider? (Choose two.)

Accepted Answer

Enable pipeline parallelism to split layers into stages.. Tensor parallelism benefits from NVLink's high bandwidth to reduce all-reduce overhead, while pipeline parallelism lowers communication frequency by staging layers across GPUs. Together they address the communication bottleneck for large multi-GPU models. KV cache block size, disabling in-flight batching, and FP32 precision do not reduce inter-GPU communication and can hurt throughput.

Answer

Disable in-flight batching to simplify scheduling.

Answer

Use FP32 precision for all weights to improve numerical stability.

Answer

Increase the KV cache block size to 256 tokens.

Question 13

You are preparing a dataset for supervised fine-tuning (SFT) of an NVIDIA NeMo LLM to follow instructions. Which TWO data preparation practices are essential to ensure the model learns to generalize rather than memorize? (Choose two.)

Accepted Answer

Include a diverse set of instruction types and domains in the training data rather than repeating a few templates.. Disjoint data splits prevent leakage and give honest evaluation, while diverse instruction types and domains teach the model to follow instructions generally rather than memorize templates. Together, these practices reduce overfitting and improve generalization. The other options either fail to address memorization, actively encourage it, or unnecessarily restrict the data distribution.

Answer

Increase the learning rate significantly to force the model to escape memorization of individual examples.

Answer

Duplicate the most common instruction-response pairs to reinforce the desired behavior.

Answer

Use only English instructions to simplify tokenization and avoid multilingual complexity.

Question 14

Why is gradient checkpointing useful when fine-tuning a model on a single GPU?

Accepted Answer

It saves GPU memory by recomputing activations during the backward pass. Gradient checkpointing trades computation for memory by not storing all intermediate activations during the forward pass. Instead, it recomputes them during the backward pass. This is extremely valuable when working on hardware with limited VRAM, as it allows for larger batch sizes or longer sequences that would otherwise cause OOM errors, though it does increase the total training time slightly due to the recomputation overhead.

Answer

It speeds up the training process by calculating gradients in parallel

Answer

It automatically adjusts the learning rate for each layer

Answer

It prevents the model from using the CPU during training

Question 15

Which strategy is most effective for optimizing an LLM that is too large to fit into a single GPU's VRAM?

Accepted Answer

Implement tensor parallelism. Model parallelism, specifically tensor parallelism, is the standard approach for splitting a large model across multiple GPUs. By partitioning individual layers across different devices, the computation can be distributed, and the total memory requirement is spread proportionally. This allows for the deployment of models that exceed the capacity of a single GPU, enabling high-performance inference for massive parameter models that would otherwise be impossible to load.

Answer

Increase the inference batch size

Answer

Apply dynamic quantization to the weights

Answer

Convert the model to a CPU-only format

Question 16

Refer to the exhibit. An engineer receives these logs while converting a Transformer model to a TensorRT engine. What is the most appropriate action to resolve this build failure?

Accepted Answer

Increase the builder workspace size. The error indicates that the workspace memory allocated to the TensorRT builder is insufficient to explore the search space of kernels for specific operations. Increasing the workspace size allows the builder to allocate larger temporary memory buffers, which is necessary for complex Transformer operations that require high-memory intermediate calculations to optimize effectively on NVIDIA hardware.

Answer

Reduce the input batch size

Answer

Switch to a smaller base model

Answer

Disable INT8 calibration

Question 17

Refer to the exhibit. An engineer observes that memory utilization spikes during inference, causing OOM errors. Given the configuration, what is the most likely cause of the failure?

Accepted Answer

The instance group count of 2 causes redundant loading of weights, exceeding VRAM.. The instance group configuration defines two concurrent instances on the same GPU. Each instance attempts to load a separate copy of the model weights into the GPU memory. If the model size is large, doubling the instances exceeds the available VRAM capacity. This configuration is a common mistake when deploying LLMs where model footprint is significant relative to total available device memory.

Answer

The count of 2 causes the GPU to oversubscribe its thermal limits.

Answer

Triton requires KIND_CPU for concurrent instance execution.

Answer

The gpus index [0] is invalid for multi-instance deployment.

Question 18

An enterprise deploying a large language model on NVIDIA Triton Inference Server needs to track GPU utilization, memory allocation, and custom inference latency histograms in Prometheus. Which approach should the MLOps engineer implement to ensure robust production observability without overloading the inference execution threads?

Accepted Answer

Enable the native Prometheus metrics endpoint in Triton Inference Server configuration and configure Prometheus to scrape it.. Enabling Triton's native Prometheus metrics endpoint allows the server to expose internal hardware and performance counters directly over an HTTP port. This scraping mechanism operates asynchronously from the main inference pipeline, preventing metric collection overhead from degrading GPU compute efficiency or increasing inference request latency.

Answer

Write a custom Python wrapper around every generate call to log execution duration directly to a shared text file.

Answer

Query the NVIDIA Management Library via a cron job every second to poll current GPU statistics and write them to a database.

Answer

Disable all internal instrumentation layers to maximize raw throughput, relying solely on external black-box API health probes.

Question 19

A production LLM service on NVIDIA Triton Inference Server uses dynamic batching. During peak load, the 99th percentile latency increases significantly, but GPU utilization remains at 60%. Which configuration change is most likely to improve latency while maintaining throughput?

Accepted Answer

Decrease the maximum batch size and adjust the batch timeout to reduce waiting. When GPU utilization is low but latency is high, the bottleneck is often the batching mechanism waiting to accumulate requests. Reducing the maximum batch size and batch timeout allows requests to be processed sooner, lowering queue time and P99 latency. Since the GPU has spare capacity, this change can improve latency without sacrificing throughput.

Answer

Enable model instances to increase parallelism on the same GPU

Answer

Switch to a larger GPU with more memory bandwidth

Answer

Increase the maximum batch size in the dynamic batching configuration

Question 20

A production LLM inference service on NVIDIA Triton Inference Server runs on a multi-GPU node. You observe that one GPU reports ECC XID errors and the model's throughput gradually degrades. Which NVIDIA tool should you use to monitor GPU health and set up alerts for these errors?

Accepted Answer

NVIDIA Data Center GPU Manager (DCGM). NVIDIA DCGM is the standard tool for monitoring GPU health in data centers. It tracks ECC and XID errors, temperature, power, and other metrics, and can trigger alerts. For a production LLM service experiencing hardware errors, DCGM provides the necessary observability to detect and respond to GPU failures.

Answer

NVIDIA TensorRT

Answer

NVIDIA Nsight Systems

Answer

NVIDIA Triton Model Analyzer