NCP-GENL Practice Test 5 — 25 Questions

Question 1

You are building an evaluation harness for a retrieval-augmented generative assistant running on NVIDIA NIM microservices. The product owner wants a single trustworthy number for 'answer quality,' but you need to defend the evaluation design. Which two design choices most directly protect the evaluation from producing misleading quality scores? (Choose two.)

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Hold out a prompt set that was never used during fine-tuning or prompt engineering, and keep it frozen across model versions.. Leakage control and retrieval attribution are the two structural safeguards that make RAG evaluation trustworthy. A frozen, unseen prompt set ensures score changes reflect the model, and the retrieval ablation shows whether gains come from context or from parametric memory. Composite averaging, self-grading, and elevated temperature all add noise or bias rather than removing it, so they undermine the credibility the product owner needs.

Answer

Let the same generative model that powers the assistant also grade its own answers, since it understands the domain best.

Answer

Average the outputs of several automatic metrics into one composite score so the product owner receives a single number.

Answer

Increase decoding temperature during evaluation so the model explores more of the answer space and scores reflect average-case behavior.

Question 2

An engineer is reviewing the architecture of a decoder-only LLM that must support very long input contexts for document analysis. They are considering architectural choices that extend effective context length beyond what the model saw during pretraining. Which TWO techniques are designed specifically to extend usable context length without retraining the entire model from scratch? (Choose two.)

Accepted Answer

Position interpolation, which rescales positional indices so longer sequences fall within the range seen during pretraining.. Position interpolation and YaRN both operate on positional encoding to reconcile desired sequence lengths with the range seen during pretraining. Interpolation compresses indices, while YaRN adjusts rotary frequencies to improve extrapolation. Both are context-extension methods that require only light fine-tuning, unlike changes to head count, MLP activation, or vocabulary size, which do not address positional generalization.

Answer

Switching the feed-forward activation from SwiGLU to GeLU to improve long-range dependency modeling.

Answer

Increasing the number of attention heads while keeping the head dimension fixed.

Answer

Reducing the vocabulary size to shorten the embedding matrix and free memory for longer sequences.

Question 3

An engineer is analyzing why a decoder-only LLM with 32,000-token context length fails to answer questions that require information from the beginning of a long document when the answer is near the end. The model was trained with standard causal attention. Which two architectural or training factors are most likely contributing to this failure? (Choose two.)

Accepted Answer

The positional encoding scheme may not generalize well beyond the sequence lengths seen during pretraining.. Long-context retrieval failures in decoder-only LLMs typically stem from two sources: pretraining on sequences much shorter than the target context, which prevents the model from learning to attend across the full window, and positional encoding schemes that do not generalize beyond training lengths. Together these cause the model to underuse information at the start of a long document. The causal mask, feed-forward network, and vocabulary size are not primary causes of this behavior.

Answer

The feed-forward network in each layer compresses the hidden state, discarding information from early tokens.

Answer

The vocabulary size is too small to represent the document's domain-specific terms, causing tokenization errors.

Answer

Causal attention masks prevent each token from attending to future tokens, which limits bidirectional reasoning over the document.

Question 4

A media analytics company runs a TensorRT-LLM optimized GPT-J model on a single NVIDIA A100 80GB GPU using NVIDIA Triton Inference Server. During peak hours, request concurrency rises sharply and the team observes that the GPU is idle for long periods while waiting on host-side tokenization and detokenization. Profiling shows that CPU preprocessing and postprocessing dominate request latency. The team wants to reduce end-to-end latency without changing model weights or adding GPUs. Which Triton feature should they use?

Accepted Answer

The TensorRT-LLM backend's in-flight batching and built-in tokenizer, which perform tokenization and detokenization inside the backend and keep the GPU busy with continuous batching.. The TensorRT-LLM Triton backend provides an integrated tokenizer and in-flight batching, which eliminate the host-side tokenization and detokenization stalls observed in the profile. In-flight batching also continuously admits new requests into the running batch, improving GPU utilization and reducing end-to-end latency without changing model weights or adding GPUs.

Answer

Dynamic batching, because it groups requests on the server and reduces the number of model executions.

Answer

Sequence batching with a custom scheduler, because it keeps tokenization on the host and overlaps it with GPU compute across requests.

Answer

A Triton ensemble that places a Python model for tokenization before the TensorRT-LLM model and a Python model for detokenization after it.

Question 5

Which THREE of the following are primary benefits of using PagedAttention in NVIDIA TensorRT-LLM deployments?

Accepted Answer

Elimination of external memory fragmentation.. PagedAttention is a critical optimization for LLM inference, solving the problem of memory fragmentation. By managing memory in non-contiguous pages, it allows the system to allocate only what is needed, reducing memory waste significantly. This enables higher batch sizes, better GPU utilization, and the ability to serve longer sequences without running out of memory, which are essential for maintaining high performance in production-grade LLM serving environments.

Answer

Faster calculation of attention scores.

Answer

Direct hardware support in the GPU scheduler.

Question 6

When profiling an application with NVIDIA Nsight Systems, you notice a long gap between kernel execution blocks on the GPU timeline. What is the most likely cause?

Accepted Answer

Excessive host-side synchronization calls.. Long gaps in the GPU timeline usually indicate host-side synchronization, such as explicit cudaDeviceSynchronize() calls or CPU-bound code that is stalling the kernel launch queue. In production systems, unnecessary CPU-to-GPU synchronization forces the GPU to remain idle while waiting for the CPU to catch up, directly impacting system-wide latency and violating the principle of asynchronous task pipelining necessary for optimal GPU utilization.

Answer

The GPU is overheating and triggering thermal throttling.

Answer

The PCIe bus is saturated with high-frequency data.

Answer

The kernel is launching with an invalid thread block size.

Question 7

Refer to the exhibit. The TensorRT build process fails with a memory limit error. Which configuration adjustment is most likely to resolve this build-time error?

Accepted Answer

Increasing the builder's workspace memory limit. The build error indicates that the workspace memory required for the optimization process exceeds the available VRAM or the limit specified by the build configuration. By explicitly increasing the workspace size in the builder configuration, the engineer provides the necessary scratchpad memory for TensorRT to evaluate and test various kernel implementations, allowing the builder to successfully complete the optimization process for all layers of the model.

Answer

Reducing the number of hidden layers

Answer

Switching to a lower precision inference

Answer

Disabling the TensorRT engine cache

Question 8

A healthcare technology company is deploying an LLM-powered patient triage assistant using NVIDIA NIM microservices on-premises. During an internal audit, the compliance team discovers that the model occasionally outputs patient names and medical record numbers (MRNs) in its responses, even though the training data was scrubbed. The company must implement a runtime safeguard that detects and redacts PII before the response reaches the user. Which NVIDIA component should they integrate into their inference pipeline to achieve this?

Accepted Answer

NVIDIA NeMo Guardrails with a custom output rail that invokes a PII detection model. The requirement is a runtime safeguard that detects and redacts PII in LLM outputs before they reach users. NeMo Guardrails provides a programmable framework for defining output rails that can invoke custom PII detection models and modify responses accordingly. Other NVIDIA components like Triton, TensorRT-LLM, and Riva focus on inference optimization or speech processing, not content moderation, so they cannot enforce the needed redaction policy.

Answer

NVIDIA Triton Inference Server with dynamic batching enabled

Answer

NVIDIA TensorRT-LLM with quantization-aware training

Answer

NVIDIA Riva with custom ASR and TTS models

Question 9

A hospital network runs an on-premises NVIDIA NIM microservice hosting a clinical-summarization LLM. Compliance requires that every generated summary be attributable to source records and that no protected health information leave the subnet. Which deployment practice best satisfies both requirements at once?

Accepted Answer

Keep inference inside the on-premises NIM endpoint and log retrieval-augmented-generation citations that map each summary sentence back to the source record IDs.. On-premises NVIDIA NIM inference keeps protected health information inside the controlled network boundary, and RAG citation logging provides the source-record traceability an auditor needs. Redaction, hashing, and de-identified fine-tuning each address only part of the problem and none of them stops live PHI from crossing the trust boundary. Only a local endpoint combined with grounded citations satisfies residency and attribution together.

Answer

Fine-tune the clinical LLM on de-identified records, then deploy the tuned checkpoint to the public cloud region closest to the hospital.

Answer

Route prompts to a hosted public LLM API for higher quality, then hash the returned summaries before writing them to the clinical record.

Answer

Enable NVIDIA NeMo Guardrails output rails to redact names and dates, and continue calling the external model endpoint from the clinical application.

Question 10

A healthcare company deploys an LLM-powered clinical documentation assistant using NVIDIA NIM microservices on-premises. During a compliance review, auditors discover that the model occasionally generates patient names and medical record numbers in its output even though these were not present in the input prompt. The team needs to implement a runtime guardrail that detects and blocks such unintended PII leakage without retraining the model. Which NVIDIA component should they configure to add this output-side detection?

Accepted Answer

NVIDIA NeMo Guardrails with an output rail that invokes a PII detection model. Output rails in NeMo Guardrails are designed to intercept the model's generated text and apply safety checks, such as PII detection, before the response is returned. This is the correct mechanism because it operates at runtime without modifying the underlying model. Triton, TensorRT-LLM, and Riva serve different purposes—serving, optimization, and speech—and lack content-filtering capabilities for PII.

Answer

NVIDIA Riva with automatic speech recognition enabled

Answer

NVIDIA TensorRT-LLM with quantization-aware training

Answer

NVIDIA Triton Inference Server with dynamic batching enabled

Question 11

When implementing Chain-of-Thought (CoT) prompting for a complex NVIDIA NeMo-based reasoning task, what is the primary benefit of encouraging the model to generate intermediate steps?

Accepted Answer

It decomposes complex problems into verifiable logical segments.. Chain-of-Thought prompting decomposes complex problems into sequential logical steps, which is critical when using LLMs for technical reasoning tasks. By forcing the model to articulate its internal logic, the likelihood of hallucination decreases significantly. This practice is essential for NVIDIA engineers deploying agents that require high-precision output, as it creates an audit trail for the model's reasoning process and allows for better debugging of multi-turn interactions.

Answer

It forces the model to use more GPU memory per token.

Answer

It increases the likelihood of the model selecting a random seed.

Answer

It eliminates the need for system-level instructions entirely.

Question 12

An enterprise is preparing a massive multi-terabyte corpus of specialized PDF documents containing technical schematics and dense tables for training a domain-specific LLM using NeMo Curator. During the document extraction pipeline, you notice that tabular data layouts are scrambled into unstructured string tokens, destroying spatial relationships. Which data preparation strategy should you implement first within NeMo Curator to preserve tabular integrity before tokenization?

Accepted Answer

Deploy NeMo Curator's layout-aware PDF extraction modules featuring visual bounding box detection to parse tables into structured Markdown formatting.. NeMo Curator provides specialized PDF extraction utilities that leverage advanced computer vision and layout parsing models to accurately identify bounding boxes for tables and figures. Preserving tabular markdown structures prevents spatial collapse, ensuring downstream tokenizers capture relational data accurately. This step is critical in domain-specific LLM training because scrambled tables introduce severe noise that degrades reasoning capabilities.

Answer

Apply aggressive regex-based whitespace removal across all extracted string buffers to normalize sentence boundaries prior to embedding generation.

Answer

Increase the chunk size parameter in the tokenizer configuration so that entire table blocks fit inside a single oversized context window.

Answer

Convert all PDF pages into low-resolution JPEG images to bypass text extraction errors and feed raw pixels directly into a text-only causal language model.

Question 13

A team is deploying a quantized LLM using NVIDIA NIM. To ensure the highest level of security and compliance, they need to verify that the container image has been scanned for vulnerabilities before production use. Which tool is the primary source for certified, production-ready NIM containers?

Accepted Answer

The official NVIDIA NGC catalog.. NVIDIA NGC (NVIDIA GPU Cloud) is the central repository for certified, secure, and optimized container images. Using NIM containers from the NVIDIA NGC catalog ensures that the images have been scanned by NVIDIA security pipelines. This is critical for enterprise compliance, as it guarantees the software components, including CUDA libraries and inference runtimes, are patched and verified for production deployment.

Answer

The public NVIDIA Docker Hub repository.

Answer

A custom build using the standard PyTorch base image.

Answer

The GitHub repository containing the source code for the model.

Question 14

Which TWO of the following NVIDIA AI Enterprise tools are specifically designed to optimize and accelerate the deployment of LLMs in containerized environments?

Accepted Answer

NVIDIA Triton Inference Server. NVIDIA Triton Inference Server and TensorRT-LLM are the cornerstones of the NVIDIA AI Enterprise deployment stack. Triton provides a unified serving platform that abstracts the complexities of hardware management, while TensorRT-LLM provides the compiler technology to fuse kernels and quantize weights. Together, they enable developers to move from research models to production-ready services with minimal code changes, ensuring optimized performance across NVIDIA GPUs.

Answer

NVIDIA Modulus

Answer

NVIDIA NeMo Framework

Answer

NVIDIA DriveWorks

Question 15

An enterprise deployment team needs to deploy a Large Language Model on NVIDIA Triton Inference Server. They require the lowest possible latency for real-time inference while maximizing GPU memory utilization. Which configuration strategy should the team implement?

Accepted Answer

Implement TensorRT-LLM with In-flight Batching and CUDA Graph capture.. To achieve optimal performance on Triton, using TensorRT-LLM backends with In-flight Batching (IFB) is essential. IFB allows the server to process new requests before existing ones finish, significantly increasing throughput and reducing latency. Configuring CUDA Graph capture further reduces CPU overhead by recording GPU operations. This approach is critical for LLMs because traditional static batching often leads to underutilized GPU cycles during the autoregressive decoding phase.

Answer

Enable dynamic batching with a maximum delay of 500ms to gather requests.

Answer

Deploy the model as a standard PyTorch model using the default model repository.

Answer

Use the Triton Model Analyzer to force a single-request batch size of 1.

Question 16

An enterprise is running a mission-critical generative AI application on an NVIDIA DGX cluster. The MLOps team notices occasional silent GPU memory corruption during long-running inference jobs that do not trigger hard crashes. Which monitoring tool and strategy should be utilized for early detection?

Accepted Answer

Deploy NVIDIA Data Center GPU Manager (DCGM) with Prometheus exporter to monitor XID errors and hardware ECC events continuously.. DCGM (Data Center GPU Manager) provides specialized diagnostic tests and continuous health monitoring, including ECC error tracking and XID error detection. Configuring DCGM to raise alerts on uncorrectable memory errors or specific XID failure codes allows operators to isolate failing GPUs before they impact production workloads.

Answer

Increase the frequency of client-side HTTP ping probes sent from the load balancer to the API gateway.

Answer

Write a custom bash script that runs nvidia-smi every five minutes and parses plain text output for warning strings.

Answer

Rely on standard Kubernetes node liveness probes to automatically restart pods when system memory usage exceeds 90%.

Question 17

An engineer is deploying a large language model for real-time inference on an NVIDIA A100 GPU. The model uses FP16 weights but the inference server must handle variable-length input sequences. Profiling shows that the GPU spends significant time on memory-bound operations and that kernel launches are frequent. Which optimization is most appropriate to reduce latency while maintaining accuracy?

Accepted Answer

Use NVIDIA TensorRT with dynamic batching and CUDA graphs to capture the inference step.. TensorRT with dynamic batching and CUDA graphs targets the two identified issues: variable-length sequences are handled by dynamic shapes and batching, while CUDA graphs eliminate launch overhead by capturing the entire inference step. This approach maintains FP16 accuracy and improves latency without the risks of quantization.

Answer

Increase the number of CUDA streams to parallelize kernel execution.

Answer

Enable NVIDIA GPUDirect Storage to accelerate data loading.

Answer

Convert the model to INT8 using TensorRT with calibration.

Question 18

A technical support team is building a chatbot using an NVIDIA NIM microservice. The chatbot must answer questions about a specific product's warranty policy. The team wants to ensure the model's responses are grounded in the official warranty document, which is 50 pages long, and avoid inventing policy details. Which prompt engineering approach is most effective for this scenario?

Accepted Answer

Use a retrieval-augmented generation (RAG) pipeline to fetch the most relevant warranty sections and include them in the prompt as context.. Retrieval-augmented generation (RAG) is the most effective way to ground responses in a specific document. It retrieves relevant sections and includes them in the prompt, ensuring the model's answer is based on factual content rather than pre-trained memory. This reduces hallucinations and handles documents that exceed the context window. Other methods either risk hallucination, are inefficient, or lack flexibility.

Answer

Ask the model to 'think step by step' and reason about the warranty policy from its pre-trained knowledge.

Answer

Fine-tune the model on the warranty document using NVIDIA NeMo, then use the fine-tuned model without any additional context in the prompt.

Answer

Include the entire warranty document in the system prompt and instruct the model to answer based only on that document.

Question 19

A team has deployed a Llama-3-8B model with NVIDIA Triton Inference Server for real-time chatbot responses. They need to evaluate the model's generation quality on a held-out test set of 500 prompts, focusing on semantic similarity to reference answers while ensuring low latency. Which evaluation approach is most appropriate to use with NVIDIA NeMo Evaluator?

Accepted Answer

Use BERTScore or a similar embedding-based metric via NeMo Evaluator's custom metric interface.. For evaluating semantic similarity in generated text, embedding-based metrics like BERTScore are preferred because they capture meaning beyond exact wording. NeMo Evaluator's extensibility allows incorporating such metrics, providing a more human-aligned assessment for chatbot responses. Perplexity and n-gram overlap metrics like BLEU and ROUGE-L do not adequately measure semantic equivalence, especially when paraphrasing is expected.

Answer

Calculate perplexity on the test set using the model's own logits.

Answer

Compute BLEU score using the sacreBLEU library integrated into NeMo Evaluator.

Answer

Run ROUGE-L scoring on the generated outputs and references.

Question 20

A developer is prompting an NVIDIA NIM for a Code Llama model to generate a Python function. The model produces correct logic but frequently omits type hints and docstrings, which the team requires. Which prompting technique best addresses this specific gap?

Accepted Answer

Include a short example of the desired function signature, type hints, and docstring in the prompt, then ask for the new function in the same style.. A concrete example showing the desired function signature, type hints, and docstring teaches the model the exact format by imitation. Vague quality instructions, larger token budgets, and reasoning steps do not specify these structural requirements, so they fail to close the gap. The example-based approach is the most direct and reliable fix.

Answer

Increase max_tokens so the model has more room to include type hints and docstrings.

Answer

Add the instruction "write clean, production-quality code" to the system message.

Answer

Ask the model to first explain its reasoning about the function, then output the code.