NCP-GENL Practice Test 22 — 15 Questions

Question 1

A financial firm is deploying a generative AI chatbot using NVIDIA NIM. To comply with strict data residency regulations, where must the inference and data processing occur?

Accepted Answer

Within the firm's controlled, compliant infrastructure or local sovereign cloud region.. Data residency regulations require that sensitive data remains within specific geographic or sovereign borders. By deploying models on-premises or within a verified sovereign cloud region using NVIDIA NIM, the organization retains complete control over the data lifecycle. This ensures that personal or financial information is not processed, logged, or stored in unauthorized regions, which is a critical requirement for regulatory compliance in the financial sector.

Answer

On any public cloud infrastructure that supports the specific model architecture.

Answer

On an edge device located at the user's home or mobile office.

Answer

Through a distributed network of global nodes to minimize latency.

Question 2

Refer to the exhibit. A team is preparing log data for a RAG-based troubleshooting assistant. Given the configuration, what is the most significant risk during the retrieval phase?

Accepted Answer

Setting the overlap to 0 will break contextual continuity between consecutive log entries.. The lack of overlap between chunks is critical. In log data, sequential events are often related; by having zero overlap, the system loses the transition between log lines that might contain a causal link. This fragmentation forces the model to interpret isolated snapshots, hindering its ability to reconstruct the sequence of errors or system states, which is vital for effective root-cause analysis.

Answer

The use of 'nv-embed-v1' will cause OOM errors during the indexing phase.

Answer

The chunk size of 4096 tokens is too small for modern log analysis.

Answer

The 'regex_mask_all' policy will cause the embedding model to fail during vectorization.

Question 3

When preparing unstructured documentation for a high-performance retrieval system, which approach best balances index size and retrieval relevance?

Accepted Answer

Implementing sliding window chunking with semantic overlap based on document structure.. Utilizing a sliding window approach with semantic overlap ensures that retrieved chunks maintain context. By carefully selecting chunk size and overlap, engineers can optimize the index size to avoid redundant storage while ensuring that the semantic units of the text are not cut off. This balance is vital for maximizing the accuracy of RAG systems running on NVIDIA infrastructure, where memory efficiency is paramount.

Answer

Using extremely large chunks to ensure that every document is a single vector.

Answer

Storing every sentence as an individual chunk in the vector database.

Answer

Removing all overlaps to keep the index size at the absolute minimum possible.

Question 4

Refer to the exhibit. What is the most likely reason for the high P99 latency despite low GPU utilization?

Accepted Answer

Inappropriate concurrency settings. When GPU utilization is low but P99 latency is high, the bottleneck is usually not the compute capability but rather the request queuing or orchestration layer. High queue depth indicates that requests are waiting for a slot, likely due to a restrictive concurrent request setting or inefficient backend task scheduling. This scenario highlights the importance of matching inference concurrency settings with the hardware's throughput capacity to avoid artificial bottlenecks.

Answer

The GPU compute units are failing

Answer

The model is too large for memory

Answer

Network bandwidth is saturated

Question 5

Refer to the exhibit. An engineer notices that the TensorRT engine takes an excessively long time to build. What is the most likely cause, and how can it be mitigated?

Accepted Answer

Use an explicit tactic sources list. The long build time is likely due to the large workspace allocation combined with a large search space for the optimization tactics. TensorRT tests a variety of kernel implementations to find the fastest one. To reduce build time, the engineer can limit the 'tactic selection' or use a profile-based build where common shapes are pre-recorded, preventing the engine from exhaustively searching every possible configuration for all input shapes.

Answer

Decrease the workspace size

Answer

Use a calibration cache

Answer

Increase the batch size

Question 6

In Mixture-of-Experts (MoE) architectures, why does the use of a router mechanism significantly impact performance compared to dense models?

Accepted Answer

It allows scaling parameters while keeping compute costs manageable.. The router determines which expert blocks to activate for a given input token, ensuring that only a subset of the model's total parameters are used per forward pass. This decoupling of model size from computation latency allows for the creation of massive, high-capacity models that run with the speed of much smaller dense models. This architectural choice is central to modern scaling laws.

Answer

It forces all parameters to update at every training step.

Answer

It forces the model to use all experts simultaneously for every input.

Answer

It replaces the attention mechanism with a standard linear layer.

Question 7

You are optimizing a ResNet-50 model on an NVIDIA A100. Which precision-based optimization will yield the highest throughput without significant accuracy loss?

Accepted Answer

Mixed-precision (FP16/BF16).. NVIDIA A100 GPUs feature Tensor Cores that are specifically optimized for FP16 and BF16 arithmetic. Utilizing mixed-precision training or inference allows the model to leverage these high-speed units, effectively doubling throughput compared to FP32. This is the standard approach for balancing the trade-off between floating-point precision and computational speed, providing near-native accuracy while maximizing the hardware's performance capabilities in deep learning workloads.

Answer

Full FP32 precision.

Answer

Aggressive FP8 quantization.

Answer

Custom boolean quantization.

Question 8

Refer to the exhibit. Why did the system fail to trigger an alert despite high latency?

Accepted Answer

The alert is suppressed by a duration requirement. Alerting systems often require sustained violation of thresholds to avoid 'flapping' or false positives. The exhibit shows the current latency is 850ms, which exceeds the threshold, but the alerting logic likely requires consecutive samples or a window-based average to trigger. This is a common reliability feature in monitoring stacks to ensure that transient spikes do not disrupt operational teams with unnecessary alerts during non-critical fluctuations.

Answer

The error rate threshold was too low

Answer

The Prometheus backend is down

Answer

The logging level is set too high

Question 9

An engineer needs to expose an LLM served by NVIDIA Triton Inference Server to a web application over HTTP with token streaming. Which Triton feature should they enable?

Accepted Answer

Decoupled mode with streaming responses in the model backend.. Triton's decoupled mode lets a backend emit multiple responses for one request, which is the mechanism used for LLM token streaming. Configuring the model for decoupled transactions and using a streaming-capable client over HTTP or gRPC delivers tokens incrementally. Other Triton features like batching, ensembles, or instance groups improve throughput or composition but do not stream partial outputs.

Answer

Model ensembles combining preprocessing and postprocessing models.

Answer

Dynamic batching in the model configuration.

Answer

Instance groups with multiple GPU instances per model.

Question 10

A team is using an NVIDIA NIM for a Mistral model to classify support tickets into one of five fixed categories. Accuracy is inconsistent, and the model sometimes invents new categories. Which prompt engineering change is most likely to improve reliability without retraining the model?

Accepted Answer

Provide three labeled examples per category in the prompt and instruct the model to output only the category name.. Few-shot examples with explicit labels define the allowed output space, and the instruction to emit only the category name prevents invented labels. This combination directly targets both symptoms, inconsistency and hallucinated categories, and requires no model retraining, unlike sampling or reasoning changes that leave the label set undefined.

Answer

Add a chain-of-thought instruction that asks the model to reason step by step before naming a category.

Answer

Increase the context window by concatenating the entire ticket history for every request.

Answer

Lower the temperature to 0.0 and remove all instructions so the model relies on its pretrained knowledge.

Question 11

Which component in the NVIDIA AI Enterprise stack is primarily responsible for serving multiple models, managing model versions, and providing metrics for monitoring model health?

Accepted Answer

NVIDIA Triton Inference Server. NVIDIA Triton Inference Server is the standard tool for model serving in production. It provides a unified API for various frameworks, supports concurrent model execution, and performs health checks. It is designed to handle model versioning and provide detailed telemetry data, which is essential for maintaining reliable and scalable AI deployments in enterprise production pipelines.

Answer

CUDA Toolkit

Answer

NVIDIA NeMo

Answer

NVIDIA DALI

Question 12

When deploying a large language model on NVIDIA H100 GPUs using TensorRT-LLM, which TWO configuration strategies are most effective for improving KV cache efficiency and memory utilization?

Accepted Answer

Enable PagedAttention to reduce fragmentation.. Optimizing the KV cache is critical for scaling generative AI, as it occupies significant VRAM during inference. PagedAttention dynamically manages memory blocks to prevent fragmentation, while inflight batching ensures that continuous requests are processed without waiting for the entire batch to finish. Combining these allows for higher concurrency and reduced memory overhead, enabling more efficient deployment of models with large context windows on limited GPU hardware.

Answer

Increase the static sequence length allocation.

Answer

Disable multi-head attention optimizations.

Answer

Switch to FP64 precision for all tensors.

Question 13

What is the primary risk of 'catastrophic forgetting' during the fine-tuning process?

Accepted Answer

The model loses the general knowledge acquired during pre-training. Catastrophic forgetting occurs when a model is updated on new, narrow tasks, causing it to lose the broad, generalized knowledge acquired during its extensive pre-training phase. In production, this renders the model useless for its original intended tasks. Mitigating this risk is crucial for businesses that need to maintain multi-purpose model capabilities while still achieving performance gains in specialized domains.

Answer

The model becomes unable to produce responses in the desired language

Answer

The model's inference speed increases significantly

Answer

The model begins to output only empty strings

Question 14

You are fine-tuning a LLM on a large corpus of technical documentation. You notice the model struggles with domain-specific terminology that frequently appeared in the training data but was inconsistently formatted. Which data preparation technique best addresses this issue?

Accepted Answer

Applying consistent text normalization and domain-specific tokenization rules.. Consistent normalization, such as lemmatization or standardizing case and special characters, ensures the tokenizer treats synonymous terms identically. In NVIDIA NeMo workflows, data quality directly impacts convergence speed and model accuracy. By reducing vocabulary noise during the preprocessing stage, the model can dedicate more capacity to learning semantic relationships rather than mapping variants of the same technical term to different embedding spaces, ultimately improving downstream performance on domain-specific benchmarks.

Answer

Increasing the batch size during the training phase.

Answer

Expanding the model's depth with additional transformer layers.

Answer

Reducing the learning rate to prevent overfitting on the noise.

Question 15

Refer to the exhibit. In the context of a distributed multi-GPU fine-tuning job, what is the most likely cause of this error?

Accepted Answer

The MASTER_ADDR or MASTER_PORT environment variables are misconfigured. This error indicates that the NCCL (NVIDIA Collective Communications Library) is failing to communicate between GPU nodes or processes. It is typically caused by a misconfiguration of the environment variables (like MASTER_ADDR or MASTER_PORT) or a firewall blocking the necessary ports. In distributed training, these network configurations are essential for synchronizing gradients across all participating GPUs during the training process.

Answer

The model weights are too large for the GPU memory

Answer

The learning rate is too high, causing gradient explosion

Answer

The dataset is missing required training samples