NCP-AIO Practice Test 7 — 10 Questions

Question 1

Refer to the exhibit. An administrator observes this in the logs during a multi-GPU training job. What is the performance implication of this setting?

Accepted Answer

GPU-to-GPU data transfer performance is significantly reduced. Disabling Peer-to-Peer (P2P) communication forces NCCL to use system memory (often via the network or PCIe bus) to facilitate data movement between GPUs. This bypasses the high-bandwidth NVLink interconnect, resulting in significantly increased latency and lower throughput for collective operations. This configuration is typically used only for debugging or when hardware incompatibility prevents direct P2P access, as it severely hinders the performance of multi-GPU, multi-node AI training workloads.

Answer

The training job will have lower memory consumption

Answer

The job will be more stable across nodes

Answer

The system will utilize less power during training

Question 2

When managing GPU resources in a shared cluster, which configuration best prevents 'noisy neighbor' scenarios where one GPU task consumes all available memory bandwidth?

Accepted Answer

Implementing NVIDIA MIG and strictly defining resource limits.. Using a combination of NVIDIA MIG and Kubernetes resource quotas provides the strongest isolation. By enforcing hardware-level partitioning via MIG, you ensure that memory bandwidth is strictly bounded for each slice. This is vital for AI Ops because it prevents high-throughput training jobs from starving small inference requests, ensuring stable latency across the entire cluster environment and improving total system reliability.

Answer

Increasing the CUDA_VISIBLE_DEVICES environment variable.

Answer

Setting a higher priority class for inference pods.

Answer

Configuring the NVIDIA DCGM Exporter alerts.

Question 3

An AI researcher is deploying a multi-node training job using NCCL on an InfiniBand network. The job is suffering from intermittent latency spikes. Which TWO steps should the engineer perform to troubleshoot the network configuration?

Accepted Answer

Check IB link status and error counters using 'ibstat'.. Troubleshooting high-performance networking in distributed training requires checking for physical layer stability and protocol-level misconfigurations. Verifying InfiniBand counters helps identify packet drops or link flapping, while ensuring NCCL environment variables are correctly set for the specific topology avoids suboptimal routing. These steps ensure that the inter-GPU communication remains within the high-bandwidth low-latency envelope required for scaling deep learning workloads effectively.

Answer

Reset the GPU thermal throttling threshold.

Answer

Update the OS kernel to the latest version.

Answer

Increase the system swap space to 512GB.

Question 4

Refer to the exhibit. An administrator is attempting to deploy a job to a namespace with a ResourceQuota defined. What is the cause of this error?

Accepted Answer

The pod manifest is missing the required GPU resource limits.. The error indicates that the namespace has a ResourceQuota enforcing that all pods must specify GPU limits, but the submitted pod manifest lacks a 'resources.limits.nvidia.com/gpu' entry. In multi-tenant environments, ResourceQuotas are essential for preventing a single user from consuming the entire GPU capacity. The manifest must include a valid GPU limit to satisfy the namespace policy, ensuring the cluster remains balanced across different organizational teams.

Answer

The GPU driver version is incompatible with the quota controller.

Answer

The cluster is out of available GPU capacity.

Answer

The NVIDIA Device Plugin is not running in the namespace.

Question 5

An administrator is tasked with deploying a multi-node training job using the NVIDIA GPU Operator. Which configuration must be present to ensure that pods are scheduled on nodes with identical GPU architectures to prevent performance degradation?

Accepted Answer

Use node affinity labels based on NFD-provided hardware information.. To maintain high-performance, synchronized training, all participating nodes should share the same GPU architecture and interconnect type (e.g., NVLink or InfiniBand). Using Kubernetes node affinity or anti-affinity rules combined with the hardware labels automatically generated by the Node Feature Discovery (NFD) service ensures that the scheduler places the job exclusively on compatible nodes. This prevents the training from falling back to slower, sub-optimal communication paths or heterogeneous hardware modes.

Answer

Enable the 'auto-scaling' feature in the NVIDIA GPU Operator.

Answer

Increase the timeout values for the NCCL collective communication operations.

Answer

Set the 'nvidia.com/gpu' resource limit to zero on all nodes except the master node.

Question 6

Which component in the NVIDIA AI Enterprise stack is responsible for providing the necessary user-space libraries and binaries to run GPU-accelerated applications inside containers?

Accepted Answer

NVIDIA Container Toolkit. The NVIDIA Container Toolkit is essential because it allows the container runtime to interact with the host's NVIDIA drivers. It provides the necessary libraries and the container runtime wrapper to expose GPUs inside the container environment. Without this toolkit, applications inside a container cannot access the GPU hardware, even if the host has the correct drivers installed, making it a critical deployment component.

Answer

NVIDIA GPU Operator

Answer

NVIDIA License System

Answer

NVIDIA Unified Fabric Manager

Question 7

Refer to the exhibit. An administrator notices poor performance in an AI training job. What is the most likely cause based on the CLI output?

Accepted Answer

The power limit is set too low for the current workload.. The output indicates that the GPU is currently throttling due to 'Sw Power Cap'. This means the software-defined power limit is restricting the GPU performance to stay within a specific wattage budget. This is common in densely packed servers or cloud environments where power infrastructure is shared. Monitoring power usage is vital because it directly impacts clock speeds, which in turn bottleneck training throughput and lengthen the time required for model convergence.

Answer

The GPU is overheating due to a fan failure.

Answer

The GPU driver is corrupted or out of date.

Answer

The workload is waiting for CPU memory allocation.

Question 8

Refer to the exhibit. The administrator has deployed the GPU Operator, but the node does not show GPU resources. What is the most likely cause?

Accepted Answer

The NFD service is not installed or configured correctly.. The lack of GPU resources in the node description indicates that the Node Feature Discovery (NFD) or the GPU Operator has not correctly identified or labeled the GPU hardware. This is a common deployment issue where the hardware-to-software handshake fails due to missing labels. Identifying this early is key to ensuring that the Kubernetes scheduler can correctly place AI workloads on nodes equipped with the necessary compute resources.

Answer

The node is not part of a valid Kubernetes namespace.

Answer

The GPU firmware is out of date.

Answer

The cluster is using an unsupported CPU architecture.

Question 9

An administrator is deploying NVIDIA AI Enterprise on a bare-metal cluster. The workload requires full GPU isolation with minimal latency. Which configuration should the administrator select to achieve this goal?

Accepted Answer

Implement bare-metal installation with NVIDIA GPUDirect RDMA enabled.. GPU Direct and bare-metal deployments are essential for latency-sensitive workloads. By avoiding hypervisor overhead, the administrator ensures direct path access to the GPU memory and interconnects. This configuration is critical in high-performance computing environments where jitter and interrupt latency can degrade model training performance. Selecting the right deployment mode is a foundational step in AI Operations to ensure optimal hardware utilization and predictable execution times for deep learning models.

Answer

Deploy using NVIDIA vGPU on a KVM hypervisor.

Answer

Configure the system using NVIDIA License System (NLS) in disconnected mode.

Answer

Utilize containerized GPU passthrough with a standard Docker runtime.

Question 10

When deploying NVIDIA AI Enterprise, why is the selection of the correct CUDA version in the container image critical during the installation phase?

Accepted Answer

The CUDA version must be compatible with the host driver version.. The CUDA version dictates which APIs and features are available to the AI application. Because the driver on the host must support the CUDA version used by the container (backward compatibility), mismatching these leads to runtime failures. This is a crucial AI Ops consideration as it directly affects the stability of the entire stack, ensuring that the software environment aligns with the underlying hardware capabilities for maximum performance and reliability.

Answer

It determines the speed of the GPU's memory bus.

Answer

It enables the use of the NVIDIA License System.

Answer

It is required for the installation of the GPU Operator.