NCA-GENL Practice Test 9 — 10 Questions

Question 1

Which of the following best describes the principle of 'Interpretability' in the context of Trustworthy AI?

Accepted Answer

The capability to explain the internal decision-making process in human-understandable terms.. Interpretability refers to the degree to which a human can understand the cause of a decision or prediction made by an AI model. In high-stakes domains like healthcare or finance, knowing 'why' a model arrived at a conclusion is as important as the conclusion itself. This transparency is crucial for building trust, debugging errors, and ensuring that the model complies with regulatory requirements regarding fairness and decision-making accountability.

Answer

The ability of the model to perform multiple tasks simultaneously without loss of accuracy.

Answer

The speed at which a model can process training data during the fine-tuning phase.

Answer

The process of removing all personal identifiers from the training dataset.

Question 2

Why is 'Data Provenance' considered a crucial component in maintaining Trustworthy AI?

Accepted Answer

It provides a clear audit trail for data lineage, ethics, and legal compliance.. Data provenance involves tracking the origin, history, and licensing status of the training data. For Trustworthy AI, it ensures legal compliance, intellectual property rights, and the ability to audit the training set for bias. Without a clear chain of custody for the data, organizations cannot guarantee that their models are trained on ethical, high-quality, and legally obtained information, leading to significant reputation and legal risks.

Answer

It ensures that the model can be compressed into a smaller size for edge deployment.

Answer

It speeds up the GPU training process by indexing the data in a vector database.

Answer

It automatically corrects grammatical errors in the training corpus.

Question 3

Which technique should an organization prioritize to identify and reduce systematic bias in a generative model's training dataset?

Accepted Answer

Conduct a comprehensive audit of the training corpus to identify demographic imbalances.. Bias mitigation must start at the data layer. Analyzing the dataset for representational imbalances, stereotype associations, and lack of diversity is the most effective way to address bias before model training begins. This process is essential for Trustworthy AI because it ensures that the foundational intelligence of the model is not built upon skewed or exclusionary data, which prevents the amplification of societal prejudices in downstream AI applications.

Answer

Apply post-processing filters to censor all sensitive keywords in model output.

Answer

Increase the model size to allow for better internal alignment with human values.

Answer

Use an adversarial model to guess the sensitive attributes of the primary model's output.

Question 4

When training a model with a very large dataset, which approach provides the best balance between computational efficiency and model convergence?

Accepted Answer

Mini-batch gradient descent.. Mini-batch gradient descent strikes an ideal balance by processing small subsets of the data (batches) at a time. This provides the efficiency of vectorization on GPU hardware while maintaining enough stochasticity to help the optimizer avoid poor local minima. Compared to full batch (too slow) or single-sample stochastic descent (too noisy), mini-batching is the industry standard for scaling training to large datasets while achieving optimal convergence.

Answer

Full-batch gradient descent.

Answer

Stochastic gradient descent with batch size 1.

Answer

Gradient descent without any data shuffling.

Question 5

Refer to the exhibit. This error occurs during the training of an LLM. What is the most likely cause for this 'device-side assert' error?

Accepted Answer

The target indices exceed the vocabulary size.. A device-side assert error in PyTorch usually indicates an index-out-of-bounds error or a shape mismatch during a kernel operation on the GPU. When the loss function expects a specific range of indices for targets (e.g., in a cross-entropy loss), providing values that exceed the vocab size triggers this assertion. This is a common debugging hurdle that highlights the importance of rigorous input data validation before submitting tensors to the GPU's highly optimized, non-interactive kernels.

Answer

The model has run out of VRAM for the current batch.

Answer

The GPU has overheated and shut down.

Answer

The learning rate is set too high for convergence.

Question 6

Which machine learning paradigm involves an agent learning to make decisions by performing actions in an environment to maximize a cumulative reward?

Accepted Answer

Reinforcement Learning. Reinforcement Learning (RL) is fundamentally about agents interacting with environments. Unlike supervised learning, which relies on labeled datasets, or unsupervised learning, which finds hidden structures, RL uses a feedback loop of rewards and penalties. This paradigm is crucial for robotics, game playing, and autonomous systems where the optimal sequence of actions is not pre-defined, but must be discovered through trial and error.

Answer

Supervised Learning

Answer

Unsupervised Learning

Answer

Transfer Learning

Question 7

Refer to the exhibit. Which strategy is most effective for resolving this memory error without changing the hardware?

Accepted Answer

Gradient Accumulation. The exhibit indicates that the GPU is nearly at capacity. Gradient accumulation is a standard technique that simulates a larger batch size by accumulating gradients over multiple smaller steps before performing a weight update. This allows the user to maintain the intended effective batch size while fitting the training within the physical memory limits of the GPU, ensuring the training process can proceed.

Answer

Increase the hidden layer size

Answer

Enable more data augmentation

Answer

Increase the number of training epochs

Question 8

When integrating an LLM into an application using NVIDIA API endpoints, what is the primary purpose of the 'System' role in the messages payload?

Accepted Answer

To define the model's behavioral guidelines and operational constraints.. The 'System' role provides foundational instructions that dictate the model's behavior, tone, and constraints throughout the conversation. It is a critical component in ensuring that the AI remains within the expected parameters of the application, such as maintaining a specific persona or following strict safety guidelines. Mastering this role is fundamental for developers to ensure consistent and high-quality outputs across different user interactions.

Answer

To provide the user with a history of previous successful interactions.

Answer

To act as a buffer for temporary memory storage during inference.

Answer

To specify the hardware architecture used for the inference request.

Question 9

Which THREE techniques are commonly used to improve the efficiency of inference for large language models?

Accepted Answer

Weight Quantization to reduce the bit-width of model parameters.. Inference efficiency is critical for deploying LLMs in real-world production environments. Techniques like quantization reduce model size and memory requirements, KV-caching prevents redundant computation of attention keys and values, and pruning eliminates unnecessary weights. These methods combined allow models to run with significantly lower latency and reduced hardware costs on NVIDIA inference hardware, making high-performance AI more accessible and scalable for diverse enterprise applications.

Answer

Increasing the number of transformer layers to add depth.

Answer

Replacing all activations with Sigmoid functions for speed.

Question 10

In the context of NVIDIA NeMo, which THREE actions are part of a robust experiment tracking workflow for fine-tuning?

Accepted Answer

Logging hyperparameters for every run. Robust experiment tracking is the foundation of reproducibility in machine learning. By logging configurations, monitoring metrics in real-time using tools like Weights & Biases or TensorBoard, and saving versioned checkpoints, researchers can compare results across iterations. These actions are vital for ensuring that performance gains are attributable to specific hyperparameter changes rather than random chance or environmental variations during training.

Answer

Deleting logs to conserve disk space

Answer

Manually calculating gradients during training