NCA-GENL Core Machine Learning and AI Knowledge Practice Test 3 — 15 Questions

Question 1

In the context of NVIDIA's Tensor Core architecture, what is the primary purpose of 'Sparsity' support?

Accepted Answer

To double the computational throughput during GEMM operations.. NVIDIA's Fine-Grained Structured Sparsity is a hardware feature that allows the GPU to skip computations for zero-valued weights in neural networks. By enforcing a 2:4 sparsity pattern (where at least 2 out of every 4 consecutive weights are zero), the hardware can double the throughput of matrix multiplication operations. This feature is vital for accelerating LLMs without sacrificing model accuracy, as it effectively doubles compute density on supported modern NVIDIA architectures.

Answer

To reduce the amount of VRAM consumed by model weights.

Answer

To automatically prune the model during the training process.

Answer

To allow models to run without any normalization layers.

Question 2

When implementing Retrieval-Augmented Generation (RAG), why is the choice of 'Chunk Size' critical for model retrieval performance?

Accepted Answer

It determines the semantic density and context of retrieved segments.. Chunk size determines how much context is included in a single document segment during the retrieval process. If chunks are too small, the model lacks sufficient context to answer complex queries. If they are too large, the retrieval results contain excessive noise, causing the model to lose focus. Optimizing this balance is a core task in RAG engineering to ensure that the retrieved information is both relevant and comprehensive enough for the model to generate accurate responses.

Answer

It directly limits the number of documents in the vector database.

Answer

It affects the latency of the embedding model's inference.

Answer

It is solely determined by the GPU's memory capacity.

Question 3

Refer to the exhibit. This error occurs during the training of an LLM. What is the most likely cause for this 'device-side assert' error?

Accepted Answer

The target indices exceed the vocabulary size.. A device-side assert error in PyTorch usually indicates an index-out-of-bounds error or a shape mismatch during a kernel operation on the GPU. When the loss function expects a specific range of indices for targets (e.g., in a cross-entropy loss), providing values that exceed the vocab size triggers this assertion. This is a common debugging hurdle that highlights the importance of rigorous input data validation before submitting tensors to the GPU's highly optimized, non-interactive kernels.

Answer

The model has run out of VRAM for the current batch.

Answer

The GPU has overheated and shut down.

Answer

The learning rate is set too high for convergence.

Question 4

Which of the following describes the 'Warm-up' phase in the context of training deep neural networks?

Accepted Answer

Gradually increasing the learning rate at the start of training.. Warm-up is a technique where the learning rate starts at a very low value and is gradually increased over the first few hundred or thousand steps. This prevents the model from diverging early in the training process when weights are randomly initialized and gradients can be unstable. Proper warm-up is essential for successfully scaling the training of modern LLMs on large compute clusters, ensuring stable convergence from the very first iterations.

Answer

Pre-loading the model into the GPU cache.

Answer

A method to reduce training time by caching gradients.

Answer

Reducing the batch size to fit in memory.

Question 5

When utilizing Pipeline Parallelism (PP) in LLM training, what is the 'pipeline bubble' and how is it minimized?

Accepted Answer

Idle GPU time during stage-to-stage communication.. The pipeline bubble is the idle time GPUs spend waiting for activations or gradients to propagate across the pipeline stages. It is minimized using techniques like Micro-batching, which breaks a single global batch into smaller units. By interleaving these units, the GPU stages can remain active more consistently, significantly increasing the pipeline's overall utilization and throughput, which is essential for scaling models that cannot fit on a single GPU's memory.

Answer

Memory overflow caused by large context windows.

Answer

The overhead of gradient accumulation steps.

Answer

The delay caused by slow NVLink interconnects.

Question 6

A data scientist is training a transformer model and observes that the training loss is decreasing while the validation loss is increasing. Which technique should be prioritized to address this specific generalization challenge?

Accepted Answer

Implement L2 regularization (weight decay) on the model weights.. This scenario indicates overfitting, where the model captures noise in the training set rather than the underlying distribution. Regularization techniques like Dropout, weight decay, or early stopping are essential to improve model generalization. By limiting the model's ability to memorize the training data, these methods ensure that the weights remain small and the model learns robust patterns that perform better on unseen, held-out validation datasets.

Answer

Increase the depth of the transformer architecture layers.

Answer

Reduce the batch size to increase stochasticity during training.

Answer

Decrease the number of training epochs to save time.

Question 7

Refer to the exhibit. Which technique is most appropriate to prevent this specific training failure?

Accepted Answer

Apply gradient clipping during the backpropagation step.. The exhibit shows a classic case of the exploding gradient problem, where large weight updates lead to numerical instability and NaN loss values. This is common in deep architectures, particularly RNNs or deep Transformers. Gradient clipping is the standard solution to constrain the norm of the gradients during backpropagation, ensuring that updates remain within a numerically stable range, thereby preventing the model parameters from reaching infinity or NaN states.

Answer

Increase the learning rate to bypass the threshold.

Answer

Remove the normalization layers to increase model capacity.

Answer

Change the optimizer from Adam to SGD without momentum.

Question 8

Which machine learning paradigm involves an agent learning to make decisions by performing actions in an environment to maximize a cumulative reward?

Accepted Answer

Reinforcement Learning. Reinforcement Learning (RL) is fundamentally about agents interacting with environments. Unlike supervised learning, which relies on labeled datasets, or unsupervised learning, which finds hidden structures, RL uses a feedback loop of rewards and penalties. This paradigm is crucial for robotics, game playing, and autonomous systems where the optimal sequence of actions is not pre-defined, but must be discovered through trial and error.

Answer

Supervised Learning

Answer

Unsupervised Learning

Answer

Transfer Learning

Question 9

In the context of Large Language Models, what is the primary purpose of 'Attention mechanisms' as introduced in the Transformer architecture?

Accepted Answer

To compute dynamic weights representing the relevance of tokens.. Attention mechanisms allow models to weigh the significance of different tokens in an input sequence relative to one another, regardless of their distance. By computing relevance scores, the model can capture long-range dependencies effectively. This capability is crucial for understanding context, syntax, and semantics, which were historically difficult for sequential models like RNNs that struggled with information retention over long sequences during the training process.

Answer

To reduce the number of parameters in the model.

Answer

To process input sequences sequentially for better memory.

Answer

To enforce a fixed context window for all inputs.

Question 10

Which THREE of the following are valid methods for improving the inference performance of a deployed deep learning model?

Accepted Answer

Quantization. Optimizing inference is critical for real-time AI applications. Techniques like quantization reduce precision, lowering memory footprint and increasing throughput. Model pruning removes redundant parameters, reducing computational cost without significant loss in accuracy. Finally, knowledge distillation transfers the capabilities of a large, high-performance 'teacher' model into a smaller, faster 'student' model, providing a highly optimized deployment candidate that maintains the intelligence of its larger predecessor while being significantly more efficient.

Answer

Increasing the number of hidden layers

Answer

Data Augmentation

Question 11

In the context of generative AI, what is the 'mode collapse' problem in GANs, and why is it a significant challenge?

Accepted Answer

The generator fails to produce diverse samples.. Mode collapse occurs when the generator in a Generative Adversarial Network learns to map several input noise vectors to the same output or a very limited set of outputs. This prevents the generator from capturing the full diversity of the target data distribution. It is a major challenge because it defeats the purpose of generative modeling, which is to produce a wide range of realistic, diverse samples that represent the training distribution.

Answer

The generator output becomes purely random noise.

Answer

The discriminator becomes too powerful to train.

Answer

Training loss increases monotonically to infinity.

Question 12

Refer to the exhibit. Which hyperparameter configuration in the provided JSON is directly responsible for preventing overfitting through weight penalty?

Accepted Answer

weight_decay. The JSON defines a standard configuration for model training. The 'weight_decay' key is the parameter that implements L2 regularization. By penalizing large weight values in the loss function, it discourages the model from relying too heavily on specific features, thereby preventing overfitting. This is a common and essential hyperparameter to tune when training deep neural networks to ensure good generalization on unseen test data, as shown by the provided value of 0.05.

Answer

dropout_rate

Answer

learning_rate_scheduler

Answer

enable_gradient_check

Question 13

Which of the following activation functions is most commonly used in hidden layers of deep neural networks to mitigate the vanishing gradient problem?

Accepted Answer

ReLU. The Rectified Linear Unit (ReLU) is the standard activation function for deep networks. Unlike Sigmoid or Tanh, which saturate at high and low values, ReLU maintains a constant gradient of 1 for all positive inputs. This effectively prevents the gradient from vanishing during backpropagation across many layers, allowing for the training of much deeper architectures without needing complex initialization or normalization schemes.

Answer

Sigmoid

Answer

Tanh

Answer

Linear

Question 14

What is the primary function of the 'Softmax' layer at the output of a multi-class classification model?

Accepted Answer

To convert logits into a probability distribution.. The Softmax function converts the raw output scores (logits) of the final layer into a probability distribution. This involves exponentiating each score and normalizing by the sum of all exponentiated scores, ensuring all outputs are in the range (0, 1) and sum to exactly 1.0. This makes the model's output directly interpretable as probabilities for each class, which is vital for decision-making tasks where confidence scores are needed.

Answer

To squash output values to a range of -1 to 1.

Answer

To linearize the output for regression tasks.

Answer

To enforce sparsity on the output vector.

Question 15

Which of the following best defines 'Generalization' in machine learning?

Accepted Answer

The model's performance on previously unseen data.. Generalization is the model's ability to perform accurately on new, unseen data that was not part of the training set. A model that performs perfectly on training data but fails on new data has failed to generalize. Achieving high generalization is the ultimate goal of all machine learning, as it ensures that the model provides value in real-world scenarios rather than just memorizing input-output patterns from a specific training batch.

Answer

The ability of a model to memorize training data perfectly.

Answer

The process of reducing the model's parameter count.

Answer

The speed at which a model converges during training.