NCA-GENL Practice Test 10 — 10 Questions

Question 1

Refer to the exhibit. Which technique is most appropriate to prevent this specific training failure?

Accepted Answer

Apply gradient clipping during the backpropagation step.. The exhibit shows a classic case of the exploding gradient problem, where large weight updates lead to numerical instability and NaN loss values. This is common in deep architectures, particularly RNNs or deep Transformers. Gradient clipping is the standard solution to constrain the norm of the gradients during backpropagation, ensuring that updates remain within a numerically stable range, thereby preventing the model parameters from reaching infinity or NaN states.

Answer

Increase the learning rate to bypass the threshold.

Answer

Remove the normalization layers to increase model capacity.

Answer

Change the optimizer from Adam to SGD without momentum.

Question 2

What is the primary benefit of tracking experiments using a centralized experiment management platform (e.g., Weights & Biases, MLflow)?

Accepted Answer

It ensures reproducibility by logging parameters and code state.. Centralized tracking provides a historical log of all runs, parameters, code versions, and results. This traceability is critical for reproducibility, allowing researchers to compare outcomes across months or even different team members. In an enterprise NVIDIA environment, this documentation prevents redundant experimentation and ensures that the best-performing models are easily identified and promoted for deployment into production.

Answer

It automatically scales GPU resources based on workload.

Answer

It enforces strict security policies on data access.

Answer

It increases the training speed of the LLM model.

Question 3

When deploying an LLM, what is the 'Time to First Token' (TTFT) metric used to measure?

Accepted Answer

The latency experienced before generation begins.. TTFT measures the delay between sending an inference request and receiving the first piece of generated text. This is a crucial metric for user experience because a long TTFT makes an application feel unresponsive. Developers must optimize model loading, initial compute, and network latency to keep this time low, ensuring that the generative response feels immediate and interactive for the end user during the application's runtime.

Answer

The total time taken to train the model.

Answer

The average number of tokens generated per second.

Answer

The amount of memory required to store the model.

Question 4

Refer to the exhibit. A developer wants to make the model's output more deterministic and focused on highly probable tokens. Which change should be made to the configuration policy?

Accepted Answer

Decrease temperature to 0.1 and top_p to 0.5.. Determinism in LLMs is controlled by the temperature and top-p sampling parameters. Lowering temperature reduces the randomness in the probability distribution, while lowering top-p restricts the sampling pool to a smaller subset of high-probability tokens. Adjusting these parameters is vital for applications requiring factual consistency and stable outputs, as they directly dictate the sampling strategy used during the token generation process in the inference engine.

Answer

Increase temperature to 1.5 and top_p to 1.0.

Answer

Set presence_penalty to 1.0.

Answer

Increase max_tokens to 4096.

Question 5

You are performing a bias audit on a fine-tuned chat model. You need to visualize the model's responses to sensitive prompts across various demographic categories. Which visualization is most effective for identifying systemic bias?

Accepted Answer

Grouped violin plots of toxicity scores by demographic. Grouped box plots or violin plots of sentiment or 'toxicity' scores are the standard for bias audits. By plotting these scores for different demographic categories (e.g., gender, ethnicity), you can easily identify statistical shifts in model response patterns. These visualizations make it clear if the model is behaving differently toward specific groups, which is critical for meeting ethical safety standards in production-ready generative AI.

Answer

A scatter plot of token generation speed

Answer

A simple bar chart of total word counts

Answer

A matrix plot of model layer activations

Question 6

Refer to the exhibit. What is the primary risk indicated by the provided logs for this training job?

Accepted Answer

An Out of Memory (OOM) error is imminent.. The logs indicate that GPU memory usage is steadily climbing toward the physical limit of 40GB, reaching 100% capacity at step 5020. This indicates a potential memory leak or an unoptimized batch size, which will soon result in an 'Out of Memory' (OOM) error. Detecting this upward trend early allows developers to adjust the batch size or employ techniques like gradient accumulation before the training job crashes, preventing loss of progress and expensive compute time.

Answer

The model is converging too quickly to be stable.

Answer

The learning rate is too low for the current hardware.

Answer

GPU utilization is too low for efficient training.

Question 7

When evaluating a generative model, why is it important to visualize the distribution of output sequence lengths?

Accepted Answer

To identify issues like repetition or infinite generation loops.. Analyzing sequence length distribution is key to detecting issues like 'infinite loops' or 'verbosity bias', where a model generates unnecessarily long or repetitive outputs. Unexpected peaks in the distribution often point to failure modes where the model struggles to reach a coherent stopping point. Visualizing this allows developers to refine stopping criteria and penalize excessive verbosity, ensuring that the final output is concise, relevant, and efficient for end-users in real-time applications.

Answer

To determine the optimal GPU batch size.

Answer

To measure the training loss convergence rate.

Answer

To visualize the internal weight distribution.

Question 8

Which of the following is a key requirement for achieving 'Transparency' in the context of NVIDIA-certified Generative AI solutions?

Accepted Answer

Documenting model limitations, intended use cases, and data characteristics.. Transparency requires providing clear documentation about model limitations, training data sources, and intended use cases. This is critical for Trustworthy AI because it allows developers and stakeholders to make informed decisions about whether a model is appropriate for a specific task. By being open about what the model can and cannot do, organizations reduce the risk of misuse and build legitimate, evidence-based trust with their users and stakeholders.

Answer

Publishing the exact weights of the model to the public internet.

Answer

Eliminating all non-deterministic behaviors to ensure 100% output consistency.

Answer

Ensuring the model always answers with a neutral tone.

Question 9

A researcher is experimenting with prompt-tuning and finds that the model output is repetitive. They decide to adjust the sampling hyperparameters. Which combination of changes is most likely to increase the diversity of the output?

Accepted Answer

Increase temperature and increase top-p.. Sampling parameters control the trade-off between coherence and creativity. Increasing temperature shifts the probability distribution, allowing for less likely tokens to be selected, while increasing top-p (nucleus sampling) expands the set of tokens considered. Balancing these allows researchers to explore the model's creative range during experimentation, ensuring the output is varied enough to be useful while maintaining sufficient logical coherence for the application's specific requirements.

Answer

Decrease temperature and decrease top-p.

Answer

Set temperature to 0 and top-p to 1.

Answer

Increase frequency penalty and decrease top-p.

Question 10

You are conducting an error analysis on an LLM's performance. Which THREE visualizations are most effective for identifying where the model struggles with factual accuracy in a RAG (Retrieval-Augmented Generation) pipeline?

Accepted Answer

Cosine similarity distribution of retrieved documents. In a RAG pipeline, failure often stems from the retrieval stage (fetching irrelevant context) or the generation stage (hallucination). Visualizing retrieval precision, cosine similarity between retrieved chunks and the query, and the correlation between context relevance and final answer accuracy allows engineers to isolate the failure point. These insights are essential for tuning the retriever, improving document indexing, and refining the prompt engineering for better grounded output.

Answer

A pie chart of the model's total word count

Answer

The memory usage of the vector database