NCA-GENL Data Analysis and Visualization Practice Question
Exhibit
{"task": "eval_latency", "metric": "p99", "value": 145.2, "unit": "ms", "threshold": 150.0, "status": "PASS"}Refer to the exhibit. A monitoring script outputs this JSON for an LLM inference service. What does the 'p99' metric represent in this context?
⚠ Common exam trap
Candidates frequently confuse p99 with the average or median latency. They assume it represents the typical request, failing to realize it captures the worst-case tail latency experienced by users.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
The latency of the slowest 1% of requests.
The p99 metric represents the 99th percentile of latency, meaning 99% of requests are processed in under 145.2 milliseconds. In LLM production, p99 is the critical industry standard for measuring tail latency, ensuring that even the slowest requests remain within acceptable bounds for user experience. Monitoring this metric is vital because it reveals transient performance bottlenecks that averages or medians hide, ensuring reliable service levels for real-time generative AI applications.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
The average latency of all requests processed.
Why it's wrong here
The average latency provides a central tendency but fails to highlight the performance of the slowest requests, which are the most critical for user experience. By focusing on the mean, developers ignore the tail-end latency issues that lead to perceived system sluggishness or timeouts during peak operational demand.
- ✓
The latency of the slowest 1% of requests.
Why this is correct
The p99 value indicates that 99% of requests meet this threshold, effectively capturing the upper bound of latency for the vast majority of users. It is a vital metric for identifying performance spikes or infrastructure bottlenecks that impact the worst-case scenario user experiences in a production environment.
- ✗
The median latency observed during the period.
Why it's wrong here
The median represents the 50th percentile, which is significantly lower than the p99. Using the median as a benchmark is dangerous in production, as it hides the latency experienced by the remaining 50% of users, potentially masking critical performance degradation occurring at the tail end of the distribution.
- ✗
The total throughput of the inference server.
Why it's wrong here
Throughput is measured in operations per second or requests per second, which is distinct from latency metrics. While latency and throughput are related, the p99 value specifically measures the time taken per individual request, not the total volume of requests handled by the server over a time window.
About these practice questions
This NCA-GENL question is part of Courseiva's 367-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written and reviewed by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
Last reviewed September 2026 · checked against the official NVIDIA exam blueprint
This NCA-GENL practice question is part of Courseiva's free NVIDIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the NCA-GENL exam.