NCA-GENL Trustworthy AI Practice Test 4 — 15 Questions

Question 1

An enterprise is deploying an NVIDIA NIM-hosted LLM for internal knowledge management. The security team wants to harden the deployment against prompt injection and jailbreak attempts before go-live. Which two measures should be implemented? (Choose two.)

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Deploy NeMo Guardrails with input rails that detect and block known jailbreak patterns and instruction-override attempts.. Defending against prompt injection and jailbreaks requires both a runtime detection layer and sound prompt construction. NeMo Guardrails input rails catch known malicious patterns before generation, while strict separation of system instructions from user content prevents injected text from being interpreted as authoritative. The remaining options either weaken security posture, harm reliability, or remove the observability needed to improve defenses over time.

Answer

Increase the model temperature to make outputs less predictable to attackers.

Answer

Disable logging of prompts and responses to reduce the attack surface of the logging system.

Answer

Store API keys in the client-side application to simplify authentication for internal users.

Question 2

A healthcare analytics team uses an LLM to summarize patient notes for clinician review. The team observes that summaries for patients from one demographic group systematically omit certain chronic conditions that appear in the source notes. Which action most directly addresses this Trustworthy AI failure?

Accepted Answer

Measure summarization completeness per demographic subgroup and retrain or adjust the pipeline until omission rates are comparable across groups.. A subgroup-specific pattern of omitted chronic conditions is a fairness defect that must be quantified before it can be fixed. Measuring completeness per demographic group establishes whether the disparity is real and whether interventions work. Disclaimers, longer summaries, and larger models are generic changes that do not target the measured gap and cannot demonstrate that equitable performance has been achieved in this clinical setting.

Answer

Switch to a larger foundation model with a longer context window so that the entire patient record fits in a single prompt.

Answer

Add a disclaimer to every generated summary stating that the output may be incomplete and must be verified by a clinician.

Answer

Increase the maximum summary length so that the model has more room to include every condition mentioned in the source note.

Question 3

A financial services firm deploys an LLM assistant that summarizes earnings calls for analysts. Legal requires that the firm be able to reconstruct, months later, exactly which model version and prompt template produced a given summary, and that any later model update not silently change historical outputs. Which practice best meets this requirement?

Accepted Answer

Log prompt text, model identifier, model version hash, decoding parameters, and a timestamp for every generation, and pin the model version used for each summary.. Reproducibility and change control require per-generation records that tie each summary to its prompt, model identity, decoding settings, and time, plus deliberate version pinning so later updates cannot rewrite history. Comprehensive logging plus pinned versions gives auditors the evidence chain they need. Aggregate metrics and public changelogs lack the granularity and control to reconstruct or stabilize individual outputs.

Answer

Store only the final generated summary text in the analyst-facing document repository.

Answer

Enable a monthly email digest that lists the total number of summaries generated per analyst.

Answer

Rely on the model provider's public changelog to determine which version was active on any given date.

Question 4

An AI team is deploying an LLM-based coding assistant. They observe that the model sometimes generates insecure code snippets, such as hardcoded credentials or SQL injection vulnerabilities. To mitigate this without retraining the model, which approach aligns with NVIDIA's Trustworthy AI recommendations?

Accepted Answer

Implement a post-processing output rail that scans generated code for known vulnerability patterns and blocks or flags them.. A post-processing output rail is the most direct mitigation because it inspects the generated code before it reaches the user, using static analysis or pattern matching to catch vulnerabilities. It does not require retraining and can be updated as new vulnerability patterns emerge. The other options either increase risk, require retraining, or do not target the security of the output.

Answer

Restrict the model's context window to limit the amount of code it can generate, reducing the chance of vulnerabilities.

Answer

Fine-tune the model on a dataset of secure code snippets to teach it to avoid vulnerabilities.

Answer

Increase the model's temperature to encourage more diverse code suggestions, reducing the chance of insecure patterns.

Question 5

A financial services firm is deploying an NVIDIA NIM microservice for an internal LLM assistant that summarizes confidential client portfolios. The security team wants to enforce that every prompt and completion is screened for PII and prompt-injection attempts before reaching the model. Which two NVIDIA components are purpose-built for this enforcement layer? (Choose two.)

Accepted Answer

NVIDIA Morpheus. NeMo Guardrails provides the programmable input/output rail layer that inspects and blocks prompts and completions, while Morpheus supplies accelerated cybersecurity inspection of the data stream for sensitive information. Together they create defense in depth around the NIM microservice without modifying the model itself. Triton, Nsight Systems, and TensorRT-LLM address serving, profiling, and optimization respectively, none of which enforce content policy or detect PII.

Answer

NVIDIA TensorRT-LLM

Answer

NVIDIA Nsight Systems

Answer

NVIDIA Triton Inference Server

Question 6

A healthcare organization is preparing to deploy an LLM-based clinical documentation assistant. The Trustworthy AI review board requires evidence that the model's outputs are safe and reliable before go-live. Which two practices should the team implement to provide this evidence? (Choose two.)

Accepted Answer

Establish a continuous evaluation harness that scores model outputs against a held-out clinical benchmark and tracks metrics over time.. Adversarial red-teaming with clinicians and a continuous evaluation harness together provide both qualitative and quantitative evidence of safety and reliability. Red-teaming uncovers edge-case failures, while the harness tracks performance against a clinical benchmark over time. Combined, they give the review board documented, repeatable assurance that the assistant behaves safely across diverse patient scenarios.

Answer

Increase the model's temperature setting to encourage more creative and varied clinical documentation.

Answer

Fine-tune the model on a small curated dataset of ideal clinical notes and assume the fine-tuning eliminates all unsafe outputs.

Answer

Deploy the model in shadow mode for a single day and rely on informal developer feedback as the sole safety assessment.

Question 7

A retail company wants its customer-facing LLM assistant to refuse requests for medical advice, legal advice, and instructions for dangerous activities. The team needs a runtime mechanism that inspects both user input and model output and can block or rewrite disallowed content without retraining the base model. Which NVIDIA component is designed for this purpose?

Accepted Answer

NVIDIA NeMo Guardrails. The requirement is runtime inspection and control of both user input and model output against topical policies, without retraining. NeMo Guardrails is the NVIDIA component purpose-built for defining and enforcing such conversational rails. The other options address inference speed, model serving infrastructure, or performance profiling, none of which can express or enforce content policies in a live assistant.

Answer

NVIDIA TensorRT-LLM

Answer

NVIDIA Triton Inference Server

Answer

NVIDIA Nsight Systems

Question 8

A retail company wants to let its support chatbot answer questions using internal policy documents, but executives fear the model will invent policies that do not exist. Which approach most directly reduces fabricated policy answers while keeping responses grounded in the approved documents?

Accepted Answer

Retrieve relevant passages from the approved policy corpus and require the model to answer only from those passages, citing them.. Grounding responses in an approved corpus through retrieval and citation is the most direct control against fabricated policies. Supplying the authoritative passages at inference time limits the model to what the documents actually say, and citations let reviewers verify each claim. Temperature, token limits, and fine-tuning change style, length, or memorized content but do not bind answers to an auditable source of truth.

Answer

Fine-tune the model on the entire policy corpus so the knowledge is baked into the weights.

Answer

Lower the temperature to zero so the model always selects the single most probable token.

Answer

Increase the max_tokens parameter so the model has room to explain its reasoning in full.

Question 9

A retail company uses an LLM to generate product descriptions. A reviewer notices that descriptions for kitchen knives are consistently written in a more aggressive tone than descriptions for other product categories, and that the model refuses to describe certain cultural cookware items at all. The team wants to understand which trustworthiness property is most directly implicated by these observations.

Accepted Answer

Model fairness, because the model produces systematically different treatment across product categories and cultural items.. The observations describe systematically different treatment across product categories and cultural items, which is the defining symptom of a fairness problem. Fairness focuses on whether a model applies consistent, equitable standards across groups. Other properties such as latency, provenance, and interpretability may be relevant to a broader investigation, but they do not directly name the unequal-treatment behavior the reviewer observed.

Answer

Data provenance, because the company cannot trace which supplier provided the product catalog.

Answer

Model interpretability, because the team cannot read the model's internal attention weights.

Answer

Model latency, because refusal behavior indicates the inference server is timing out on certain prompts.

Question 10

A global retailer uses an NVIDIA-powered LLM to generate product descriptions in multiple languages. The compliance team requires that the model's outputs do not contain culturally insensitive or legally restricted terms in any target market. Which evaluation practice should be implemented to detect such issues before deployment?

Accepted Answer

Conduct red teaming exercises with native speakers to probe for culturally insensitive or legally restricted outputs.. Red teaming with native speakers is the most effective way to identify culturally insensitive or legally restricted terms because it leverages human judgment and local expertise. Automated benchmarks and sentiment analysis lack the contextual understanding needed for multi-language compliance. Adjusting temperature does not filter content and may introduce more risk.

Answer

Increase the model's temperature during generation to produce more varied descriptions, reducing the chance of restricted terms.

Answer

Run a standard benchmark like MMLU to measure the model's general language understanding across languages.

Answer

Use automated sentiment analysis to flag negative tones in the generated descriptions.

Question 11

A retail company is using NVIDIA NeMo Guardrails to build a customer-facing shopping assistant. The security team wants to prevent users from extracting the system prompt or instructing the model to ignore its safety rules. Which guardrail type should be configured first to intercept these attempts before they reach the LLM?

Accepted Answer

Input rails that detect and block prompt injection and jailbreak patterns in the user message.. Input rails inspect the user message before it reaches the model, making them the correct first layer to block prompt injection and jailbreak attempts. By rejecting malicious inputs early, the assistant never processes instructions that could extract the system prompt or bypass safety rules. Output and retrieval rails address different stages and are complementary, not primary, for this threat.

Answer

Dialog rails that redirect the conversation to a fallback topic when the user asks about shopping.

Answer

Retrieval rails that filter the documents returned by the RAG pipeline before they are added to the context.

Answer

Output rails that scan the model's response for sensitive content before returning it to the user.

Question 12

A hospital's AI governance committee is reviewing a generative model that drafts discharge summaries. They require a documented, auditable record showing which source documents, consent forms, and preprocessing steps produced each training example. Which Trustworthy AI practice does this requirement describe?

Accepted Answer

Data lineage tracking. The committee wants to trace each training example back to its source documents, consent forms, and preprocessing operations, which is precisely what data lineage tracking captures and preserves for audit. Privacy-enhancing techniques such as differential privacy or federated learning change how data is used but do not document its origin, and quantization is purely an inference optimization. Only lineage tracking yields the traceable, reviewable record the governance process demands.

Answer

Federated learning

Answer

Differential privacy

Answer

Model quantization

Question 13

An AI governance team is preparing an NVIDIA-hosted LLM for a regulated financial service. They need a documented, repeatable method to detect whether the model produces systematically different approval recommendations for otherwise identical applicants across demographic groups. Which practice best meets this need?

Accepted Answer

Conduct a structured bias evaluation using counterfactual test cases that vary only protected attributes and compare approval rates across groups.. Counterfactual testing is the standard way to isolate disparate treatment: by changing only the protected attribute across otherwise identical applicants, any shift in recommendation is attributable to that attribute, and group-level approval rates quantify the disparity. Leaderboards, self-reports, and latency monitoring cannot produce a reproducible, documented fairness metric tied to matched inputs, so they fail the governance requirement.

Answer

Ask the model to self-report whether its own recommendations are biased and record the responses.

Answer

Run the model through a public leaderboard benchmark and publish the aggregate accuracy score.

Answer

Monitor production traffic for anomalous latency spikes that might indicate unequal treatment of certain requests.

Question 14

An enterprise is preparing an LLM-based document assistant for internal use and must demonstrate accountability for Trustworthy AI to its auditors. Which two practices most directly provide verifiable accountability for the assistant's behavior? (Choose two.)

Accepted Answer

Maintain an immutable audit log that records prompts, retrieved sources, model versions, and generated responses for each interaction.. Verifiable accountability rests on two complementary pillars: a durable record of what the system did, and a governed process that assigns responsibility for what it is allowed to do. Immutable logging supplies the evidentiary trail, while documented roles and approval gates supply the human ownership and change control. Together they let auditors reconstruct decisions and confirm that modifications were reviewed by accountable parties before reaching users.

Answer

Publish the assistant's system prompt on the company intranet so employees understand how the model is instructed to behave.

Answer

Collect user satisfaction ratings after each interaction and display the rolling average on a dashboard for leadership.

Answer

Run a one-time red teaming exercise before launch and archive the final report in the project repository.

Question 15

An AI team is preparing to release an LLM-powered legal research assistant. Before launch, they want to quantify how often the model produces confident but unsupported legal citations. Which evaluation approach most directly measures this failure mode?

Accepted Answer

Run a benchmark of legal queries and score each generated citation against an authoritative case-law database to compute a hallucination rate.. Directly testing whether generated citations exist and support their propositions requires checking them against an authoritative case-law source. Aggregating those checks yields a concrete hallucination rate that can be compared across versions and prompts. Response length, user surveys, and perplexity all measure adjacent qualities but cannot verify factual grounding, so they would not quantify the specific failure mode.

Answer

Measure the average response length in tokens across a sample of legal queries.

Answer

Compare the model's perplexity on a held-out set of legal documents to its perplexity on general web text.

Answer

Survey the legal team to ask whether they generally trust the assistant's answers.