Generative AI Leader Techniques to Improve Generative AI Model Output Practice Test 3 — 15 Questions

Question 1

A team is using Vertex AI Pipelines to deploy a generative AI model for real-time inference. The model sometimes generates harmful content. They want to implement a safety filter that checks the output before returning it to the user, but they need to minimize latency. Which approach best balances safety and performance?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Use a secondary lightweight classifier to filter outputs in real-time.. Deploying a secondary lightweight classifier (e.g., a distilled BERT or a small logistic regression model) as a post-processing filter allows real-time inference with minimal latency overhead. This approach decouples safety from the primary generative model, enabling fast rejection of harmful outputs without retraining or blocking the main inference pipeline.

Answer

Retrain the model on every flagged harmful output.

Answer

Manually review all outputs before delivery.

Answer

Disable safety checks to improve latency.

Question 2

A developer is using the Gemini API to build a chatbot. They want the model to always respond in a friendly, professional tone. Which prompt engineering technique should they use?

Accepted Answer

Set system instructions to 'You are a friendly and professional assistant.'. Setting system instructions is the most direct and reliable way to define the model's persona and behavioral constraints. In the Gemini API, system instructions act as a persistent, top-level directive that influences every response, ensuring the chatbot consistently adopts a friendly and professional tone without requiring repeated examples or parameter tuning.

Answer

Include a few-shot example in every user message.

Answer

Set the temperature to 0.2.

Answer

Set max output tokens to 100.

Question 3

A team is using a pre-trained language model to summarize legal documents. They find that summaries often miss key dates and parties involved. Which technique would most effectively improve factual accuracy?

Accepted Answer

Fine-tune the model on a dataset of legal summaries with annotated key entities.. Fine-tuning on a dataset of legal summaries with annotated key entities directly teaches the model to recognize and reproduce critical factual elements like dates and parties. This supervised learning approach adjusts the model's weights to prioritize entity extraction and accurate generation, which is the most effective method for improving factual accuracy in domain-specific tasks.

Answer

Use top-p sampling with a low p value.

Answer

Increase the temperature parameter.

Answer

Use chain-of-thought prompting.

Question 4

A company is deploying a generative AI model for customer support. They want to reduce hallucinations while maintaining fluency. They have a large dataset of previous support conversations. Which strategy should they prioritize?

Accepted Answer

Implement retrieval-augmented generation (RAG) using the conversation dataset as a knowledge base.. Retrieval-augmented generation (RAG) directly addresses hallucinations by grounding the model's responses in factual, retrieved data from the conversation dataset. This approach allows the model to generate fluent, contextually relevant answers while reducing the risk of inventing information, as it retrieves actual support interactions as evidence before generating a response.

Answer

Increase the beam search width to 10.

Answer

Fine-tune the model on the conversation dataset.

Answer

Set the temperature to 0.1.

Question 5

A developer is using Vertex AI Studio to test prompts for a text generation model. They want the model to follow a specific output format (JSON). Which prompt engineering approach is most effective?

Accepted Answer

Include a few-shot example of the exact JSON format in the prompt.. Including a few-shot example of the exact JSON format in the prompt provides the model with a concrete pattern to follow, which is the most reliable method for enforcing structured output in generative models. Few-shot prompting leverages in-context learning, where the model uses the provided example to infer the desired schema and formatting rules, reducing ambiguity and improving adherence to the specified JSON structure.

Answer

Set stop sequences to '}'.

Answer

Set the system instruction to 'Always output JSON.'

Answer

Set temperature to 0 to make output deterministic.

Question 6

Which TWO techniques can help improve the factual accuracy of a language model's outputs? (Choose two.)

Accepted Answer

Fine-tune on a domain-specific curated dataset.. Fine-tuning on a domain-specific curated dataset (C) directly adjusts the model's weights using high-quality, verified examples, teaching it to produce factually correct outputs for that domain. This reduces hallucinations by grounding the model in accurate, relevant data rather than relying solely on its pre-training distribution.

Answer

Decrease the max output tokens.

Answer

Increase the temperature parameter.

Answer

Use top-k random sampling.

Question 7

Which THREE approaches are effective for reducing bias in generative model outputs? (Choose three.)

Accepted Answer

Use a balanced training dataset.. A balanced training dataset reduces the risk of the model learning spurious correlations or skewed distributions that lead to biased outputs. By ensuring that all demographic groups, topics, or perspectives are represented proportionally, the model's learned probability distribution is less likely to favor one group over another, directly mitigating representation bias at the data level.

Answer

Set temperature to a very high value.

Answer

Use adversarial training.

Question 8

A media company is using Vertex AI's Imagen model to generate images for marketing campaigns. They have a set of prompts that describe desired scenes, but the generated images often contain artifacts such as distorted faces or unnatural lighting. The team has tried varying the prompt wording but the issues persist. They are using the default parameters (no modifications). They have a budget for additional compute resources and want to improve image quality without switching to a more expensive model. The team has access to a small set of high-quality images in the same style as their target outputs. What should the team do?

Accepted Answer

Fine-tune the Imagen model on the small set of high-quality images to improve output quality.. Fine-tuning the Imagen model on the small set of high-quality images allows the model to learn the desired style and reduce artifacts like distorted faces and unnatural lighting, improving output quality without switching to a more expensive model. Option A is incorrect because increasing the guidance scale may cause the model to overfit to the prompt and potentially introduce more artifacts rather than fix them, and the team already has issues with prompt adherence. Option B is incorrect because using more detailed prompts with negative prompts might help but the team already tried varying wording without success; the root cause is the model's lack of specific training on the desired quality, which fine-tuning directly addresses. Option D is incorrect because generating more images per prompt does not improve the per-image quality; it only increases the chance of finding a good one, and the team wants to improve overall image quality.

Answer

Increase the guidance scale parameter to make the model follow prompts more closely.

Answer

Use a more detailed prompt style with negative prompts to avoid artifacts.

Answer

Increase the number of images generated per prompt and manually select the best ones.

Question 9

You are a Generative AI architect at a large financial services firm. The firm has deployed a custom large language model (LLM) fine-tuned on proprietary financial reports to assist analysts in generating quarterly earnings summaries. The model is hosted on Vertex AI using a dedicated endpoint with autoscaling enabled. Recently, the model's output has exhibited two issues: (1) occasional factual inaccuracies about specific financial figures, and (2) a tendency to produce overly verbose and repetitive text in the summaries, sometimes exceeding the desired length of 200 words. The team has already tried adjusting the temperature parameter from 0.7 to 0.2 and increased the top-k sampling from 40 to 50, but the problems persist. The model's training data includes over 10,000 financial reports, and the fine-tuning process used low-rank adaptation (LoRA) with rank 16. The production environment uses a batch size of 1 for inference. You need to recommend a course of action that most directly addresses both the factual accuracy and verbosity issues without requiring a full retraining of the model. Which approach should you take?

Accepted Answer

Implement a retrieval-augmented generation (RAG) pipeline that queries a vector database of verified financial data, and apply constrained decoding with a maximum token limit and a repetition penalty.. It directly addresses both issues without retraining. A RAG pipeline grounds the model's outputs in verified financial data, eliminating factual inaccuracies. Constrained decoding with a maximum token limit and repetition penalty directly curbs verbosity and repetition, which temperature and top-k adjustments failed to fix.

Answer

Increase the LoRA rank to 32 and fine-tune the model for additional epochs on a curated subset of reports that focus on concise and accurate summaries.

Answer

Switch to a larger pre-trained model (e.g., PaLM 2 or GPT-4) and use the same fine-tuning data with higher rank LoRA to improve capability, then rely on the larger model's inherent accuracy.

Answer

Experiment with higher temperature (e.g., 0.9) and lower top-k (e.g., 20) to encourage more diverse and concise outputs, and add a post-processing step to truncate summaries to 200 words.

Question 10

A company notices that their AI chatbot occasionally generates incorrect information. Which technique can best reduce hallucinations without retraining?

Accepted Answer

Use system instructions to constrain the model to only answer from provided context. Constraining the model to answer only from provided context directly addresses the root cause of hallucinations—the model generating information not grounded in verified sources. This technique, often implemented via system instructions or retrieval-augmented generation (RAG) pipelines, forces the model to rely on a trusted knowledge base rather than its parametric memory, effectively eliminating unsupported fabrications without requiring retraining.

Answer

Use a longer system prompt without examples

Answer

Set top_p to 0.1

Answer

Increase temperature to 0.9

Question 11

A team wants to improve the factual accuracy of their chatbot responses regarding internal company policies. What is the most effective approach?

Accepted Answer

Use RAG with Vertex AI Search indexing the policies. RAG with Vertex AI Search is the most effective approach because it retrieves relevant, up-to-date policy documents from a curated index and injects them into the prompt context at inference time, grounding the chatbot's responses in authoritative sources without modifying the underlying model. This ensures factual accuracy for dynamic or evolving policies, as the model can reference the exact text rather than relying on static training data.

Answer

Use few-shot prompting with example Q&A pairs

Answer

Increase the model's maximum tokens

Answer

Fine-tune the model on policy documents

Question 12

A real-time customer support chatbot using Gemini is experiencing high latency. The team must maintain response quality while improving speed. Which technique should they implement?

Accepted Answer

Use context caching for frequent queries. Context caching reduces latency by storing frequently accessed query responses or intermediate computations, allowing the chatbot to reuse precomputed results instead of reprocessing identical or similar requests through the full model pipeline. This directly addresses high latency in real-time systems while preserving response quality, as the cached outputs are identical to freshly generated ones for the same input.

Answer

Switch to a larger model

Answer

Increase the batch size

Answer

Decrease the temperature

Question 13

A marketing company wants to fine-tune a generative AI model to adopt a specific brand voice. Which tuning method is most appropriate?

Accepted Answer

Supervised fine-tuning with labeled examples of the brand voice. Supervised fine-tuning (SFT) is the most appropriate method because it directly trains the model on a curated dataset of input-output pairs that exemplify the desired brand voice. By adjusting the model's weights through backpropagation on labeled examples, the model learns to mimic the specific tone, vocabulary, and stylistic patterns of the brand, making it the most precise approach for adopting a fixed voice.

Answer

RLHF with general user feedback

Answer

Grounding with external knowledge base

Answer

Prompt engineering with system instructions

Question 14

Despite applying safety filters, a generative AI model still produces toxic outputs in some cases. Which additional technique should be applied?

Accepted Answer

Use RLHF with human feedback to reduce toxicity. RLHF (Reinforcement Learning from Human Feedback) directly addresses toxicity by using human evaluators to rank model outputs, then fine-tuning the model to prefer less toxic responses. This technique teaches the model to avoid harmful patterns that safety filters might miss, as filters are static and can be bypassed by adversarial prompts or nuanced toxicity.

Answer

Add more examples of toxic content to training

Answer

Increase the filter threshold

Answer

Decrease the model's temperature

Question 15

A model generates responses that frequently repeat phrases or words. Which parameter adjustment is most likely to fix this?

Accepted Answer

Increase repetition penalty. Increasing the repetition penalty directly discourages the model from selecting tokens that have already appeared in the generated sequence, thereby reducing repetitive phrases or words. This parameter works by subtracting a fixed penalty from the logits of previously generated tokens before applying the softmax function, making them less likely to be chosen again.

Answer

Increase top_k

Answer

Increase temperature

Answer

Increase max output tokens