Generative AI Leader Practice Question: Techniques to Improve Generative AI Model Output
A financial technology company has deployed a custom-tuned PaLM 2 model on Vertex AI to generate personalized investment recommendations for retail clients. The model was fine-tuned on a corpus of historical market data and advisory transcripts. Recently, the compliance team flagged that several recommendations contradicted SEC guidelines, and the model sometimes repeated prohibited statements from outdated training materials. The team has already implemented safety filters (e.g., blocking toxic content) and adjusted the model's system instructions to be more conservative. However, the issues persist. The model's deployment parameters are: temperature=0.4, top_p=0.9, max_output_tokens=500, and no grounding. The company must maintain compliance without significantly increasing latency. What should they do next?
⚠ Common exam trap
This exam often tests the misconception that fine-tuning or prompt engineering alone can solve compliance issues, when in fact grounding with authoritative data sources is the only reliable method for ensuring outputs adhere to real-time, external regulations without sacrificing latency.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Configure Vertex AI grounding using a curated data store of real-time SEC regulations and market data
Configuring Vertex AI grounding with a curated data store of real-time SEC regulations directly addresses the root cause: the model is generating outputs that contradict current compliance rules. Grounding forces the model to base its responses on authoritative, up-to-date sources, which is more effective than safety filters or system instructions alone, and it avoids the latency increase of a second model or the risk of catastrophic forgetting from additional fine-tuning.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Increase temperature to 0.7 to allow more diverse responses, and add a second model to verify outputs
Why it's wrong here
Higher temperature increases randomness, likely worsening compliance issues; dual model adds latency.
- ✗
Perform an additional fine-tuning round exclusively on the most recent SEC regulatory filings and compliance-approved content
Why it's wrong here
Fine-tuning requires ongoing updates and may not capture rapidly changing regulations; also risks catastrophic forgetting of other capabilities.
- ✗
Implement a chain-of-thought prompting technique that requires the model to explain its reasoning step by step
Why it's wrong here
Chain-of-thought improves reasoning transparency but does not inherently ground outputs to current, approved data sources.
- ✓
Configure Vertex AI grounding using a curated data store of real-time SEC regulations and market data
Why this is correct
Grounding with a curated Vertex AI data store anchors generation to current SEC regulations, directly addressing the prohibited statements and contradictions sourced from outdated training materials. Unlike fine-tuning, retrieval injects authoritative text at inference time, so compliance updates take effect immediately without retraining. This satisfies the compliance constraint while adding only modest retrieval latency.
Go deeper
Related to this question
About these practice questions
Courseiva writes every Generative AI Leader question from scratch — 1,008 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This Generative AI Leader practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the Generative AI Leader exam.