Generative AI Leader Practice Question: Techniques to Improve Generative AI Model Output
A company is using Vertex AI to generate customer support summaries from chat logs. They notice that the summaries sometimes include irrelevant details from the conversation. Which technique should they use to reduce irrelevant details?
⚠ Common exam trap
A common mistake for Vertex AI summarization is to adjust randomness parameters (top-k or temperature) thinking they will improve focus, but they actually increase variability and can introduce more irrelevant details. The correct technique is to use system instructions to explicitly direct the model to prioritize key points.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Add a system instruction to focus on key points.
Adding a system instruction to focus on key points is the most direct and effective technique for reducing irrelevant details in generated summaries. System instructions act as a persistent, high-level directive that guides the model's attention and output structure without altering the underlying model weights. This allows the model to filter out extraneous information from the chat logs by explicitly prioritizing key points, which is a standard practice in prompt engineering for Vertex AI.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Use a higher top-k value.
Why it's wrong here
Raising top-k widens the sampling pool, so more low-probability tokens survive and extra irrelevant detail increases. It is tempting because higher top-k boosts output variety and coverage in creative or brainstorming tasks, where diverse wording is wanted rather than tight summaries.
- ✗
Fine-tune the model on a large dataset of general conversations.
Why it's wrong here
Fine-tuning on general conversations teaches conversational style, not the summarisation behaviour needed to drop irrelevant chat content. It is tempting because fine-tuning is the standard route to specialise a model, and it works when you have labelled examples of the exact target output.
- ✓
Add a system instruction to focus on key points.
Why this is correct
A system instruction sets persistent behavioural guidance applied to every prompt, so the model weights key points over incidental chat content. This directly targets the irrelevant-detail constraint at generation time, unlike post-processing or prompt-by-prompt tweaks.
- ✗
Increase the temperature parameter.
Why it's wrong here
Higher temperature flattens the probability distribution, making output more random and irrelevant details likelier, not fewer. It is tempting because temperature tuning is the usual lever for creative variation, which suits ideation or marketing copy where novelty matters more than factual focus.
Go deeper
Related to this question
About these practice questions
One of 1,008 original Generative AI Leader practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This Generative AI Leader practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the Generative AI Leader exam.