The correct answer is to reduce the max_output_tokens parameter and enable streaming responses via server-sent events (SSE). Reducing max_output_tokens directly shortens the total generation time by capping the response length, which lowers latency without requiring more compute. Enabling SSE, on the other hand, reduces perceived latency by sending tokens to the user as they are generated, so the first token appears almost instantly even if the full response takes the same time to complete. On the Google Cloud Generative AI Leader exam, this scenario tests your understanding of cost-neutral optimization techniques for Vertex AI chatbots, often appearing as a trap where candidates mistakenly choose to upgrade hardware or increase model size. The key insight is that you can improve user experience without raising costs by controlling output length and leveraging incremental delivery. Memory tip: think “shorter output plus early tokens equals faster feel without bigger bills.”
Generative AI Leader Practice Question: Business Strategies for Generative AI Solutions
This Generative AI Leader practice question tests your understanding of business strategies for generative ai solutions. Read the scenario carefully and evaluate each option against the stated constraints before committing to an answer. After answering, compare your reasoning against the explanation and wrong-answer breakdown below. Once you have made your selection, read the full explanation to reinforce the concept and understand why each distractor is designed to mislead on exam day.
A company has a generative AI chatbot on Vertex AI that shows high response latency. They want to reduce latency without significantly increasing cost. Which TWO actions should they take? (Choose two.)
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Enable streaming responses using server-sent events.
Option B is correct because enabling streaming responses using server-sent events (SSE) allows the chatbot to send tokens incrementally as they are generated, rather than waiting for the full response. This reduces the perceived latency for the end user, as the first token appears much sooner, even though the total generation time may remain similar. This approach directly addresses high response latency without increasing compute cost, as it does not require additional infrastructure or model changes.
Key principle: Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
✗
Increase the min_replica_count to keep more instances always warm.
Why it's wrong here
D is wrong because it increases cost without necessarily reducing latency (cold start avoided but more idle cost).
✓
Enable streaming responses using server-sent events.
Why this is correct
C is correct because streaming gives partial results sooner.
Related concept
Read the scenario before looking for a memorised answer.
✓
Reduce the max_output_tokens parameter in the model configuration.
Why this is correct
B is correct because shorter generation reduces latency.
Related concept
Read the scenario before looking for a memorised answer.
✗
Use machine types with GPUs.
Why it's wrong here
A is wrong because GPUs increase cost and are not always needed.
✗
Switch to a larger model like Gemini 1.5 Pro for better accuracy.
Why it's wrong here
E is wrong because larger models are typically slower.
Common exam traps
Common exam trap: answer the scenario, not the keyword
The trap here is that candidates often confuse reducing latency with reducing total generation time, but streaming only reduces perceived latency by delivering tokens earlier, while options like reducing max_output_tokens actually cut total generation time and cost by limiting output length.
Detailed technical explanation
How to think about this question
Streaming with server-sent events (SSE) leverages the HTTP/1.1 chunked transfer encoding or HTTP/2 server push to deliver partial response payloads. In Vertex AI, the 'streamGenerateContent' API endpoint returns tokens as they are decoded from the transformer model's autoregressive loop, reducing time-to-first-token (TTFT) from the full generation time to just the first inference step. This is particularly effective for long-form text generation where the user sees text appearing in real-time, masking backend processing delays.
KKey Concepts to Remember
Read the scenario before looking for a memorised answer.
Find the constraint that changes the correct option.
Eliminate answers that are true in general but not in this case.
TExam Day Tips
→Watch for words such as best, first, most likely and least administrative effort.
→Review why wrong options are wrong, not only why the correct option is correct.
Key takeaway
Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Real-world example
How this comes up in practice
A startup's cloud architect reviews their monthly bill and notices costs are higher than expected for a long-running batch job. Switching from on-demand instances to Reserved Instances — or using Spot/Preemptible VMs — can reduce compute costs by up to 72 %. Questions like this test whether you understand the tradeoffs between commitment, flexibility, and cost across cloud pricing models.
What to study next
Got this wrong? Here's your next step.
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
What does this Generative AI Leader question test?
Business Strategies for Generative AI Solutions — This question tests Business Strategies for Generative AI Solutions — Read the scenario before looking for a memorised answer..
What is the correct answer to this question?
The correct answer is: Enable streaming responses using server-sent events. — Option B is correct because enabling streaming responses using server-sent events (SSE) allows the chatbot to send tokens incrementally as they are generated, rather than waiting for the full response. This reduces the perceived latency for the end user, as the first token appears much sooner, even though the total generation time may remain similar. This approach directly addresses high response latency without increasing compute cost, as it does not require additional infrastructure or model changes.
What should I do if I get this Generative AI Leader question wrong?
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
What is the key concept behind this question?
Read the scenario before looking for a memorised answer.
About these practice questions
Courseiva creates original exam-style practice questions with explanations and wrong-answer analysis. It does not publish real exam questions, exam dumps, or protected exam content. Learn why practice questions differ from exam dumps →
1 more ways this is tested on Generative AI Leader
These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.
Variation 1. A company deployed a generative AI chatbot using Vertex AI PaLM API for customer support. Users report high latency (average 5 seconds per response). They need to reduce latency without significantly affecting response quality. Which design change should they prioritize?
medium
✓ A.Apply model quantization to the deployed model
B.Migrate the chatbot to run on edge devices
C.Increase the batch size of inference requests
D.Switch to a larger, more powerful foundation model
Why A: Model quantization reduces the precision of the model's weights (e.g., from FP32 to INT8), which decreases the computational load and memory footprint during inference. This directly lowers latency per request on the Vertex AI PaLM API while preserving most of the model's accuracy, making it the most effective single change for reducing response time without significantly degrading quality.
Last reviewed: Jun 25, 2026
Question Discussion
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
This Generative AI Leader practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the Generative AI Leader exam.
Question Discussion
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
Sign in to join the discussion.