Generative AI Leader Practice Question: Business Strategies for Generative AI Solutions
A financial services firm wants to use generative AI to summarize lengthy regulatory documents for compliance officers. They need high accuracy and the ability to reference specific source paragraphs. The team is evaluating a retrieval-augmented generation (RAG) approach on Google Cloud. However, they are concerned about latency when querying large documents. Which architecture change would most effectively reduce response time?
⚠ Common exam trap
Google Cloud often tests the misconception that improving retrieval accuracy or increasing context always benefits latency, when in fact reducing the per-query data volume through smarter chunking is the most direct way to cut response time.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Implement semantic chunking with overlapping to reduce document size per retrieval
Semantic chunking with overlapping reduces the size of each retrieved chunk while preserving context, which directly lowers the amount of text processed per query and speeds up the generation step. This architecture change minimizes latency by ensuring the retriever fetches only the most relevant, compact segments, reducing the load on both the embedding and LLM inference stages.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Switch to a pure vector search without indexing
Why it's wrong here
Without indexing, search is slower.
- ✗
Increase the number of chunks retrieved per query
Why it's wrong here
More chunks mean more processing, increasing latency.
- ✗
Use a larger embedding model to improve retrieval accuracy
Why it's wrong here
Larger models increase latency.
- ✓
Implement semantic chunking with overlapping to reduce document size per retrieval
Why this is correct
Smaller, well-structured chunks speed up retrieval and generation.
Go deeper
Related to this question
About these practice questions
One of 683 original Generative AI Leader practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This Generative AI Leader practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the Generative AI Leader exam.