AI-102 Implement agentic AI solutions Practice Question
A company is building an agent that uses Azure OpenAI to answer questions from a large document library. The agent must use a Retrieval Augmented Generation (RAG) pattern. Which TWO actions should the team take to implement RAG effectively?
⚠ Common exam trap
Candidates often confuse fine-tuning (which adapts model behavior) with RAG (which augments prompts with retrieved data), leading them to select Option B instead of understanding that RAG requires an external retrieval step and vector index.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Index the documents into a vector database like Azure Cognitive Search.
Indexing documents into a vector database like Azure Cognitive Search enables efficient similarity search over embeddings, which is the retrieval foundation of RAG. This allows the system to quickly find the most relevant document chunks based on semantic meaning, rather than relying on the model to memorize or be fine-tuned on the entire library.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Ensure the model is large enough to memorize the entire document library.
Why it's wrong here
Memorization is not feasible for large libraries.
- ✗
Fine-tune the Azure OpenAI model on the document library.
Why it's wrong here
Fine-tuning is not required for RAG.
- ✓
Index the documents into a vector database like Azure Cognitive Search.
Why this is correct
Indexing enables efficient retrieval of relevant content.
- ✗
Train a custom language model from scratch.
Why it's wrong here
RAG uses a pretrained model.
- ✓
Use a retrieval step to fetch relevant document chunks before generating a response.
Why this is correct
Retrieval is the core of RAG.
Go deeper
Related to this question
About these practice questions
One of 945 original AI-102 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-102 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-102 exam.