AI-900 Practice Question: Describe features of generative AI workloads on Azure
What is Azure AI Search (formerly Cognitive Search) and how does it relate to generative AI?
⚠ Common exam trap
A common mix-up: candidates confuse Azure AI Search with a simple database or a built-in LLM knowledge base, failing to recognize its role as the retrieval layer in the RAG architecture that grounds generative AI responses in external data.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
An enterprise search service used in RAG to retrieve relevant documents for LLM context
Azure AI Search is an enterprise search service that indexes and retrieves relevant documents from your own data sources. In the context of generative AI, it is a core component of the Retrieval Augmented Generation (RAG) pattern, where it provides the LLM with up-to-date, domain-specific context to ground its responses, preventing hallucinations and ensuring factual accuracy.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
A service that generates answers using only the language model's built-in training knowledge
Why it's wrong here
Azure AI Search is not a generative service; it performs retrieval over a configurable index of your own documents. Although an LLM alone can produce answers from its static training cutoffs, that approach ignores the specific, up-to-date knowledge base that Azure AI Search is designed to index. The correct pattern is RAG, where the search service supplies relevant passages as context for the LLM to synthesize—never relying purely on the model's baked-in knowledge.
- ✓
An enterprise search service used in RAG to retrieve relevant documents for LLM context
Why this is correct
Azure AI Search is the enterprise search and retrieval component in a RAG architecture: it ingests your content, builds searchable indexes (with keyword, vector, and hybrid search capabilities), and, given a user query, returns the top relevant passages. Those retrieved documents are injected into the LLM prompt as grounding context, enabling responses that are accurate, current, and traceable to your own data sources. This retrieval-first role is distinct from generation, which the LLM performs after receiving the search results.
- ✗
A tool for searching through Azure OpenAI model configurations
Why it's wrong here
Azure AI Search indexes and queries business content such as PDFs, websites, and databases—not the configuration metadata of Azure OpenAI deployments. Model parameters, endpoints, keys, and quota settings are managed through Azure OpenAI Studio, ARM templates, or the Azure CLI, not through a search index. RAG would never need AI Search to inspect model configurations; it needs AI Search to locate relevant source documents for grounding the LLM's response.
- ✗
A database service for storing generated AI content
Why it's wrong here
Azure AI Search is an indexing and retrieval service, not a general-purpose store for generated AI outputs. It maintains inverted indexes and vector embeddings to make content searchable, but it does not serve as primary storage for blobs, rows, or JSON documents—those live in services like Azure Blob Storage, Cosmos DB, or Azure SQL Database. Generated content may be indexed for later retrieval, but the service's purpose is querying and ranking relevant information, not acting as a durable database for AI outputs.
Go deeper
Related to this question
Learn chapter
Machine Learning Core Concepts
Key term
Azure OpenAI Service
Azure OpenAI Service is a cloud platform from Microsoft that lets developers use powerful artificial intelligence models, like GPT-4, to build applications that can understand and generate human-like text, code, images, and more.
Key term
RAG
Retrieval-Augmented Generation (RAG) is a technique that combines information retrieval with text generation to produce more accurate and contextually relevant answers from large language models.
About these practice questions
One of 985 original AI-900 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-900 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-900 exam.