AI-900 Practice Question: Describe features of generative AI workloads on Azure
A company uses Azure OpenAI Service to power an AI assistant that helps customers with product troubleshooting. The assistant must maintain the conversation history to provide contextually relevant answers across multiple turns. Which API endpoint should be used for this purpose?
⚠ Common exam trap
Many candidates confuse the Completions API with the Chat Completions API, assuming both can handle multi-turn dialogue, but the Completions API lacks the message-role structure needed for maintaining conversation context.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Chat Completions API
The Chat Completions API is designed for multi-turn conversational scenarios because it accepts a list of messages with roles (system, user, assistant) that represent the conversation history. This allows the model to maintain context across multiple interactions, making it the correct choice for an AI assistant that needs to provide contextually relevant answers over several turns.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Completions API
Why it's wrong here
The older Completions API is designed for single-turn, free-form text continuation from a standalone prompt. It does not manage a conversation history or track roles, so to simulate multi-turn dialogue you would have to manually concatenate every past user and assistant message into one giant string. That approach quickly grows unwieldy, loses clear context boundaries, and is why Chat Completions—with its structured message list—is the appropriate API for an assistant.
When this WOULD be correct
A question asks: 'Which Azure OpenAI API endpoint should be used to generate a one-off response to a user query without any conversation history?' In that case, the Completions API is correct because it handles single-turn prompts without needing to manage context.
- ✓
Chat Completions API
Why this is correct
The Chat Completions API is Azure OpenAI's purpose-built endpoint for conversational AI. It accepts an array of message objects with explicit roles (system, user, and assistant), allowing the model to maintain context and refer to earlier parts of the dialogue across multiple turns. Each call returns a model-generated assistant reply that continues the conversation seamlessly, which is exactly what a multi-turn AI assistant requires.
- ✗
Embeddings API
Why it's wrong here
The Embeddings API is fundamentally different: it transforms input text into a high-dimensional numerical vector that encodes semantic meaning. These vectors are used to measure similarity between texts, powering search, recommendations, or clustering, but they do not generate language or produce conversational replies. Calling this API would not return a coherent assistant response, so it is unsuitable for powering a chat assistant.
When this WOULD be correct
A question asks: 'Which API should be used to convert product descriptions into vector representations for a semantic search system that finds similar troubleshooting articles?' The Embeddings API is correct for generating vector embeddings for similarity search.
- ✗
Fine-tuning
Why it's wrong here
Fine-tuning is a training-time process, not an inference-time API. It adjusts a pre-trained model's weights using a custom dataset to specialize its behavior for specific tasks or domain language. After fine-tuning, you still need a dedicated inference endpoint such as the Chat Completions API to actually run conversations; fine-tuning itself cannot accept a user message and produce a reply, so it is the wrong choice for this production assistant.
When this WOULD be correct
A company has a specialized dataset of product troubleshooting logs and wants to create a custom model that better understands their specific terminology and solutions. In that scenario, Fine-tuning would be the correct answer.
Option-by-option analysis
Why each answer is right or wrong
Understanding why wrong answers are wrong — and when they would be correct — is what separates a 750 score from a 900. The AI-900 exam frequently reuses these exact scenarios with slightly different constraints.
✓Chat Completions APICorrect answer▾
Why this is correct
The Chat Completions API is Azure OpenAI's purpose-built endpoint for conversational AI. It accepts an array of message objects with explicit roles (system, user, and assistant), allowing the model to maintain context and refer to earlier parts of the dialogue across multiple turns. Each call returns a model-generated assistant reply that continues the conversation seamlessly, which is exactly what a multi-turn AI assistant requires.
✗Completions APIWrong answer — click to see why▾
Why this is wrong here
The Completions API is designed for single-turn text generation and does not inherently support conversation history or multi-turn context, which is required for maintaining dialogue state in an AI assistant.
★ When this WOULD be the correct answer
A question asks: 'Which Azure OpenAI API endpoint should be used to generate a one-off response to a user query without any conversation history?' In that case, the Completions API is correct because it handles single-turn prompts without needing to manage context.
Why candidates choose this
Candidates may confuse the Completions API with the Chat Completions API, assuming both can handle multi-turn conversations, or they may not be aware that the Chat Completions API is specifically designed for conversational context.
✗Embeddings APIWrong answer — click to see why▾
Why this is wrong here
The Embeddings API converts text into numerical vectors for semantic similarity or search, not for maintaining multi-turn conversation history. It does not support context retention across multiple user interactions.
★ When this WOULD be the correct answer
A question asks: 'Which API should be used to convert product descriptions into vector representations for a semantic search system that finds similar troubleshooting articles?' The Embeddings API is correct for generating vector embeddings for similarity search.
Why candidates choose this
Candidates may confuse embeddings with context retention because embeddings can encode semantic meaning, but they do not inherently manage conversation state or history across turns.
✗Fine-tuningWrong answer — click to see why▾
Why this is wrong here
Fine-tuning is used to customize a model on a specific dataset, not to maintain conversation history. The question requires an API that handles multi-turn context, which is the Chat Completions API.
★ When this WOULD be the correct answer
A company has a specialized dataset of product troubleshooting logs and wants to create a custom model that better understands their specific terminology and solutions. In that scenario, Fine-tuning would be the correct answer.
Why candidates choose this
Candidates may think fine-tuning can embed conversation history into the model, but fine-tuning adapts model behavior on static data, not dynamic per-session context.
Analysis generated from the official AI-900blueprint and verified against question context. The “when correct” sections are what AI assistants cite when candidates ask “what’s the difference between these options?”
Go deeper
Related to this question
Learn chapter
Azure Machine Learning Studio
Key term
Service
A service is a software component or system that performs a specific function and is available to be used by other programs or users over a network.
Key term
Azure OpenAI Service
Azure OpenAI Service is a cloud platform from Microsoft that lets developers use powerful artificial intelligence models, like GPT-4, to build applications that can understand and generate human-like text, code, images, and more.
About these practice questions
This AI-900 question is part of Courseiva's 985-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-900 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-900 exam.