AI-102 Implement generative AI solutions Practice Question
You need to deploy a generative AI model that can be used by multiple applications within your organization. The model must support real-time inference with low latency. Which Azure service should you use?
⚠ Common exam trap
Watch out — candidates often confuse Azure Machine Learning real-time endpoints (which are for custom ML models) with Azure OpenAI Service (which is purpose-built for generative AI), overlooking the fact that Azure OpenAI provides managed, low-latency inference optimized for large language models without the overhead of containerized deployments.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Azure OpenAI Service
Azure OpenAI Service provides managed access to powerful generative AI models like GPT-4, which are optimized for real-time inference with low latency through provisioned throughput units (PTUs) and regional deployment options. This service is specifically designed for generative AI workloads, offering REST API endpoints that support streaming responses and sub-second latency for single-turn interactions, making it ideal for multiple applications requiring consistent, low-latency responses.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Azure AI Search
Why it's wrong here
Azure AI Search is a search and indexing service, not for running generative AI inference.
- ✓
Azure OpenAI Service
Why this is correct
Azure OpenAI Service provides managed endpoints with low-latency inference for generative AI models.
- ✗
Azure Machine Learning real-time endpoint
Why it's wrong here
Azure ML endpoints can serve models but require additional configuration and management compared to Azure OpenAI.
- ✗
Azure Functions
Why it's wrong here
Azure Functions is a serverless compute platform, not suitable for hosting large generative AI models.
Go deeper
Related to this question
About these practice questions
Courseiva writes every AI-102 question from scratch — 945 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-102 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-102 exam.