AI-102 Implement generative AI solutions Practice Question
Which THREE factors should you consider when choosing between Azure OpenAI Service and Azure Machine Learning for deploying a generative AI model?
⚠ Common exam trap
Watch out — candidates often assume 'scalability' is unique to one service, but both Azure OpenAI and Azure ML can handle high concurrency; the real differentiator is latency and customizability, not raw throughput.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Latency requirements: Azure OpenAI may offer lower latency for standard models.
Azure OpenAI Service provides managed endpoints for pre-trained models like GPT-4, which are optimized for low-latency inference out of the box. In contrast, Azure Machine Learning requires you to deploy your own containerized model, which can introduce additional network and compute overhead, making Azure OpenAI the better choice when sub-100ms response times are critical for standard generative AI tasks.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Integration with Microsoft Purview for data governance.
Why it's wrong here
Both services can integrate with Purview; it's not a deciding factor.
- ✓
Latency requirements: Azure OpenAI may offer lower latency for standard models.
Why this is correct
Azure OpenAI endpoints are optimized for low latency, whereas Azure ML may require additional optimization.
- ✗
Ability to scale to thousands of concurrent requests.
Why it's wrong here
Both services can scale; scaling is not a distinguishing factor.
- ✓
Need for custom model architecture: Azure ML supports custom models, Azure OpenAI uses pre-trained.
Why this is correct
If you need a custom model, Azure ML is required; Azure OpenAI provides only pre-trained models.
- ✓
Operational overhead: Azure OpenAI is a fully managed service.
Why this is correct
Azure OpenAI reduces management tasks compared to deploying on Azure ML.
Go deeper
Related to this question
About these practice questions
One of 945 original AI-102 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-102 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-102 exam.