AI-900 Practice Question: Describe features of generative AI workloads on Azure
What is Azure OpenAI Service?
⚠ Common exam trap
Test-takers frequently confuse Azure OpenAI Service with a general-purpose AI training platform (like Azure Machine Learning) or a rule-based chatbot service, overlooking its specific role as a managed API for pre-trained generative models with enterprise controls.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Azure's deployment of OpenAI models with enterprise security and compliance
Azure OpenAI Service is correct because it provides access to OpenAI's powerful generative AI models (like GPT-4, GPT-3.5, and DALL-E) through Azure's cloud platform, with built-in enterprise-grade security, compliance, and responsible AI guardrails. Unlike a generic API, it integrates with Azure Active Directory, virtual networks, and private endpoints, ensuring data residency and privacy for enterprise workloads.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
A service for building traditional rule-based chatbots
Why it's wrong here
Azure OpenAI generates responses using large language models that understand context, intent, and natural language, not through scripted if-then rules or predefined decision trees. Rule-based chatbots typically rely on Azure Bot Service and QnA Maker/AI Language to match keywords and intents against a fixed knowledge base. Unlike those deterministic frameworks, Azure OpenAI can handle novel, open-ended dialogue and generative tasks that rule-based systems cannot. Therefore, this option misrepresents it as a traditional chatbot framework.
- ✓
Azure's deployment of OpenAI models with enterprise security and compliance
Why this is correct
Azure OpenAI Service delivers OpenAI's language and image generation models (GPT-4, DALL-E) on Microsoft's Azure infrastructure, adding enterprise-grade security, compliance standards, and responsible AI controls for production use. It provides a managed inference API, so you send prompts and receive generated completions without managing underlying GPUs or model scaling. Integration with Azure Active Directory, private endpoints, and data residency guarantees differentiates it from accessing OpenAI directly. This is the correct description of the service's purpose.
- ✗
A machine learning training platform for custom models
Why it's wrong here
Azure OpenAI is not designed for custom model training; it exposes OpenAI's existing foundational models such as GPT-4 and DALL-E via a managed API. While limited fine-tuning of these base models is possible, full custom training and lifecycle management are handled by Azure Machine Learning, which provides data preparation, training, and deployment tools. Azure OpenAI only serves pre-built model weights and cannot train models from scratch. Thus, this option confuses inference with training.
- ✗
A database service for storing AI training data
Why it's wrong here
Azure OpenAI Service is fundamentally an inference endpoint for pre-trained OpenAI models, not a data persistence layer. It does not store, index, or manage AI training data; customers may send prompts or upload small files for fine-tuning, but that does not make it a database. For durable data storage, Azure offers dedicated services like Blob Storage and Cosmos DB. This option mischaracterizes the service's role as a model-serving API.
Go deeper
Related to this question
Learn chapter
Types of AI Workloads
Key term
Azure OpenAI Service
Azure OpenAI Service is a cloud platform from Microsoft that lets developers use powerful artificial intelligence models, like GPT-4, to build applications that can understand and generate human-like text, code, images, and more.
Key term
Responsible AI
A framework of ethical principles and practices that ensure artificial intelligence systems are developed and deployed in a transparent, fair, accountable, and safe manner.
About these practice questions
This AI-900 question is part of Courseiva's 985-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-900 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-900 exam.