AI-102 Plan and manage an Azure AI solution Practice Question
Your company uses Azure OpenAI Service to generate product descriptions. You need to reduce costs while maintaining response quality for common requests. What should you implement?
⚠ Common exam trap
Many exam-takers confuse semantic caching with simple request caching or assume batching is supported, overlooking that semantic caching specifically reuses responses for similar prompts without degrading quality, while other options either reduce quality or are technically infeasible.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Enable semantic caching to reuse responses for similar prompts.
Semantic caching stores responses for semantically similar prompts, allowing Azure OpenAI Service to return cached results for common requests without incurring per-token inference costs. This directly reduces costs while preserving response quality, as the cached responses are identical to what the model would generate. Unlike other options, it avoids degrading output quality or requiring architectural changes.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Use a smaller model variant (e.g., GPT-3.5 instead of GPT-4).
Why it's wrong here
Smaller models may not maintain quality for all product descriptions.
- ✗
Batch multiple requests into a single API call.
Why it's wrong here
Batching increases throughput but does not reduce cost per token.
- ✓
Enable semantic caching to reuse responses for similar prompts.
Why this is correct
Caching reduces costs without sacrificing quality for common requests.
- ✗
Reduce the max_tokens parameter for all requests.
Why it's wrong here
This may truncate important content.
Go deeper
Related to this question
About these practice questions
Courseiva writes every AI-102 question from scratch — 945 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-102 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-102 exam.