AI-102 Plan and manage an Azure AI solution Practice Question
You are a lead AI engineer for a global retail company. The company is building an AI-powered customer support chatbot using Microsoft Foundry. The chatbot must answer product questions, process returns, and escalate to human agents when needed. The solution uses Azure AI Language for intent recognition and Azure AI Bot Service for bot orchestration. During testing, the chatbot fails to understand customer queries about return policies. The intents 'ProductInquiry' and 'ReturnRequest' are defined, but the model often confuses them. You need to improve intent classification accuracy. The development team has already collected 500 sample utterances for each intent. You have a budget to collect additional data. What should you do?
⚠ Common exam trap
Test-takers frequently assume increasing the confidence threshold (Option C) will fix misclassifications, but this only adjusts the prediction cutoff and does not improve the underlying model's ability to differentiate intents, which is a data quality issue, not a threshold tuning issue.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Collect additional utterances that are similar to the confusing ones and retrain
Collecting additional utterances that are similar to the confusing ones directly addresses the ambiguity between the 'ProductInquiry' and 'ReturnRequest' intents. By providing more representative examples of edge cases where the intents overlap, the Azure AI Language model can better learn the subtle linguistic patterns that distinguish them, thereby improving classification accuracy without requiring a complete retraining from scratch.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Use Azure AI Translator to translate utterances into multiple languages
Why it's wrong here
Translation multiplies utterances across languages but preserves the same semantic overlap between ProductInquiry and ReturnRequest, so the confusion boundary is unchanged. It is tempting because it expands training data cheaply, and translation would be correct if the problem were low coverage of non-English customer queries rather than ambiguous intent separation.
- ✓
Collect additional utterances that are similar to the confusing ones and retrain
Why this is correct
Confusion between ProductInquiry and ReturnRequest stems from insufficient utterance coverage near the decision boundary. Adding utterances similar to the misclassified examples gives the model discriminative training signal on that boundary, improving classification accuracy more effectively than unrelated data.
- ✗
Increase the confidence threshold in the bot configuration
Why it's wrong here
Raising the confidence threshold only changes when the bot defers or escalates; it cannot separate ProductInquiry from ReturnRequest, since both intents still score similarly on the same utterances. Threshold tuning suits filtering low-confidence matches once the model already classifies intents accurately.
- ✗
Create a new custom language project and retrain from scratch
Why it's wrong here
Rebuilding a custom language project discards the 500 labelled utterances per intent that already exist, so the confusion between ProductInquiry and ReturnRequest remains unaddressed. Creating a fresh project suits a new domain or language where no labelled data exists, not refining an existing model that simply needs more boundary examples.
Go deeper
Related to this question
About these practice questions
Courseiva writes every AI-102 question from scratch — 761 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-102 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-102 exam.