AI-102 Practice Question: Implement natural language processing solutions
A company uses Azure AI Language's custom text classification to categorize support tickets. The model was trained with 5000 labeled examples and achieves 90% accuracy. However, for a specific category (e.g., 'billing'), the model frequently misclassifies tickets that contain both billing and technical issues. Which action should you take to improve classification for this category?
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Add more labeled examples for the 'billing' category, especially those that are mixed with other categories.
Adding more labeled examples for the 'billing' category, especially those that are mixed with other categories, will help the model learn to distinguish them better. Option A is wrong because reducing the number of categories may not address the specific confusion. Option C is wrong because increasing the training epochs may lead to overfitting. Option D is wrong because using a different algorithm is not an option in Azure AI Language's custom text classification.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Reduce the number of categories to simplify the classification.
Why it's wrong here
This may not address the specific misclassification.
- ✓
Add more labeled examples for the 'billing' category, especially those that are mixed with other categories.
Why this is correct
More training data for the problematic category improves model performance.
- ✗
Increase the number of training epochs to further train the model.
Why it's wrong here
May lead to overfitting without new data.
- ✗
Use a different classification algorithm, such as a neural network.
Why it's wrong here
Azure AI Language does not allow choosing algorithms; it uses a pre-configured model.
Go deeper
Related to this question
About these practice questions
One of 945 original AI-102 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
Same concept, more angles
2 more ways this is tested on AI-102
These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.
Variation 1. A company uses Azure AI Language Service for custom text classification. The model is trained to classify support tickets into categories. After deployment, the model performs well on the test set but poorly on new incoming tickets. Which action should be taken to improve generalization?
hard- A.Switch to a prebuilt text classification model
- B.Increase the number of training epochs
- C.Reduce the confidence threshold for classification
- ✓ D.Add more labeled data from actual production tickets
Why D: Adding more labeled data from actual production tickets helps the model learn the true distribution of real-world inputs, reducing overfitting to the test set. The model's poor performance on new tickets indicates it memorized patterns specific to the training data rather than generalizing. Incorporating production data directly addresses the distribution shift between the test set and live traffic.
Variation 2. Your NLP solution uses custom text classification in Azure AI Language. You need to improve the model's accuracy. Which action should you take?
medium- ✓ A.Add more labeled training data with balanced classes.
- B.Increase the number of training epochs.
- C.Decrease the batch size.
- D.Use a different pretrained model.
Why A: Custom text classification in Azure AI Language relies on supervised learning, where model accuracy is directly proportional to the quantity and quality of labeled training data. Adding more labeled examples with balanced class distributions reduces bias, improves generalization, and helps the model learn distinguishing features more effectively, which is the most impactful action for improving accuracy.
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-102 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-102 exam.