AI-102 Practice Question: Implement natural language processing solutions
A company uses Azure AI Language Service for custom text classification. The model is trained to classify support tickets into categories. After deployment, the model performs well on the test set but poorly on new incoming tickets. Which action should be taken to improve generalization?
⚠ Common exam trap
Candidates often mistakenly tune hyperparameters (epochs, confidence threshold) or switch to a prebuilt model, but the real issue is distribution shift between test data and production data. Adding representative labeled data from production is the correct solution.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Add more labeled data from actual production tickets
Adding more labeled data from actual production tickets helps the model learn the true distribution of real-world inputs, reducing overfitting to the test set. The model's poor performance on new tickets indicates it memorized patterns specific to the training data rather than generalizing. Incorporating production data directly addresses the distribution shift between the test set and live traffic.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Switch to a prebuilt text classification model
Why it's wrong here
Prebuilt models may not match custom categories.
- ✗
Increase the number of training epochs
Why it's wrong here
More epochs can cause overfitting, not generalization.
- ✗
Reduce the confidence threshold for classification
Why it's wrong here
Threshold adjustment does not improve model accuracy.
- ✓
Add more labeled data from actual production tickets
Why this is correct
Diverse data helps the model learn patterns present in production.
Go deeper
Related to this question
About these practice questions
Courseiva writes every AI-102 question from scratch — 945 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-102 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-102 exam.