AI-900 Practice Question: Describe fundamental principles of machine learning on Azure
What is 'confusion matrix' and what does it tell you about a classification model?
⚠ Common exam trap
Many candidates confuse the term 'confusion matrix' with user confusion or model confidence, when in fact it is a structured table of prediction counts that reveals the specific types of correct and incorrect classifications.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
A table showing counts of correct and incorrect predictions broken down by predicted vs. actual class
A confusion matrix is a specific table layout that allows visualization of the performance of a classification model. It shows the counts of true positive, true negative, false positive, and false negative predictions, broken down by each actual class versus each predicted class. This directly tells you not just overall accuracy, but also the types of errors the model is making, which is critical for evaluating classifiers in Azure Machine Learning.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
A measure of how confused users are when interacting with an AI system's predictions
Why it's wrong here
The name 'confusion matrix' refers to the model being 'confused' about which classes to assign, not to end-user psychological confusion. User confusion is a UX research construct, often measured via task completion time, error rates, or satisfaction surveys. A confusion matrix has no user component; it is a purely quantitative evaluation artifact used by data scientists to diagnose classification algorithm errors.
- ✓
A table showing counts of correct and incorrect predictions broken down by predicted vs. actual class
Why this is correct
A confusion matrix is a cross-tabulation of predicted class labels against actual class labels, with each cell counting how many instances fall into that combination. In binary classification, this yields true positives, true negatives, false positives, and false negatives, from which you can derive precision, recall, F1-score, and accuracy. It is the correct technical answer because it directly reveals not just overall correctness but the specific types of errors the model makes.
- ✗
A graphical display of how confident the model is across its entire test dataset
Why it's wrong here
A confusion matrix is not a graphical display of model confidence. Confidence is typically visualized with reliability diagrams (calibration curves) or histograms of predicted probabilities, which show how the model's output probabilities align with actual outcomes. A confusion matrix instead shows discrete counts of predicted versus actual class labels, regardless of probability scores.
- ✗
A diagram comparing the accuracy of multiple models on the same test set
Why it's wrong here
This describes a model comparison technique, such as a bar chart of accuracy scores or ROC curves overlaid on the same plot. A confusion matrix evaluates a single model's predictions, quantifying exactly where that model makes errors (e.g., false positives vs. false negatives). It does not directly compare competitors; any model comparison would require separate confusion matrices or aggregated metrics.
Go deeper
Related to this question
Learn chapter
Types of AI Workloads
Key term
Classification
Classification is a supervised machine learning technique used to predict a category or class label for new data based on patterns learned from labeled training data.
Key term
Machine learning
Machine learning is a branch of artificial intelligence where computers learn patterns from data to make decisions or predictions without being explicitly programmed for every task.
About these practice questions
This AI-900 question is part of Courseiva's 985-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-900 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-900 exam.