AI-900 Practice Question: Describe fundamental principles of machine learning on Azure
A medical research team trains a model to detect a rare disease from lab results. The disease occurs in only 1% of patients. The model predicts 'no disease' for every patient and achieves 99% accuracy. Which metric best reveals that the model is failing to identify actual disease cases?
⚠ Common exam trap
The trap here is that candidates see 99% accuracy and assume the model is performing well, without recognizing that accuracy is meaningless when the class distribution is extremely skewed.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Recall
Recall (sensitivity) measures the proportion of actual positive cases correctly identified by the model. With a 99% accuracy but zero true positives (since the model always predicts 'no disease'), recall is 0%, which directly reveals the model's failure to detect any actual disease cases. In Azure Machine Learning, recall is a key metric for imbalanced classification tasks, especially when missing a positive case has severe consequences.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Accuracy
Why it's wrong here
Accuracy is the ratio of correct predictions to all predictions, i.e., (true positives + true negatives) divided by the total number of cases. In a rare disease scenario with, say, a 1% prevalence, a model that simply predicts 'no disease' for every patient achieves 99% accuracy while detecting zero actual cases. Because the majority class (healthy patients) dominates the metric, accuracy remains deceptively high and completely obscures the model's failure to identify any positive instances.
- ✗
Precision
Why it's wrong here
Precision measures the proportion of positive predictions that are actually correct, defined as true positives divided by (true positives + false positives). In this case, the model never outputs a positive prediction, so both true positives and false positives are zero, rendering precision undefined (or assigned 0 by convention). Precision evaluates the quality of the model's positive alerts, not its coverage of real cases, so it cannot expose the fact that all disease patients are being missed. The failure to detect positives is literally a recall problem, not a precision problem.
- ✓
Recall
Why this is correct
Recall, also called sensitivity, is computed as true positives divided by the total number of actual positive cases (true positives + false negatives). Here, the model predicts no positive cases, so the true positive count is zero, yielding a recall of 0%. This directly indicates that 100% of actual disease cases are missed, which is the exact failure mode in this screening scenario. For rare disease detection, high recall is essential to ensure that no affected patient is overlooked, even if it means accepting more false positives.
- ✗
F1 score
Why it's wrong here
The F1 score is the harmonic mean of precision and recall, calculated as 2 × (precision × recall) / (precision + recall). Because recall is 0 in this model, the F1 score collapses to 0 no matter what precision happens to be, so it does convey that performance is poor. However, it cannot distinguish whether the problem stems from precision or recall; the metric is a single aggregate that hides the specific failure mode. A 0 F1 is a symptom, not a diagnostic — it is recall alone that cleanly identifies the model's total inability to detect any disease cases.
Go deeper
Related to this question
Learn chapter
Machine Learning Core Concepts
Key term
Machine learning
Machine learning is a branch of artificial intelligence where computers learn patterns from data to make decisions or predictions without being explicitly programmed for every task.
Key term
Model
In IT and AI, a model is a trained mathematical representation that learns patterns from data to make predictions or decisions.
About these practice questions
One of 985 original AI-900 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-900 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-900 exam.