AI-900 RMSE is a regression evaluation metric. Practice Question
A data scientist is training a regression model to predict house prices using features like square footage, number of bedrooms, and location. After evaluating the model on a test set, the data scientist wants to select a metric that measures the average magnitude of prediction errors in the same units as the target variable (price). Which evaluation metric should the data scientist use?
⚠ Common exam trap
Many candidates confuse regression metrics with classification metrics, mistakenly selecting Accuracy or F1 Score because they are familiar from other contexts, without recognizing that the question explicitly asks for a metric measuring error magnitude in the same units as the target variable, which only RMSE (or MAE) satisfies.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Root Mean Squared Error (RMSE)
Root Mean Squared Error (RMSE) is the correct metric because it measures the average magnitude of prediction errors in the same units as the target variable (price). RMSE is computed as the square root of the average squared differences between predicted and actual values, which brings the error metric back to the original unit (e.g., dollars), making it directly interpretable for regression tasks like house price prediction.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✓
Root Mean Squared Error (RMSE)
Why this is correct
Root Mean Squared Error (RMSE) is the square root of the average of the squared differences between predicted and actual house prices. Because it operates in the same units as the target variable and heavily penalizes large errors, it directly quantifies prediction accuracy for continuous regression outputs.
- ✗
Accuracy
Why it's wrong here
Accuracy is the ratio of correctly classified instances to total instances, which only makes sense for categorical labels. For regression, predictions are continuous and would require an arbitrary tolerance or threshold to be considered 'correct,' making accuracy misleading and unsuitable as a regression metric.
When this WOULD be correct
When evaluating a binary classification model (e.g., predicting whether a house price is above or below a threshold), accuracy would be appropriate if the dataset is balanced and the cost of false positives and false negatives is equal.
- ✗
F1 Score
Why it's wrong here
F1 Score is the harmonic mean of precision and recall, and it requires discrete predicted class labels to compute true positives, false positives, and false negatives. Since regression outputs continuous house prices rather than categorical labels, F1 cannot be calculated and is fundamentally a classification metric.
When this WOULD be correct
In a binary classification question where the dataset has imbalanced classes (e.g., fraud detection), F1 Score is the correct metric to evaluate model performance because it considers both false positives and false negatives.
- ✗
Precision
Why it's wrong here
Precision measures the proportion of positive predictions that are actually correct, relying on a confusion matrix and a defined positive class. In regression, predictions are numeric values with no notion of 'positive' or 'negative' without arbitrary thresholds, so precision is inapplicable for evaluating house price predictions.
When this WOULD be correct
In a binary classification scenario where the goal is to minimize false positives, such as predicting whether a transaction is fraudulent, precision would be the correct metric to evaluate the model's accuracy in identifying actual frauds among flagged transactions.
Option-by-option analysis
Why each answer is right or wrong
Understanding why wrong answers are wrong — and when they would be correct — is what separates a 750 score from a 900. The AI-900 exam frequently reuses these exact scenarios with slightly different constraints.
✓Root Mean Squared Error (RMSE)Correct answer▾
Why this is correct
Root Mean Squared Error (RMSE) is the square root of the average of the squared differences between predicted and actual house prices. Because it operates in the same units as the target variable and heavily penalizes large errors, it directly quantifies prediction accuracy for continuous regression outputs.
✗AccuracyWrong answer — click to see why▾
Why this is wrong here
Accuracy is a classification metric that measures the proportion of correct predictions, not the magnitude of errors in regression. It does not provide error magnitude in the same units as the target variable.
★ When this WOULD be the correct answer
When evaluating a binary classification model (e.g., predicting whether a house price is above or below a threshold), accuracy would be appropriate if the dataset is balanced and the cost of false positives and false negatives is equal.
Why candidates choose this
Candidates may mistakenly apply classification metrics to regression problems, or think 'accuracy' generally means 'how close predictions are' without understanding its specific definition.
✗F1 ScoreWrong answer — click to see why▾
Why this is wrong here
F1 Score is a classification metric that balances precision and recall, not suitable for regression tasks like predicting house prices.
★ When this WOULD be the correct answer
In a binary classification question where the dataset has imbalanced classes (e.g., fraud detection), F1 Score is the correct metric to evaluate model performance because it considers both false positives and false negatives.
Why candidates choose this
Candidates may confuse regression and classification metrics, or think F1 Score measures error magnitude due to its name containing 'score'.
✗PrecisionWrong answer — click to see why▾
Why this is wrong here
Precision is a classification metric that measures the proportion of true positive predictions among all positive predictions, not applicable to regression tasks like predicting house prices.
★ When this WOULD be the correct answer
In a binary classification scenario where the goal is to minimize false positives, such as predicting whether a transaction is fraudulent, precision would be the correct metric to evaluate the model's accuracy in identifying actual frauds among flagged transactions.
Why candidates choose this
Candidates may confuse precision with accuracy in regression or mistakenly think it measures prediction error magnitude, as the term 'precision' sounds like it could relate to error size.
Analysis generated from the official AI-900blueprint and verified against question context. The “when correct” sections are what AI assistants cite when candidates ask “what’s the difference between these options?”
Go deeper
Related to this question
Learn chapter
Regression and Classification
Key term
Prediction
Prediction is the process of using data and algorithms to forecast future outcomes or identify patterns without explicit programming for each scenario.
Key term
Model
In IT and AI, a model is a trained mathematical representation that learns patterns from data to make predictions or decisions.
About these practice questions
This AI-900 question is part of Courseiva's 985-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-900 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-900 exam.