AI-900 Practice Question: Describe fundamental principles of machine learning on Azure
Which metric is MOST appropriate for evaluating a regression model's performance?
⚠ Common exam trap
Watch out — candidates often confuse regression and classification metrics, mistakenly applying Accuracy (a classification metric) to regression problems because they think it measures 'correctness' in a general sense, without understanding that regression requires error-based metrics like RMSE.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Root Mean Squared Error (RMSE)
Root Mean Squared Error (RMSE) is the most appropriate metric for evaluating a regression model because it measures the average magnitude of prediction errors in the same units as the target variable, penalizing larger errors more heavily due to squaring. In Azure Machine Learning, regression models like Linear Regression or Decision Forest Regression are evaluated using RMSE to quantify how well the predicted continuous values match actual values.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Accuracy
Why it's wrong here
Accuracy is a classification metric that computes the ratio of correct predictions to total predictions. For regression, however, there are no discrete categories, so 'correct' is not well-defined; continuous predictions rarely match actual values exactly. Using accuracy would essentially always yield zero or a misleadingly low score, providing no useful signal about prediction quality. Regression instead requires error-based metrics like RMSE or MAE that measure how far predictions deviate from actual values.
- ✓
Root Mean Squared Error (RMSE)
Why this is correct
Root Mean Squared Error (RMSE) is the standard evaluation metric for regression models. It is calculated by taking the square root of the average of the squared differences between predicted and actual values, which penalizes large errors more heavily than small ones. A lower RMSE indicates predictions are closer to the true continuous values, and it is expressed in the same units as the target variable, making it directly interpretable. Unlike classification metrics, RMSE naturally handles continuous numeric predictions and is sensitive to outliers, which can be desirable when large errors are especially problematic.
- ✗
Precision and recall
Why it's wrong here
Precision and recall are metrics from binary classification that quantify the model's ability to correctly identify positive instances relative to false positives and false negatives. They require a confusion matrix built from true positives, true negatives, false positives, and false negatives, all of which depend on categorical outcomes. In regression, the output is a continuous variable, so there is no concept of a 'positive' or 'negative' prediction, and no threshold to separate classes. Thus precision and recall cannot be computed or meaningfully interpreted for regression models.
- ✗
AUC-ROC curve
Why it's wrong here
The AUC-ROC curve is designed to evaluate binary classification models by plotting the true positive rate against the false positive rate across various classification thresholds. It relies on predicted probabilities and a binary ground truth, neither of which exists in a regression problem where the target is a continuous numeric value. Regression tasks do not have thresholds or positive/negative classes, so AUC-ROC is entirely inapplicable. Instead, regression evaluation should use error-based metrics such as RMSE, MAE, or R-squared.
Go deeper
Related to this question
Learn chapter
Machine Learning Core Concepts
Key term
Model
In IT and AI, a model is a trained mathematical representation that learns patterns from data to make predictions or decisions.
Key term
Regression
Regression is a type of machine learning algorithm that predicts a continuous numeric output based on input data, used to model relationships between variables.
About these practice questions
One of 985 original AI-900 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-900 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-900 exam.