Courseiva

AI-900 Practice Question: Describe fundamental principles of machine learning on Azure

Which metric is MOST appropriate for evaluating a regression model's performance?

⚠ Common exam trap

Watch out — candidates often confuse regression and classification metrics, mistakenly applying Accuracy (a classification metric) to regression problems because they think it measures 'correctness' in a general sense, without understanding that regression requires error-based metrics like RMSE.

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

Root Mean Squared Error (RMSE)

Root Mean Squared Error (RMSE) is the most appropriate metric for evaluating a regression model because it measures the average magnitude of prediction errors in the same units as the target variable, penalizing larger errors more heavily due to squaring. In Azure Machine Learning, regression models like Linear Regression or Decision Forest Regression are evaluated using RMSE to quantify how well the predicted continuous values match actual values.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

  • Accuracy

    Why it's wrong here

    Accuracy is a classification metric that computes the ratio of correct predictions to total predictions. For regression, however, there are no discrete categories, so 'correct' is not well-defined; continuous predictions rarely match actual values exactly. Using accuracy would essentially always yield zero or a misleadingly low score, providing no useful signal about prediction quality. Regression instead requires error-based metrics like RMSE or MAE that measure how far predictions deviate from actual values.

  • Root Mean Squared Error (RMSE)

    Why this is correct

    Root Mean Squared Error (RMSE) is the standard evaluation metric for regression models. It is calculated by taking the square root of the average of the squared differences between predicted and actual values, which penalizes large errors more heavily than small ones. A lower RMSE indicates predictions are closer to the true continuous values, and it is expressed in the same units as the target variable, making it directly interpretable. Unlike classification metrics, RMSE naturally handles continuous numeric predictions and is sensitive to outliers, which can be desirable when large errors are especially problematic.

  • Precision and recall

    Why it's wrong here

    Precision and recall are metrics from binary classification that quantify the model's ability to correctly identify positive instances relative to false positives and false negatives. They require a confusion matrix built from true positives, true negatives, false positives, and false negatives, all of which depend on categorical outcomes. In regression, the output is a continuous variable, so there is no concept of a 'positive' or 'negative' prediction, and no threshold to separate classes. Thus precision and recall cannot be computed or meaningfully interpreted for regression models.

  • AUC-ROC curve

    Why it's wrong here

    The AUC-ROC curve is designed to evaluate binary classification models by plotting the true positive rate against the false positive rate across various classification thresholds. It relies on predicted probabilities and a binary ground truth, neither of which exists in a regression problem where the target is a continuous numeric value. Regression tasks do not have thresholds or positive/negative classes, so AUC-ROC is entirely inapplicable. Instead, regression evaluation should use error-based metrics such as RMSE, MAE, or R-squared.

About these practice questions

One of 985 original AI-900 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →

How Courseiva writes practice questions · Editorial policy

JA

Written by Johnson Ajibi, MSc IT Security

Senior Network & Security Engineer · founder of Courseiva

This AI-900 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-900 exam.