Question 473 of 1,020

Which Metric Evaluates Regression Models? RMSE Explained for AI-900

This AI-900 practice question tests your understanding of describe fundamental principles of machine learning on azure. Match the stated requirement to the specific cloud service, access model, or configuration option — many options are valid in isolation but not for this scenario. After answering, compare your reasoning against the explanation and wrong-answer breakdown below. Once you have made your selection, read the full explanation to reinforce the concept and understand why each distractor is designed to mislead on exam day.

Which metric is MOST appropriate for evaluating a regression model's performance?

Quick Answer

The answer is Root Mean Squared Error, or RMSE, which is the most appropriate regression evaluation metric for the AI-900 exam. RMSE measures the average magnitude of prediction errors by calculating the square root of the average of squared differences between predicted and actual values, crucially penalizing larger errors more heavily due to the squaring step. This makes it ideal for regression models like Linear Regression or Decision Forest Regression in Azure Machine Learning, where you need to quantify how well continuous predictions match real-world data. On the Microsoft Azure AI Fundamentals exam, this concept tests your ability to distinguish regression metrics from classification metrics like accuracy or precision—a common trap is confusing RMSE with Mean Absolute Error (MAE), but remember that RMSE amplifies large outliers. For a quick memory tip, think “RMSE: Root Mean Squared Error—squaring makes big mistakes hurt more.”

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

Root Mean Squared Error (RMSE)

Root Mean Squared Error (RMSE) is the most appropriate metric for evaluating a regression model because it measures the average magnitude of prediction errors in the same units as the target variable, penalizing larger errors more heavily due to squaring. In Azure Machine Learning, regression models like Linear Regression or Decision Forest Regression are evaluated using RMSE to quantify how well the predicted continuous values match actual values.

Key principle: Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

  • Accuracy

    Why it's wrong here

    Accuracy measures proportion of correct classifications — it's for classification models, not regression.

  • Root Mean Squared Error (RMSE)

    Why this is correct

    RMSE measures the average magnitude of prediction errors for regression — lower RMSE means predictions are closer to actual values.

    Related concept

    Read the scenario before looking for a memorised answer.

  • Precision and recall

    Why it's wrong here

    Precision and recall evaluate binary classification performance — not appropriate for continuous value regression.

  • AUC-ROC curve

    Why it's wrong here

    AUC-ROC evaluates binary classifier performance — RMSE/MAE are the appropriate metrics for regression models.

Common exam traps

Common exam trap: answer the scenario, not the keyword

The trap here is that candidates often confuse regression and classification metrics, mistakenly applying Accuracy (a classification metric) to regression problems because they think it measures 'correctness' in a general sense, without understanding that regression requires error-based metrics like RMSE.

Detailed technical explanation

How to think about this question

RMSE is calculated as the square root of the average of squared differences between predicted and actual values, which amplifies the impact of large errors, making it sensitive to outliers. In Azure Machine Learning, when training a regression model, the AutoML process automatically computes RMSE along with other metrics like R-squared and Mean Absolute Error (MAE) to provide a comprehensive view of model performance. A real-world scenario where RMSE matters is predicting house prices, where a large error on an expensive property could be more costly than multiple small errors on cheaper properties.

KKey Concepts to Remember

  • Read the scenario before looking for a memorised answer.
  • Find the constraint that changes the correct option.
  • Eliminate answers that are true in general but not in this case.

TExam Day Tips

  • Watch for words such as best, first, most likely and least administrative effort.
  • Review why wrong options are wrong, not only why the correct option is correct.

Key takeaway

Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.

Real-world example

How this comes up in practice

A cloud solutions architect for a retail company is evaluating services for a new workload. The correct answer here reflects best practice for the specific scenario described — not a general cloud recommendation. Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option. Cloud exam questions reward reading the constraint carefully: the same technology can be right or wrong depending on the use case.

What to study next

Got this wrong? Here's your next step.

Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.

Related practice questions

Related AI-900 practice-question pages

Use these pages to review the topic behind this question. This is how one missed question becomes focused revision.

Practice this exam

Start a free AI-900 practice session

Short sessions build daily habit. Longer sessions build exam-day stamina. Try a timed session to simulate real conditions.

FAQ

Questions learners often ask

What does this AI-900 question test?

Describe fundamental principles of machine learning on Azure — This question tests Describe fundamental principles of machine learning on Azure — Read the scenario before looking for a memorised answer..

What is the correct answer to this question?

The correct answer is: Root Mean Squared Error (RMSE) — Root Mean Squared Error (RMSE) is the most appropriate metric for evaluating a regression model because it measures the average magnitude of prediction errors in the same units as the target variable, penalizing larger errors more heavily due to squaring. In Azure Machine Learning, regression models like Linear Regression or Decision Forest Regression are evaluated using RMSE to quantify how well the predicted continuous values match actual values.

What should I do if I get this AI-900 question wrong?

Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.

What is the key concept behind this question?

Read the scenario before looking for a memorised answer.

About these practice questions

Courseiva creates original exam-style practice questions with explanations and wrong-answer analysis. It does not publish real exam questions, exam dumps, or protected exam content. Learn why practice questions differ from exam dumps →

How Courseiva writes practice questions · Editorial policy

Keep practising

More AI-900 practice questions

Last reviewed: Jun 11, 2026

Question Discussion

Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.

Loading comments…

Sign in to join the discussion.

This AI-900 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-900 exam.