Describe fundamental principles of machine learning on Azure →easyMultiple ChoiceObjective-mapped

AI-900 Practice Question: Describe fundamental principles of machine learning on Azure

A data scientist uses Azure Machine Learning to train a model that predicts the electricity consumption (in kilowatt-hours) of a building based on features like building age, square footage, and number of occupants. The data scientist wants to evaluate how accurately the model's predictions match the actual consumption values. Which evaluation metric is most appropriate for this regression task?

⚠ Common exam trap

Candidates often confuse classification metrics (Precision, F1, AUC) with regression metrics, mistakenly applying them to a continuous prediction task because they recall these metrics from other Azure ML scenarios like fraud detection or image classification.

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

✓

Mean Absolute Error (MAE)

Mean Absolute Error (MAE) is the most appropriate metric for this regression task because it directly measures the average absolute difference between predicted and actual electricity consumption values. Unlike classification metrics, MAE provides an interpretable error in the same unit (kilowatt-hours) as the target variable, making it ideal for evaluating continuous numerical predictions.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

✗
Precision
Why it's wrong here
Precision measures the fraction of predicted positive instances that are actually positive, calculated from true positives and false positives in a classification confusion matrix. Since regression problems predict numeric values rather than categorical labels, precision is inapplicable — there are no 'positive' predictions to evaluate, and using precision would ignore the magnitude of prediction errors, failing to assess how close predicted values are to actual targets.
When this WOULD be correct
Precision would be correct in a classification scenario where the model predicts whether a building will have high electricity consumption (e.g., above a threshold) and the focus is on minimizing false positives, such as in a fraud detection system for abnormal consumption patterns.
✓
Mean Absolute Error (MAE)
Why this is correct
Mean Absolute Error (MAE) is the appropriate regression metric here because it directly quantifies the average magnitude of prediction errors in the same units as the target variable. By taking the mean of the absolute differences between predicted and actual values, MAE provides an intuitive measure of model accuracy that is robust to outliers, making it a standard choice for evaluating continuous predictions in Azure Machine Learning's regression tasks.
✗
F1 score
Why it's wrong here
F1 score is fundamentally a classification metric that harmonizes precision and recall into a single score, and it relies on true positives, false positives, and false negatives derived from a confusion matrix. In a regression setting, there are no discrete classes or positive/negative predictions, so F1 cannot be computed without artificially thresholding continuous outputs, which would discard valuable prediction magnitude information and misrepresent the model's error.
When this WOULD be correct
F1 score would be correct for a binary classification question, e.g., 'A data scientist builds a model to classify whether a building will have high electricity consumption (above a threshold) or not. Which metric balances precision and recall?'
✗
Area Under the ROC Curve (AUC)
Why it's wrong here
Area Under the ROC Curve (AUC) evaluates a binary classifier's discriminative ability by plotting the true positive rate against the false positive rate across all possible classification thresholds. This metric is designed for ranking or classification problems where outputs are probabilities or scores; applying it to regression would be meaningless because regression targets are continuous real values, not categorical outcomes, and there is no concept of true/false positive rates.
When this WOULD be correct
AUC would be correct in a binary classification scenario, such as evaluating a model that predicts whether a building's electricity consumption exceeds a threshold (e.g., high vs. low consumption) based on features like building age and square footage.

Option-by-option analysis

Why each answer is right or wrong

Understanding why wrong answers are wrong — and when they would be correct — is what separates a 750 score from a 900. The AI-900 exam frequently reuses these exact scenarios with slightly different constraints.

✓Mean Absolute Error (MAE)Correct answer▾

Why this is correct

Mean Absolute Error (MAE) is the appropriate regression metric here because it directly quantifies the average magnitude of prediction errors in the same units as the target variable. By taking the mean of the absolute differences between predicted and actual values, MAE provides an intuitive measure of model accuracy that is robust to outliers, making it a standard choice for evaluating continuous predictions in Azure Machine Learning's regression tasks.

✗PrecisionWrong answer — click to see why▾

Why this is wrong here

Precision is a classification metric that measures the proportion of true positive predictions among all positive predictions, not suitable for evaluating regression tasks like predicting continuous electricity consumption values.

★ When this WOULD be the correct answer

Precision would be correct in a classification scenario where the model predicts whether a building will have high electricity consumption (e.g., above a threshold) and the focus is on minimizing false positives, such as in a fraud detection system for abnormal consumption patterns.

Why candidates choose this

Candidates may confuse regression with classification or mistakenly think precision applies to any prediction accuracy, not realizing it is specific to binary or multiclass classification.

✗F1 scoreWrong answer — click to see why▾

Why this is wrong here

F1 score is a metric for classification tasks, not regression. This question asks about evaluating a regression model predicting continuous electricity consumption, so F1 score is inappropriate.

★ When this WOULD be the correct answer

F1 score would be correct for a binary classification question, e.g., 'A data scientist builds a model to classify whether a building will have high electricity consumption (above a threshold) or not. Which metric balances precision and recall?'

Why candidates choose this

Candidates may confuse F1 score as a general performance metric applicable to any prediction task, not realizing it is specifically for classification with imbalanced classes.

✗Area Under the ROC Curve (AUC)Wrong answer — click to see why▾

Why this is wrong here

Area Under the ROC Curve (AUC) is a metric for binary classification, not regression. This question asks about predicting continuous electricity consumption values, making AUC inappropriate.

★ When this WOULD be the correct answer

AUC would be correct in a binary classification scenario, such as evaluating a model that predicts whether a building's electricity consumption exceeds a threshold (e.g., high vs. low consumption) based on features like building age and square footage.

Why candidates choose this

Candidates may confuse AUC as a general performance metric applicable to any predictive model, or they may mistakenly think the problem is classification due to the presence of a threshold.

Analysis generated from the official AI-900blueprint and verified against question context. The “when correct” sections are what AI assistants cite when candidates ask “what’s the difference between these options?”

Go deeper

AI-900 Practice Question: Describe fundamental principles of machine learning on Azure

Why each option matters

Option-by-option breakdown

Why each answer is right or wrong

Related to this question