AI-900 Describe fundamental principles of machine learning on Azure Practice Test 5 — 15 Questions

Question 1

A data scientist wants to train a model that predicts whether a customer will respond to a marketing offer (yes or no). The dataset includes features such as age, income, past purchase history, and the labeled outcome (responded or not responded) for previous customers. Which type of machine learning is this?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Supervised learning. This is supervised learning because the dataset includes labeled outcomes (responded or not responded) for previous customers, which the model uses to learn a mapping from input features (age, income, past purchase history) to the correct output. The goal is to predict a categorical label (yes/no), making it a classification task within supervised learning.

Answer

Unsupervised learning

Answer

Reinforcement learning

Answer

Semi-supervised learning

Question 2

A data scientist trains a binary classification model to detect fraudulent transactions. The dataset contains only 1% fraudulent cases. The model predicts 'not fraudulent' for all transactions and achieves 99% accuracy. Which metric would best reveal the model's poor performance on fraud detection?

Accepted Answer

Recall. Recall (sensitivity) measures the proportion of actual positive cases (fraudulent transactions) correctly identified by the model. With 1% fraud, a model that predicts 'not fraudulent' for all transactions will have a recall of 0% because it fails to catch any true positives, despite 99% accuracy. This makes recall the best metric to reveal the model's inability to detect fraud.

Answer

Precision

Answer

F1 score

Answer

Accuracy

Question 3

A data scientist is training a model to predict whether a patient has a rare disease (1% prevalence). The model predicts 'no disease' for all patients and achieves 99% accuracy, but fails to identify any actual cases. Which metric would best reveal this failure?

Accepted Answer

Recall. Recall (sensitivity) measures the proportion of actual positive cases correctly identified. With 1% disease prevalence and a model that predicts 'no disease' for all patients, recall is 0% because zero true positives are found. Accuracy (99%) is misleading here because the model fails to detect any rare disease cases, and recall directly exposes this failure.

Answer

Precision

Answer

F1 score

Answer

Mean absolute error

Question 4

A data scientist trains a machine learning model to predict house prices based on features like square footage, number of bedrooms, and location. The model achieves a very low error on the training data but performs poorly on a held-out test set. Which term best describes this situation?

Accepted Answer

Overfitting. The model performs exceptionally well on training data but poorly on test data, which is the classic symptom of overfitting. Overfitting occurs when the model learns noise and specific patterns in the training set rather than generalizing to unseen data. In Azure Machine Learning, this can be detected by monitoring the gap between training and validation metrics, and mitigated using techniques like regularization or early stopping.

Answer

Underfitting

Answer

High bias

Answer

High variance

Question 5

A retail company has historical data about customers, including age, purchase history, and whether they have churned (yes/no). They want to train a model that predicts if a new customer will churn. Which type of machine learning should they use?

Accepted Answer

Supervised classification. The goal is to predict a categorical outcome (churn: yes/no) from historical labeled data. Supervised classification algorithms, such as logistic regression or decision trees, learn from input features (age, purchase history) and the target label (churn status) to assign new customers to one of the discrete classes. This directly matches the requirement for a binary classification model.

Answer

Supervised regression

Answer

Unsupervised clustering

Answer

Reinforcement learning

Question 6

A medical research team trains a model to detect a rare disease from lab results. The disease occurs in only 1% of patients. The model predicts 'no disease' for every patient and achieves 99% accuracy. Which metric best reveals that the model is failing to identify actual disease cases?

Accepted Answer

Recall. Recall (sensitivity) measures the proportion of actual positive cases correctly identified by the model. With a 99% accuracy but zero true positives (since the model always predicts 'no disease'), recall is 0%, which directly reveals the model's failure to detect any actual disease cases. In Azure Machine Learning, recall is a key metric for imbalanced classification tasks, especially when missing a positive case has severe consequences.

Answer

Accuracy

Answer

Precision

Answer

F1 score

Question 7

A manufacturer trains a model to detect defective parts on an assembly line. Only 2% of parts are defective. The model predicts 'non-defective' for all parts and achieves 98% accuracy. Which metric best reveals the model's inability to identify defective parts?

Accepted Answer

Recall. Recall (sensitivity) measures the proportion of actual defective parts correctly identified by the model. With 98% accuracy but zero true positives (since the model labels everything as non-defective), recall is 0%, which directly exposes the model's failure to detect any defective parts despite high accuracy.

Answer

Accuracy

Answer

Precision

Answer

F1 Score

Question 8

A data scientist trains a classification model on a dataset of 10,000 labeled emails to distinguish spam from non-spam. The model achieves 99% accuracy on the training data but only 70% accuracy on a held-out test set. Which term best describes this situation?

Accepted Answer

B) Overfitting. The model performs exceptionally well on training data (99% accuracy) but poorly on unseen test data (70% accuracy), which is the classic symptom of overfitting. Overfitting occurs when the model learns noise and specific patterns in the training set rather than generalizing to new data, often due to excessive model complexity or insufficient regularization.

Answer

A) Underfitting

Answer

C) Bias-variance tradeoff

Answer

D) Regularization

Question 9

A real estate company has a dataset containing square footage, number of bedrooms, and location for 10,000 houses, along with their sale prices. They want to train a model that predicts the sale price of a new house based on these features. Which type of machine learning should they use?

Accepted Answer

Supervised regression. The goal is to predict a continuous numeric value (sale price) from input features (square footage, bedrooms, location). This is a classic supervised regression problem because the training data includes labeled target values (prices) and the output is a real number, not a category.

Answer

Supervised classification

Answer

Unsupervised clustering

Answer

Reinforcement learning

Question 10

A data scientist is evaluating a binary classification model that predicts whether a transaction is fraudulent. The test set contains 1,000 transactions: 990 legitimate and 10 fraudulent. The model's predictions are shown in the confusion matrix below. Confusion matrix: Predicted Legitimate Predicted Fraudulent Actual Legitimate 942 48 Actual Fraudulent 2 8 Which metric should the data scientist prioritize if the business goal is to minimize the number of fraudulent transactions that are missed (false negatives)?

Accepted Answer

Recall. Recall (sensitivity) measures the proportion of actual positives correctly identified, calculated as TP/(TP+FN). With 2 false negatives (missed fraudulent transactions), recall is 8/(8+2)=0.80. Minimizing missed fraud directly corresponds to maximizing recall, making it the correct priority for this business goal.

Answer

Precision

Answer

Accuracy

Answer

Specificity

Question 11

A retail company wants to analyze customer purchase histories to identify natural groups of customers with similar buying patterns. They do not have predefined categories. Which type of machine learning should they use?

Accepted Answer

Unsupervised clustering. Unsupervised clustering is the correct approach because the company wants to discover natural groupings in customer purchase histories without predefined labels. Clustering algorithms, such as K-Means or DBSCAN, partition data into clusters based on feature similarity, enabling the identification of customer segments with similar buying patterns without any prior training on labeled examples.

Answer

Reinforcement learning

Answer

Supervised classification

Answer

Supervised regression

Question 12

A real estate company trains a model to predict house prices. They evaluate it on a test set of 100 houses. The model predictions have a mean absolute error (MAE) of $5,000 and a root mean squared error (RMSE) of $20,000. What does the large difference between MAE and RMSE indicate about the model's errors?

Accepted Answer

The model has many small errors and a few large errors.. The mean absolute error (MAE) of $5,000 and root mean squared error (RMSE) of $20,000 show a large discrepancy because RMSE squares errors before averaging, which heavily penalizes large deviations. Since RMSE is four times larger than MAE, this indicates that while most predictions are close (small errors), there are a few predictions with very large errors that inflate the RMSE. This pattern is classic for a model that performs well on most houses but fails badly on a few outliers.

Answer

The model consistently overestimates prices.

Answer

The model has a high bias and low variance.

Answer

The model is perfectly accurate.

Question 13

A data scientist evaluates a regression model that predicts house prices. On the test set, the Mean Absolute Error (MAE) is $8,000 and the Root Mean Squared Error (RMSE) is $25,000. What does the large difference between MAE and RMSE indicate about the model's errors?

Accepted Answer

The model has some predictions with very large errors. The large difference between MAE ($8,000) and RMSE ($25,000) indicates that the model has some predictions with very large errors. RMSE squares the errors before averaging, which heavily penalizes large deviations, so a significantly higher RMSE relative to MAE suggests the presence of outliers or extreme prediction errors in the test set.

Answer

The model is overfitting the training data

Answer

The model predictions are consistently biased high

Answer

The model has high variance due to outliers in training data

Question 14

A data scientist trains a model on historical data and achieves high accuracy on both the training set and a held-out test set. However, when the model is deployed in production, it performs poorly on new, unseen data. Which issue is most likely the cause?

Accepted Answer

Data leakage. Data leakage occurs when information from outside the training dataset is inadvertently used to train the model, causing it to learn patterns that do not generalize to new data. In this scenario, the high accuracy on both training and test sets but poor production performance indicates that the test set was contaminated with information from the future or from the target variable, making the model appear accurate during validation but fail in real-world deployment.

Answer

Overfitting

Answer

Underfitting

Answer

Concept drift

Question 15

A data scientist trains a binary classification model to detect fraudulent transactions. The dataset contains 99% legitimate transactions (negative class) and 1% fraudulent transactions (positive class). The model predicts 'legitimate' for every transaction in the test set and achieves 99% accuracy. Which metric would best reveal that the model is failing to identify any fraudulent transactions?

Accepted Answer

Recall. Recall (also known as sensitivity or true positive rate) measures the proportion of actual positive cases (fraudulent transactions) that the model correctly identifies. With 99% accuracy but zero true positives, the recall is 0%, which immediately reveals the model's complete failure to detect fraud. In Azure Machine Learning, the classification metrics pane would show recall = 0.0 for the positive class, highlighting this issue despite high accuracy.

Answer

Accuracy

Answer

Precision

Answer

F1-score