Courseiva

CCNA Describe Fundamental Principles Of Machine Learning On Azure Questions

49 of 199 questions · Page 3/3 · Describe Fundamental Principles Of Machine Learning On Azure topic · Answers revealed

Practice these questionsExam hubAll questions
151
MCQeasy

What is 'clustering' in unsupervised machine learning?

A.Grouping similar data points together without predefined labels based on natural patterns
B.Classifying data points into predefined categories using labelled training examples
C.Grouping Azure compute resources together for distributed training jobs
D.Organising model training runs into logical groups for experiment tracking
AnswerA

Clustering partitions unlabelled data by similarity, so the algorithm discovers natural groupings without predefined labels. This satisfies the unsupervised constraint in the stem, where no target classes exist. Distinct from classification, which requires labelled training data to map inputs to known categories.

Why this answer

Clustering is an unsupervised learning technique that automatically groups data points based on inherent similarities or patterns in the data, without requiring any pre-existing labels. The algorithm identifies natural structures, such as distance or density relationships, to form clusters. In Azure Machine Learning, clustering is commonly implemented using algorithms like K-Means or DBSCAN for tasks such as customer segmentation or anomaly detection.

Exam trap

The trap here is that candidates confuse clustering (unsupervised) with classification (supervised), especially when the question mentions 'grouping' data, leading them to choose Option B which describes classification with predefined labels.

How to eliminate wrong answers

Option B is wrong because it describes supervised learning (classification), where models are trained on labelled examples to assign predefined categories, not unsupervised clustering. Option C is wrong because it refers to Azure compute cluster provisioning for distributed training, which is an infrastructure concept unrelated to machine learning algorithms. Option D is wrong because it describes organizing experiment tracking runs in Azure Machine Learning, which is a DevOps/MLOps practice, not a machine learning technique.

Practice this question →
152
MCQeasy

What is 'regression' in machine learning and when is it used?

A.A model that predicts which category an item belongs to from a set of options
B.Predicting a continuous numerical value such as price, temperature, or demand
C.Going back to a previous model version when the current version performs poorly
D.A technique for reducing the dimensionality of training data before model fitting
AnswerB

Regression in machine learning is the task of predicting a continuous numerical value, such as house price, energy demand, or tomorrow's temperature, from input features. The model learns a mapping from features to a real-valued output and is typically trained with loss functions like mean squared error to penalize the magnitude of prediction errors. This contrasts with classification, which predicts discrete categories, and is used in scenarios where the outcome naturally exists on an infinite numeric scale.

Why this answer

Regression is a supervised machine learning technique used to predict a continuous numerical value, such as price, temperature, or demand, based on input features. It models the relationship between independent variables and a dependent variable that has a real-valued output, making option B correct.

Exam trap

The trap here is that candidates confuse regression with classification, as both are supervised learning, but regression outputs a continuous number while classification outputs a discrete label.

How to eliminate wrong answers

Option A is wrong because it describes classification, not regression; classification predicts discrete categorical labels (e.g., 'cat' or 'dog'), not continuous values. Option C is wrong because it describes a version control or model rollback practice, not a machine learning algorithm or task. Option D is wrong because it describes dimensionality reduction (e.g., PCA), which is a preprocessing technique, not a predictive modeling task like regression.

Practice this question →
153
MCQmedium

A manufacturing team wants to predict product defects based on sensor readings from the production line. They have 10,000 historical samples, each labeled as 'defective' or 'non-defective'. Which type of machine learning should they use in Azure Machine Learning?

A.Supervised learning
B.Unsupervised learning
C.Reinforcement learning
D.Semi-supervised learning
AnswerA

The 10,000 samples carry known 'defective' or 'non-defective' labels, giving the model labelled ground truth to learn the mapping from sensor readings to outcome. Supervised classification in Azure Machine Learning fits precisely because labels exist, unlike unsupervised or reinforcement approaches.

Why this answer

This is a supervised learning problem because the dataset contains labeled historical samples (defective or non-defective), and the goal is to predict a categorical outcome based on sensor readings. In Azure Machine Learning, supervised learning algorithms such as two-class logistic regression or boosted decision trees are used to train a model that maps input features to known labels.

Exam trap

The trap here is that candidates may confuse 'predicting defects' with unsupervised anomaly detection, but the presence of explicit labels (defective/non-defective) makes this a supervised classification task, not an unsupervised one.

Why the other options are wrong

B

The dataset has labeled samples ('defective' or 'non-defective'), so the problem is supervised learning. Unsupervised learning is for unlabeled data, making it incorrect here.

C

Reinforcement learning is used for sequential decision-making with reward signals, not for predicting defects from labeled historical data. The question involves labeled samples (defective/non-defective), which is a supervised learning task.

Practice this question →
154
MCQeasy

What is 'data preprocessing' and why is it important for machine learning?

A.Encrypting sensitive data before storing it in Azure for security compliance
B.Transforming raw data (handling nulls, scaling, encoding) to make it suitable for ML training
C.The process of splitting raw data into training and test sets
D.Compressing data files to reduce the cost of Azure Blob Storage
AnswerB

Data preprocessing is the foundational transformation that converts raw, messy data into a clean, structured form for ML training: missing values are imputed or dropped, numerical features are scaled (e.g., Min-Max, z-score normalization) to prevent one feature from dominating, and categorical labels are encoded (one-hot, ordinal) into numeric vectors. It directly impacts model accuracy and training stability, as algorithms like gradient descent converge faster with normalized inputs and tree models require encoded categories. Without preprocessing, nulls can crash algorithms, wide-scale differences bias distance-based models, and string features are simply incompatible.

Why this answer

Data preprocessing is the transformation of raw data into a clean, structured format that machine learning algorithms can effectively learn from. Option B correctly identifies this as handling nulls, scaling numerical features, and encoding categorical variables, which are essential because ML models require numeric input and are sensitive to missing values and feature magnitudes.

Exam trap

The trap here is that candidates confuse data preprocessing with data splitting or security measures, but the core purpose is to clean and transform raw data so that ML models can interpret it correctly.

How to eliminate wrong answers

Option A is wrong because encrypting sensitive data is a security measure, not a preprocessing step that prepares data for ML training. Option C is wrong because splitting data into training and test sets is a separate step that occurs after preprocessing, not the preprocessing itself. Option D is wrong because compressing files reduces storage costs but does not transform data into a format suitable for ML algorithms.

Practice this question →
155
MCQmedium

What is recall (sensitivity) in the context of binary classification model evaluation?

A.The proportion of positive predictions that are actually correct
B.The proportion of actual positives that the model correctly identified
C.The overall proportion of predictions that match the actual labels
D.How quickly the model can be updated with new training data
AnswerB

Recall measures the fraction of actual positive instances that the model correctly identifies, mathematically TP / (TP + FN). It is also called sensitivity or true positive rate, and it directly reflects how well the model avoids missing positive cases. This makes it the correct definition for this question.

Why this answer

Recall (sensitivity) measures the proportion of actual positive cases that the model correctly identifies. In binary classification, it answers: 'Of all the truly positive instances, how many did the model catch?' This is critical in scenarios where missing a positive (false negative) is costly, such as disease screening or fraud detection.

Exam trap

The trap here is that candidates confuse recall with precision (Option A) because both involve true positives, but recall focuses on actual positives while precision focuses on predicted positives.

How to eliminate wrong answers

Option A is wrong because it describes precision, not recall — precision is the proportion of positive predictions that are actually correct (true positives divided by all predicted positives). Option C is wrong because it describes accuracy, which is the overall proportion of correct predictions (both true positives and true negatives) out of all predictions. Option D is wrong because it describes model retraining or update speed, which is unrelated to evaluation metrics like recall; recall is a static performance measure, not a measure of training agility.

Practice this question →
156
MCQmedium

What is 'model explainability' using SHAP values in Azure Machine Learning?

A.Explaining the model's predictions using a simplified version of the model that is easier to interpret
B.Calculating each feature's contribution to a specific prediction to explain why the model made that decision
C.Displaying the model's source code so users can verify what computations are performed
D.Testing the model on a separate evaluation dataset to report overall accuracy
AnswerB

SHAP (SHapley Additive exPlanations) values assign each feature a numeric contribution to a model's output for one specific instance, derived from cooperative game theory's Shapley values. They satisfy desirable properties such as local accuracy (the sum of attributions equals the prediction), consistency (changing a model so a feature has greater impact never lowers its attribution), and missingness (features with no influence get zero attribution). This is precisely a local, per-prediction explanation: it quantifies how much each input feature pushed the prediction away from the baseline toward the final decision.

Why this answer

SHAP (SHapley Additive exPlanations) values are a game-theoretic approach that assigns each feature an importance value for a particular prediction. Option B is correct because SHAP values quantify the contribution of each input feature to the model's output, providing a local explanation for why a specific decision was made. This is distinct from global feature importance or model simplification.

Exam trap

The trap here is that candidates confuse model explainability with model evaluation or model simplification, leading them to select Option A (surrogate model) or Option D (accuracy reporting) instead of recognizing that SHAP specifically provides per-feature contribution explanations for individual predictions.

How to eliminate wrong answers

Option A is wrong because it describes a surrogate model or model distillation (e.g., using a decision tree to approximate a black-box model), not SHAP values, which directly compute per-feature contributions without creating a separate simplified model. Option C is wrong because model explainability does not involve displaying source code; Azure Machine Learning does not expose model source code for verification, and SHAP is a post-hoc explanation method, not a code review tool. Option D is wrong because it describes model evaluation (testing accuracy on a holdout set), which is a performance metric, not an explainability technique that explains individual predictions.

Practice this question →
157
MCQmedium

What is 'model compression' and what techniques does it include?

A.Compressing training data files to reduce storage costs
B.Reducing model size through pruning, quantisation, distillation, and factorisation for efficient deployment
C.Summarising model documentation into a shorter model card format
D.Packaging model code and dependencies into a container image for deployment
AnswerB

Model compression reduces a trained model's computational footprint via pruning (removing low-importance weights), quantization (e.g., FP32→INT8), knowledge distillation (training a compact student to mimic a large teacher), and factorization (decomposing large weight matrices). These techniques enable edge deployment on resource-constrained devices and lower inference cost, usually with a small, controlled accuracy trade-off. This is precisely what the question describes.

Why this answer

Model compression is a set of techniques used to reduce the size of a trained machine learning model while preserving its accuracy as much as possible. This is critical for deploying models on resource-constrained devices like edge devices or mobile phones. The key techniques include pruning (removing unnecessary weights), quantization (reducing the precision of weights, e.g., from 32-bit floats to 8-bit integers), distillation (training a smaller 'student' model to mimic a larger 'teacher' model), and factorization (decomposing large weight matrices into smaller ones).

Option B correctly lists these four core techniques.

Exam trap

The trap here is that candidates confuse model compression with general deployment or data optimization tasks, such as containerization (Option D) or data compression (Option A), because the word 'compression' is used broadly in Azure contexts.

How to eliminate wrong answers

Option A is wrong because compressing training data files is a data storage optimization technique, not a model compression technique; model compression specifically targets the model's architecture and parameters, not the input data. Option C is wrong because summarizing model documentation into a shorter model card is a documentation or governance practice, not a technical method for reducing model size or computational footprint. Option D is wrong because packaging model code and dependencies into a container image is a deployment and containerization step (e.g., using Docker), which does not reduce the model's size or complexity; it simply bundles the existing model for portability.

Practice this question →
158
MCQeasy

What is Azure Machine Learning?

A.A pre-built AI service for specific tasks like vision or language
B.A cloud platform for building, training, deploying, and monitoring ML models
C.A database service optimized for storing ML training data
D.A GPU-only service for deep learning training
AnswerB

Azure Machine Learning is a comprehensive cloud platform that covers the entire machine learning lifecycle: creating experiments, training models, packaging and deploying them as REST endpoints, and monitoring performance and drift. It also includes MLOps capabilities like automated pipelines, model versioning, and responsible AI tools. This end-to-end scope makes it a platform rather than a single-purpose service.

Why this answer

Azure Machine Learning is a comprehensive cloud-based platform that provides end-to-end capabilities for the machine learning lifecycle, including building, training, deploying, and monitoring models. It supports various frameworks (e.g., TensorFlow, PyTorch, scikit-learn) and offers features like automated ML, pipelines, and MLOps integration. This distinguishes it from pre-built AI services or specialized infrastructure offerings.

Exam trap

The trap here is that candidates confuse Azure Machine Learning (a full ML platform) with Azure Cognitive Services (pre-built AI services), especially since both fall under the 'AI on Azure' umbrella, but the question specifically asks for the platform that enables custom model development.

How to eliminate wrong answers

Option A is wrong because it describes Azure Cognitive Services (now Azure AI Services), which are pre-built APIs for specific tasks like vision, language, or speech, not a platform for custom model development. Option C is wrong because Azure Machine Learning is not a database service; it can integrate with data stores like Azure Blob Storage or Azure SQL Database for training data, but it is not a database itself. Option D is wrong because Azure Machine Learning supports both CPU and GPU compute targets (e.g., Azure ML compute clusters, attached VMs), and is not limited to GPU-only workloads; it can run training on CPUs for many algorithms.

Practice this question →
159
MCQhard

A data scientist is training a logistic regression model to predict customer churn using a small dataset with 500 records and 200 features. The model achieves 97% accuracy on the training set but only 65% on a held-out test set, indicating severe overfitting. The data scientist wants to reduce overfitting by automatically eliminating irrelevant features. Which technique should the data scientist apply?

A.Apply L1 regularization (Lasso) to the model
B.Apply L2 regularization (Ridge) to the model
C.Use k-fold cross-validation to select the best model
D.Increase the number of training samples by data augmentation
AnswerA

L1 regularization (Lasso) is the correct choice here because it applies a penalty proportional to the absolute value of the coefficients, which drives the coefficients of irrelevant or redundant features to exactly zero. With 200 features and likely many that do not contribute to churn prediction, this produces a sparse model that performs automatic feature selection and directly reduces overfitting by eliminating noise-related dimensions. The resulting simpler model generalizes better to unseen data, making it the most appropriate regularization technique for this high-dimensional structured dataset.

Why this answer

L1 regularization (Lasso) adds a penalty equal to the absolute value of the magnitude of coefficients, which can shrink some coefficients exactly to zero. This performs automatic feature selection by eliminating irrelevant features, directly addressing the overfitting caused by having 200 features on only 500 records. The high training accuracy (97%) versus low test accuracy (65%) is a classic sign of overfitting that L1 regularization mitigates by reducing model complexity.

Exam trap

Microsoft often tests the distinction between L1 and L2 regularization: the trap here is that candidates confuse 'reducing overfitting' (which both can do) with 'eliminating features' (which only L1 does), leading them to pick L2 regularization or cross-validation instead.

Why the other options are wrong

B

L2 regularization (Ridge) shrinks coefficients but does not set them to zero, so it cannot automatically eliminate irrelevant features; it only reduces their impact. For feature selection, L1 regularization is needed.

C

Cross-validation is a method for model evaluation and hyperparameter tuning, not a technique for automatically eliminating irrelevant features. It does not directly reduce overfitting by feature selection.

D

Data augmentation increases the number of training samples, which can help reduce overfitting, but the question specifically asks for a technique to automatically eliminate irrelevant features. Data augmentation does not perform feature selection; it creates synthetic samples from existing data.

Practice this question →
160
MCQeasy

A retail company wants to automatically group its customers into distinct segments based on their purchasing patterns, without having pre-defined categories. The goal is to discover natural groupings in the customer data to tailor marketing campaigns. Which type of machine learning task should the company use?

A.Supervised learning - Classification
B.Unsupervised learning - Clustering
C.Reinforcement learning
D.Supervised learning - Regression
AnswerB

Clustering is an unsupervised learning technique that partitions data points into groups based on feature similarity, such as purchase history, spending amount, or browsing behavior. Algorithms like k-means or DBSCAN automatically discover natural customer segments from the patterns in these features without requiring any labeled examples or predefined outcomes. This directly matches the retail company's goal of grouping customers based on their attributes.

Why this answer

The company wants to discover natural groupings in customer data without pre-defined categories, which is the definition of unsupervised learning. Clustering algorithms (e.g., K-Means, DBSCAN) automatically partition data into segments based on similarity in purchasing patterns, making it the correct choice for this scenario.

Exam trap

The trap here is that candidates confuse 'grouping without labels' with classification (which requires labels) or regression (which predicts numbers), but the key differentiator is the absence of pre-defined categories, pointing directly to unsupervised clustering.

Why the other options are wrong

A

The question specifies no pre-defined categories and aims to discover natural groupings, which is unsupervised clustering. Supervised classification requires labeled data with known classes.

C

Reinforcement learning involves an agent learning to make decisions through trial and error to maximize a reward, which is not applicable to grouping customers into segments based on existing data without predefined categories or a reward signal.

D

The goal is to discover natural groupings without predefined categories, which is unsupervised clustering. Regression predicts a continuous numeric value, not customer segments.

Practice this question →
161
MCQeasy

What is the Azure Machine Learning workspace?

A.A web-based IDE for writing machine learning code in Python
B.The top-level Azure ML resource that organizes experiments, models, compute, and deployments
C.A virtual machine pre-configured with ML tools and libraries
D.A dedicated GPU cluster for distributed deep learning training
AnswerB

The Azure Machine Learning workspace is the root Azure resource (Microsoft.MachineLearningServices/workspaces) that acts as the central organizational hub for all ML work in a given project. It contains and groups experiments, datasets, models, compute targets, environments, and deployment endpoints, while also holding the shared configuration and secrets for those assets. It provides the fundamental scope for role-based access control, quota, and billing, so every resource in Azure ML must belong to exactly one workspace and cannot span workspaces. This is why it is the correct top-level resource.

Why this answer

The Azure Machine Learning workspace is the top-level resource in Azure that serves as a centralized hub for managing all machine learning activities. It organizes experiments, models, compute targets, and deployments, providing a unified environment for the entire ML lifecycle. This is the correct answer because the workspace is the foundational resource that ties together all other Azure ML components.

Exam trap

The trap here is that candidates often confuse the workspace with its components, such as the web-based IDE (Azure Machine Learning Studio) or compute resources (DSVM or GPU clusters), because the exam tests the distinction between the management layer and the execution resources.

How to eliminate wrong answers

Option A is wrong because a web-based IDE for writing machine learning code in Python describes Azure Machine Learning Studio (or Jupyter notebooks within the workspace), not the workspace itself. Option C is wrong because a virtual machine pre-configured with ML tools and libraries refers to a Data Science Virtual Machine (DSVM), which is a separate compute resource, not the workspace. Option D is wrong because a dedicated GPU cluster for distributed deep learning training describes a compute target (e.g., GPU cluster or Azure Machine Learning Compute), not the workspace that orchestrates it.

Practice this question →
162
MCQmedium

What is 'confusion matrix' and what does it tell you about a classification model?

A.A measure of how confused users are when interacting with an AI system's predictions
B.A table showing counts of correct and incorrect predictions broken down by predicted vs. actual class
C.A graphical display of how confident the model is across its entire test dataset
D.A diagram comparing the accuracy of multiple models on the same test set
AnswerB

A confusion matrix is a cross-tabulation of predicted class labels against actual class labels, with each cell counting how many instances fall into that combination. In binary classification, this yields true positives, true negatives, false positives, and false negatives, from which you can derive precision, recall, F1-score, and accuracy. It is the correct technical answer because it directly reveals not just overall correctness but the specific types of errors the model makes.

Why this answer

A confusion matrix is a specific table layout that allows visualization of the performance of a classification model. It shows the counts of true positive, true negative, false positive, and false negative predictions, broken down by each actual class versus each predicted class. This directly tells you not just overall accuracy, but also the types of errors the model is making, which is critical for evaluating classifiers in Azure Machine Learning.

Exam trap

The trap here is that candidates confuse the term 'confusion matrix' with user confusion or model confidence, when in fact it is a structured table of prediction counts that reveals the specific types of correct and incorrect classifications.

How to eliminate wrong answers

Option A is wrong because it describes user confusion in human-computer interaction, not a machine learning evaluation metric; a confusion matrix has nothing to do with user sentiment or confusion. Option C is wrong because a confusion matrix is a table of counts, not a graphical display of confidence scores; confidence scores are typically shown via calibration curves or reliability diagrams. Option D is wrong because a confusion matrix evaluates a single model's predictions against ground truth, not a comparison of multiple models; model comparison is done using metrics like accuracy, precision, recall, or ROC curves across models.

Practice this question →
163
MCQmedium

A data scientist trains a regression model to predict the selling price of houses. After evaluating on a test set, the data scientist wants a metric that measures the average absolute error between predicted and actual prices, expressed in the same units (dollars) as the target variable. Which evaluation metric should the data scientist use?

A.R-squared (R²)
B.Mean Absolute Error (MAE)
C.Root Mean Squared Error (RMSE)
D.Mean Squared Error (MSE)
AnswerB

MAE is the correct choice because it calculates the mean of the absolute differences between the predicted and actual dollar values. Because the absolute value is taken before averaging, the error is expressed in the same units as the target variable (dollars), giving the direct average absolute prediction error. It exactly matches the requirement.

Why this answer

Mean Absolute Error (MAE) is the correct metric because it directly measures the average absolute difference between predicted and actual house prices, and its result is expressed in the same unit (dollars) as the target variable. This makes it intuitive for stakeholders to understand the typical prediction error in monetary terms.

Exam trap

The trap here is that candidates often confuse RMSE with MAE because both are in the same units as the target, but RMSE measures the square root of the average squared error, not the average absolute error, and it gives more weight to large errors.

Why the other options are wrong

A

R-squared measures the proportion of variance explained by the model, not the average absolute error in dollars. It is unitless and does not express error in the same units as the target variable.

C

RMSE measures the square root of the average squared errors, so it is not in the same units as the target variable (dollars) — it is in dollars, but the squaring emphasizes larger errors, making it not a direct average absolute error.

D

MSE measures average squared error, so its units are dollars squared, not dollars. The question explicitly requires a metric expressed in the same units (dollars) as the target variable.

Practice this question →
164
MCQmedium

What is 'feature engineering' and why does it matter for machine learning models?

A.Building physical infrastructure features (GPU clusters) for model training
B.Creating and transforming input variables using domain knowledge to improve model performance
C.The process of selecting which machine learning algorithm to use for a task
D.Adding new computing nodes to a training cluster to speed up training
AnswerB

Feature engineering creates and transforms input variables, using domain knowledge to expose patterns a raw dataset hides — scaling, encoding, combining fields. Better-represented inputs let the algorithm learn more accurate relationships, directly improving model performance.

Why this answer

Feature engineering is the process of creating new input variables or transforming existing ones using domain knowledge to help machine learning models better capture patterns in the data. It directly impacts model performance by making the underlying relationships more explicit, reducing noise, and enabling algorithms to learn more effectively. In Azure Machine Learning, this is often done through automated feature engineering tools or custom Python scripts within pipelines.

Exam trap

The trap here is that candidates confuse feature engineering with hardware or infrastructure tasks (like GPU clusters or scaling nodes) because the word 'engineering' sounds technical, but the focus is purely on data transformation, not system architecture.

How to eliminate wrong answers

Option A is wrong because building physical infrastructure features like GPU clusters relates to hardware provisioning for training, not to the creation or transformation of input variables. Option C is wrong because selecting which machine learning algorithm to use is a separate step called algorithm selection or model selection, not feature engineering. Option D is wrong because adding computing nodes to a training cluster is a scaling operation for distributed training, not a data preparation technique.

Practice this question →
165
MCQmedium

A data scientist is building a machine learning model to predict the number of daily bike rentals in a city based on weather data and day of the week. The target variable is a continuous integer. Which type of machine learning task is this?

A.Classification
B.Regression
C.Clustering
D.Anomaly Detection
AnswerB

Regression is the correct supervised learning technique because the target variable is a continuous numeric value—the number of bike rentals. A regression model learns a mapping from input features to a real-valued output, allowing it to predict rental counts that were not present in the training data. Common regression algorithms include linear regression, decision trees, random forests, and neural networks with a linear output unit, all of which can output a continuous number.

Why this answer

The target variable is the number of daily bike rentals, which is a continuous integer (count). Predicting a continuous numeric value is a regression task. In Azure Machine Learning, regression algorithms such as Linear Regression, Decision Forest Regression, or Poisson Regression are used for this type of problem.

Exam trap

The trap here is that candidates confuse 'continuous integer' with classification because the output is an integer, but the key is that it's a continuous range of possible values (e.g., 0 to 500+), not a fixed set of categories.

How to eliminate wrong answers

Option A is wrong because classification predicts discrete categorical labels (e.g., 'high' vs 'low' rental day), not a continuous integer count. Option C is wrong because clustering groups unlabeled data into clusters based on similarity, without a predefined target variable. Option D is wrong because anomaly detection identifies rare or unusual data points, not the prediction of a normal continuous value.

Practice this question →
166
MCQhard

A data science team trains several machine learning models for a regression task. They observe that Model A has low training error and low test error. Model B has low training error but high test error. Model C has high training error and high test error. Which model would most likely benefit from an ensemble technique that averages the predictions of multiple models?

A.Model A (low training error, low test error)
B.Model B (low training error, high test error)
C.Model C (high training error, high test error)
D.None of the models would benefit from an ensemble technique
AnswerB

Model B has low training error but high test error, a classic sign of overfitting caused by high variance: the model memorizes noise in the training set and fails to generalize. Ensemble techniques such as bagging train multiple models on different bootstrap samples and average their predictions, which cancels out independent errors and stabilizes the decision boundary. This variance reduction directly targets the gap between training and test error, making Model B the clearest candidate for improvement.

Why this answer

Model B exhibits low training error but high test error, which is a classic sign of overfitting. Ensemble techniques like averaging predictions from multiple models reduce variance and improve generalization, making them most beneficial for overfit models. In Azure Machine Learning, you can use an ensemble pipeline or AutoML's VotingEnsemble to combine diverse models and lower test error.

Exam trap

The trap here is that candidates often assume ensembles always improve accuracy, but they are most effective for high-variance (overfit) models, not for underfit or already well-generalized models.

How to eliminate wrong answers

Option A is wrong because Model A already generalizes well (low training and test error), so an ensemble would provide minimal improvement and might add unnecessary complexity. Option C is wrong because Model C has high training error, indicating underfitting; ensembles primarily reduce variance, not bias, so they would not fix the underlying high bias. Option D is wrong because Model B clearly suffers from high variance, and ensemble techniques are specifically designed to address this issue by averaging predictions to smooth out overfitting.

Practice this question →
167
MCQmedium

A retail company has a dataset of customer transaction records with no predefined categories. They want to identify natural groupings of customers based on their purchasing behavior to create targeted marketing campaigns. Which type of machine learning should they use in Azure Machine Learning?

A.Classification
B.Regression
C.Clustering
D.Reinforcement learning
AnswerC

Clustering is the correct approach because it is an unsupervised learning technique that discovers natural groupings or segments in data without requiring pre-existing labels. Applied to customer transaction records, clustering groups customers with similar purchasing patterns, enabling the company to identify market segments, target promotions, or analyze behavior without needing a predefined target variable.

Why this answer

Clustering is the correct choice because the goal is to discover natural groupings in unlabeled data based on purchasing behavior. Azure Machine Learning provides clustering algorithms like K-Means that automatically partition customers into segments without predefined labels, enabling targeted marketing campaigns.

Exam trap

The trap here is that candidates confuse clustering with classification because both involve grouping, but clustering is unsupervised (no labels) while classification is supervised (requires labeled data).

Why the other options are wrong

A

Classification requires predefined categories (labels) to predict, but the question states the dataset has no predefined categories and the goal is to identify natural groupings, which is unsupervised clustering.

B

Regression predicts a continuous numeric value, such as sales amount, but the question asks to identify natural groupings of customers, which is a clustering task.

D

Reinforcement learning is used for decision-making in dynamic environments where an agent learns by interacting with the environment and receiving rewards, not for identifying natural groupings in static data.

Practice this question →
168
MCQmedium

A retail company wants to predict which customers are likely to stop using their service. They have a dataset with many customer attributes including age, income, purchase history, website activity, and support interactions. They suspect some features are redundant. Which technique should they use to reduce the number of features while preserving as much information as possible?

A.Normalization
B.Principal Component Analysis (PCA)
C.One-hot encoding
D.Regression analysis
AnswerB

Principal Component Analysis (PCA) is a dimensionality-reduction technique that uses orthogonal transformation to convert a set of possibly correlated features into a smaller set of linearly uncorrelated variables called principal components. These components are ordered so that the first few retain most of the variation present in the original data, allowing a high-dimensional feature set to be summarized with minimal information loss. By projecting customers onto a lower-dimensional subspace, PCA reduces the feature count while preserving the structure needed for predicting customer churn or purchase propensity.

Why this answer

Principal Component Analysis (PCA) is an unsupervised dimensionality reduction technique that transforms the original correlated features into a smaller set of uncorrelated principal components, ordered by the variance they capture. By retaining only the top components, PCA reduces the number of features while preserving as much of the total variance (information) as possible, making it ideal for handling redundant features in customer datasets.

Exam trap

The trap here is that candidates confuse normalization (scaling) with dimensionality reduction, or mistakenly think regression analysis can be used to select features, when PCA is the correct technique for reducing redundant features while preserving information.

Why the other options are wrong

A

Normalization scales features to a common range but does not reduce the number of features; it preserves all original features, so it cannot address redundancy.

C

One-hot encoding is used to convert categorical variables into numerical format, not to reduce the number of features or eliminate redundancy. It actually increases the number of features by creating binary columns for each category.

D

Regression analysis is used to model relationships between variables and predict a target, not to reduce feature dimensionality. The question asks for a technique to reduce features while preserving information, which is a dimensionality reduction task, not a predictive modeling task.

Practice this question →
169
MCQeasy

What is Azure Machine Learning's 'responsible AI dashboard'?

A.A legal compliance checklist for AI regulations in different countries
B.A multi-dimensional model analysis tool covering error analysis, interpretability, and fairness
C.A monitoring dashboard for tracking API usage and costs
D.A tool for documenting model cards for AI transparency
AnswerB

The Responsible AI dashboard in Azure Machine Learning is indeed a multi-dimensional model analysis tool that integrates several capabilities in one interface. It provides error analysis for identifying data cohorts where the model underperforms, interpretability via global and local feature importance explanations, and fairness metrics to evaluate disparate treatment across groups. It also supports counterfactual analysis to explore minimal input changes that alter predictions, making it a broad, interactive platform for understanding and diagnosing models.

Why this answer

The responsible AI dashboard in Azure Machine Learning is a comprehensive, multi-dimensional tool that integrates several open-source components (such as Error Analysis, InterpretML, and Fairlearn) to help data scientists and developers evaluate and improve their models across error analysis, interpretability, and fairness dimensions. It is designed to operationalize responsible AI practices by providing a single pane of glass for debugging model behavior, understanding feature importance, and detecting potential fairness issues.

Exam trap

The trap here is that candidates often confuse the responsible AI dashboard with a simple documentation or compliance tool (options A or D), when in fact it is an interactive, multi-dimensional analysis suite that goes far beyond static model cards or legal checklists.

How to eliminate wrong answers

Option A is wrong because it describes a legal compliance checklist, which is not a feature of the responsible AI dashboard; the dashboard is a technical analysis tool, not a legal document or regulatory checklist. Option C is wrong because it describes a monitoring dashboard for API usage and costs, which is typically handled by Azure Monitor or Azure Cost Management, not the responsible AI dashboard. Option D is wrong because while the dashboard can help generate model cards, its primary purpose is not just documentation; it is an interactive analysis tool for error analysis, interpretability, and fairness, with model card generation being a downstream output.

Practice this question →
170
MCQmedium

What is the role of a validation dataset in machine learning?

A.To provide the primary examples for training the model's weights
B.To tune hyperparameters and monitor performance during training without using test data
C.To provide the final, unbiased assessment of model performance
D.To store the model's trained weights for later use
AnswerB

The validation dataset exists to provide ongoing feedback during active model development, letting you tune hyperparameters, compare training runs, and detect overfitting or underfitting as training proceeds. Because it is a separate labeled split that is not used for gradient computation, its loss and accuracy offer an unbiased-in-the-loop signal that reflects how well the model generalizes beyond the training set. Crucially, using a validation set keeps the test dataset completely untouched for the final evaluation, preventing leakage from tuning choices. This makes validation an essential part of the training workflow rather than a storehouse, trainer, or final grader.

Why this answer

The validation dataset is used during model training to tune hyperparameters and monitor performance on unseen data, preventing overfitting without contaminating the test set. This allows iterative adjustments to model architecture or learning rate while keeping the test data reserved for final evaluation.

Exam trap

The trap here is that candidates often confuse the validation set with the test set, mistakenly thinking the validation set provides the final unbiased performance metric, when in fact the test set is reserved for that purpose.

How to eliminate wrong answers

Option A is wrong because the training dataset, not the validation set, provides the primary examples for updating model weights via backpropagation. Option C is wrong because the test dataset, not the validation set, provides the final unbiased assessment of model performance after all tuning is complete. Option D is wrong because storing trained weights is a function of model serialization (e.g., saving to a .pkl or .h5 file), not a role of the validation dataset.

Practice this question →
171
MCQmedium

A data scientist trains a binary classification model to detect fraudulent transactions. The dataset contains only 1% fraudulent cases. The model predicts 'not fraudulent' for all transactions and achieves 99% accuracy. Which metric would best reveal the model's poor performance on fraud detection?

A.Precision
B.Recall
C.F1 score
D.Accuracy
AnswerB

Recall, also sensitivity or true positive rate, is computed as TP / (TP + FN). Because the model fails to flag a single fraudulent transaction, TP = 0 and all actual frauds become false negatives, yielding recall = 0. This zero score precisely exposes the model's total failure to catch fraud, which is the business-critical goal. In imbalanced fraud detection, recall is the primary metric because the cost of missing fraud is far higher than false alarms.

Why this answer

Recall (sensitivity) measures the proportion of actual positive cases (fraudulent transactions) correctly identified by the model. With 1% fraud, a model that predicts 'not fraudulent' for all transactions will have a recall of 0% because it fails to catch any true positives, despite 99% accuracy. This makes recall the best metric to reveal the model's inability to detect fraud.

Exam trap

The trap here is that candidates see 99% accuracy and assume the model is performing well, failing to recognize that accuracy is a poor metric for imbalanced datasets where the minority class (fraud) is the focus.

How to eliminate wrong answers

Option A is wrong because precision measures the proportion of predicted positive cases that are actually positive; if the model never predicts fraud, precision is undefined (division by zero) and does not directly expose the failure to identify any fraud cases. Option C is wrong because the F1 score is the harmonic mean of precision and recall; with recall at 0%, the F1 score will also be 0%, but recall alone more directly and intuitively highlights the complete miss of fraudulent cases. Option D is wrong because accuracy is misleading in imbalanced datasets; 99% accuracy here simply reflects the model's correct prediction of the majority class (non-fraud) and hides the total failure on the minority class (fraud).

Practice this question →
172
MCQmedium

A data scientist has trained a binary classification model to predict whether an email is spam (positive) or not spam (negative). On a test set, the model correctly identifies 90 out of 100 actual spam emails and 80 out of 100 actual non-spam emails. Which metric shows the proportion of actual spam emails that the model correctly predicted?

A.A. Precision
B.B. Recall
C.C. F1 Score
D.D. Accuracy
AnswerB

Recall, also called sensitivity or true positive rate, directly measures the proportion of actual positive instances that the model successfully identifies. It is computed as true positives divided by the sum of true positives and false negatives, i.e., 90 out of 90+10, which equals 0.9. This precisely matches the question's definition of 'the proportion of actual spam correctly identified.'

Why this answer

Recall (also known as sensitivity or true positive rate) measures the proportion of actual positive cases that were correctly predicted by the model. In this scenario, the model correctly identified 90 out of 100 actual spam emails, so the recall is 90/100 = 0.9 (90%). This metric directly answers the question about how well the model captures actual spam emails.

Exam trap

The trap here is that candidates often confuse recall with precision, mistakenly thinking that 'correctly predicted actual spam' refers to precision, when precision instead answers 'of all emails predicted as spam, how many were actually spam?'

Why the other options are wrong

A

Precision measures the proportion of predicted spam emails that are actually spam, not the proportion of actual spam emails correctly identified. The question asks for recall (true positive rate).

C

The question asks for the proportion of actual spam emails correctly predicted, which is recall (true positive rate). F1 Score is the harmonic mean of precision and recall, not a direct measure of this proportion.

D

Accuracy measures the overall proportion of correct predictions (both spam and non-spam) out of all predictions, not specifically the proportion of actual spam emails correctly identified.

Practice this question →
173
MCQeasy

What is a training dataset in machine learning?

A.A dataset used to evaluate a trained model's performance on unseen data
B.The labeled data used to teach a machine learning model
C.Data that has been cleaned and normalized for analysis
D.Real-world data used after model deployment
AnswerB

Training data consists of input features paired with known correct output labels, serving as the ground truth for supervised learning. During training, the model iteratively adjusts its internal parameters (such as weights in a neural network) to minimize prediction error on these examples, thereby learning the underlying patterns and relationships. This labeled data is the direct source of knowledge for the model, distinguishing it from unlabeled inference data or preprocessed data that has not been used for teaching.

Why this answer

A training dataset is the labeled data used to teach a machine learning model by allowing it to learn patterns and relationships between features and labels. In Azure Machine Learning, this dataset is fed into an algorithm during the training step, where the model adjusts its internal parameters (e.g., weights in a neural network) to minimize prediction error. Without labeled training data, supervised learning models cannot learn the mapping from inputs to outputs.

Exam trap

The trap here is that candidates often confuse the training dataset with the test dataset or preprocessed data, mistakenly thinking any cleaned data or evaluation data qualifies as training data, when in fact the training dataset is specifically the labeled subset used to fit the model's parameters.

How to eliminate wrong answers

Option A is wrong because a dataset used to evaluate a trained model's performance on unseen data is called a test dataset or validation dataset, not a training dataset; the training dataset is used exclusively for learning, not evaluation. Option C is wrong because data that has been cleaned and normalized for analysis describes a preprocessed dataset, which could be used for training, testing, or any other purpose, but it is not specifically the labeled data used to teach a model. Option D is wrong because real-world data used after model deployment is referred to as inference data or production data, which the model processes to make predictions, and it is not used for training.

Practice this question →
174
MCQmedium

A data scientist is training a regression model to predict energy consumption. The dataset includes features like temperature, humidity, time of day, and day of week. After training, the model performs well on the training set but poorly on new data. Which approach would most likely help reduce this problem?

A.Add more features to the model.
B.Use a simpler model with fewer parameters.
C.Increase the number of training epochs.
D.Use a more complex model to capture more patterns.
AnswerB

Switching to a simpler regression model, such as a linear model instead of a high-degree polynomial, reduces the number of learnable parameters and therefore limits the model's capacity to memorize noise. This pushes the model toward the bias end of the bias-variance tradeoff, lowering variance and improving out-of-sample generalization. It is the most direct way to address overfitting when training data is limited.

Why this answer

The model performs well on the training set but poorly on new data, which is classic overfitting. Using a simpler model with fewer parameters reduces the model's capacity to memorize noise and irrelevant patterns, forcing it to learn the underlying generalizable relationships. This directly addresses the variance problem without requiring additional data or computational resources.

Exam trap

The trap here is that candidates often confuse 'poor performance on new data' with underfitting and incorrectly choose to add more features or increase complexity, when the symptom of high training accuracy with low test accuracy clearly indicates overfitting requiring simplification.

How to eliminate wrong answers

Option A is wrong because adding more features increases the dimensionality and complexity, which typically worsens overfitting by giving the model more spurious correlations to memorize. Option C is wrong because increasing training epochs does not fix overfitting; it often exacerbates it by allowing the model to further minimize training error at the expense of generalization. Option D is wrong because using a more complex model with more parameters increases capacity, which is the opposite of what is needed to reduce overfitting—it would likely increase variance and make the problem worse.

Practice this question →
175
MCQmedium

What is 'feature importance' in Azure Machine Learning and how is it used?

A.Ranking which ML project features (notebooks, experiments, pipelines) are most used by the team
B.Quantifying how much each input variable contributes to a model's predictions
C.Determining which model features (capabilities) are included in each Azure ML pricing tier
D.The priority order in which data preprocessing steps are applied before training
AnswerB

Feature importance is the correct interpretation because it directly answers which input variables influence a model's predictions. Techniques such as permutation importance, SHAP values, or partial dependence plots assign a numerical contribution score to each predictor, allowing you to see, for example, that credit score drives risk more than zip code. This insight is used for debugging, feature selection, model simplification, and regulatory requirements like explaining automated lending or hiring decisions.

Why this answer

Feature importance is a technique in Azure Machine Learning that quantifies the contribution of each input variable (feature) to a model's predictions. It is used to interpret model behavior, identify the most influential features, and validate that the model aligns with domain knowledge. This is critical for debugging, improving model performance, and ensuring regulatory compliance.

Exam trap

The trap here is that 'feature' is a polysemous term in Azure ML—candidates often confuse it with 'features' as in product capabilities or project artifacts, rather than the specific machine learning concept of input variables used for model training.

How to eliminate wrong answers

Option A is wrong because it confuses 'feature importance' with usage analytics of Azure ML artifacts (notebooks, experiments, pipelines), which is unrelated to model interpretability. Option C is wrong because it misinterprets 'feature' as a product capability in Azure ML pricing tiers, not as an input variable to a machine learning model. Option D is wrong because it describes the order of data preprocessing steps, which is a data engineering concern, not a post-training model interpretation technique.

Practice this question →
176
MCQmedium

What is a feature in the context of machine learning?

A.The output or prediction made by a machine learning model
B.An individual measurable property used as input to a machine learning model
C.A type of neural network layer
D.A software capability in Azure Machine Learning
AnswerB

A feature is an individual measurable property of the data that a model consumes as input — for instance, age, temperature, pixel intensity, or word frequency. In a tabular dataset, each feature is a column, and each row is an example with a feature vector. Models analyze these inputs to learn patterns and later map a new example’s features to a prediction.

Why this answer

In machine learning, a feature is an individual measurable property or characteristic of the data that is used as input to a model. Features are the variables that the model learns from to make predictions or classifications. This is a fundamental concept in ML, as the quality and relevance of features directly impact model performance.

Exam trap

The trap here is confusing the input (features) with the output (labels/predictions), especially since the term 'feature' is sometimes loosely used in other contexts like software features, leading candidates to pick option A or D.

How to eliminate wrong answers

Option A is wrong because the output or prediction made by a machine learning model is called a label or target, not a feature. Option C is wrong because a neural network layer is a structural component of a deep learning model, not a property of input data. Option D is wrong because a software capability in Azure Machine Learning is a service or tool (e.g., automated ML, designer), not a data attribute used as input.

Practice this question →
177
MCQeasy

What does Azure Machine Learning's 'compute cluster' provide?

A.A Kubernetes cluster for deploying trained models as REST APIs
B.Scalable, auto-scaling cloud compute for running ML training jobs that scales to zero when idle
C.A data storage cluster for distributing training datasets across nodes
D.A network of IoT sensors for collecting training data
AnswerB

This is correct because an Azure Machine Learning compute cluster is a managed pool of CPU/GPU VMs that auto-scales from zero nodes to the required number for training jobs, then returns to zero when idle. You only pay for the compute while it is actively running, making it cost-efficient for periodic training workloads. It supports parallel training and batch inference, aligning with the description of scalable, auto-scaling cloud compute for ML training.

Why this answer

Azure Machine Learning's compute cluster provides a scalable, auto-scaling cloud compute environment specifically designed for running ML training jobs. It automatically scales up to handle large workloads and scales down to zero nodes when idle, optimizing cost and resource utilization.

Exam trap

The trap here is confusing compute cluster (for training) with inference clusters like AKS (for deploying models as REST APIs), leading candidates to select Option A incorrectly.

How to eliminate wrong answers

Option A is wrong because a Kubernetes cluster for deploying trained models as REST APIs is provided by Azure Kubernetes Service (AKS) or Azure Container Instances, not by a compute cluster, which is focused on training rather than inference. Option C is wrong because data storage for distributing training datasets is handled by Azure Blob Storage, Azure Data Lake, or Azure Machine Learning datastores, not by a compute cluster, which is a compute resource. Option D is wrong because IoT sensors for collecting training data are part of Azure IoT Hub or Azure Sphere, not a compute cluster, which is a cloud-based compute resource for processing data, not collecting it.

Practice this question →
178
MCQmedium

A retail company wants to segment its customers into different groups based on purchasing behavior, without using predefined categories. Which type of machine learning task should they use?

A.Classification
B.Regression
C.Clustering
D.Reinforcement learning
AnswerC

Clustering is an unsupervised learning technique that automatically discovers natural groupings within unlabeled data based on feature similarity. For customer segmentation, algorithms like k-means or DBSCAN partition customers into distinct clusters where members of the same cluster share purchase behaviors or demographics. Since no predefined categories exist, clustering directly identifies the underlying segments the retail company is looking for.

Why this answer

Clustering is the correct choice because it is an unsupervised learning technique that groups data points based on inherent similarities without requiring predefined labels. In this scenario, the retail company wants to discover natural segments in customer purchasing behavior, such as high-frequency buyers or discount seekers, without providing any existing categories. Azure Machine Learning offers clustering algorithms like K-Means, which iteratively assigns customers to clusters by minimizing within-cluster variance based on features like purchase frequency and average order value.

Exam trap

The trap here is that candidates often confuse clustering with classification because both involve grouping, but classification requires predefined labels while clustering discovers groups from unlabeled data, which is the key distinction tested in this question.

Why the other options are wrong

A

Classification requires predefined categories (labels) to predict, but the question specifies 'without using predefined categories', making clustering the correct unsupervised approach.

B

Regression predicts a continuous numeric value, such as sales amount, but the question asks for grouping customers into segments without predefined categories, which is a clustering task.

D

Reinforcement learning involves an agent learning to make decisions by interacting with an environment to maximize rewards, not for segmenting data into groups without predefined categories.

Practice this question →
179
MCQmedium

A data scientist is building a machine learning model to predict whether a credit card transaction is fraudulent or legitimate. The dataset contains 100,000 historical transactions, each labeled as 'fraudulent' or 'legitimate'. Which type of machine learning task should the data scientist use in Azure Machine Learning?

A.Regression
B.Binary classification
C.Multi-class classification
D.Clustering
AnswerB

Binary classification is the correct choice because the model predicts one of exactly two discrete outcomes: fraudulent or legitimate. This is a supervised learning problem since every training example includes a known label. Algorithms such as logistic regression, decision trees, or boosted ensembles can learn a decision boundary that separates these two classes. The binary nature of the target variable is the defining characteristic.

Why this answer

Binary classification is the correct choice because the prediction task involves distinguishing between exactly two mutually exclusive classes: 'fraudulent' and 'legitimate'. In Azure Machine Learning, binary classification algorithms (e.g., Two-Class Logistic Regression, Two-Class Boosted Decision Tree) are designed to output a probability score for one of two labels, making them ideal for this fraud detection scenario.

Exam trap

The trap here is that candidates confuse binary classification with multi-class classification, mistakenly thinking that 'fraudulent' and 'legitimate' are two separate classes requiring multi-class logic, when in fact binary classification is explicitly designed for exactly two outcomes.

Why the other options are wrong

A

Regression predicts a continuous numeric value, but fraud detection requires predicting a discrete category (fraudulent or legitimate).

C

Multi-class classification is used for predicting more than two classes, but here the task is binary (fraudulent vs. legitimate), so it is not appropriate.

D

Clustering is an unsupervised learning task used to group unlabeled data, but the dataset has labeled transactions ('fraudulent' or 'legitimate'), so supervised learning is required.

Practice this question →
180
MCQeasy

What type of machine learning model is used for time series forecasting?

A.K-means clustering to group similar time periods together
B.Sequential models (like LSTM, ARIMA) that learn patterns in historical time-ordered data to predict future values
C.Image classification models applied to chart images
D.Decision trees that map dates to outcomes
AnswerB

Sequential models like ARIMA and LSTM are purpose-built for time series forecasting because they explicitly model dependencies across ordered time steps. ARIMA captures autoregressive and moving-average components after differencing to achieve stationarity, while LSTM uses gated recurrent units to retain long-term patterns. By learning from historical numeric sequences, these models can project future values while accounting for trend, seasonality, and noise.

Why this answer

Time series forecasting relies on sequential models like LSTM (a type of recurrent neural network) or ARIMA (AutoRegressive Integrated Moving Average) that explicitly capture temporal dependencies, trends, and seasonality in historical data ordered by time. These models learn patterns from past observations to predict future values, making them the standard approach for tasks such as stock price prediction or demand forecasting.

Exam trap

The trap here is that candidates may confuse clustering (Option A) with time series segmentation, but clustering does not perform forecasting—it only groups data points without predicting future values in a temporal sequence.

How to eliminate wrong answers

Option A is wrong because K-means clustering is an unsupervised learning algorithm used to partition data into groups based on similarity, not to model time-ordered dependencies or predict future values; it cannot capture temporal autocorrelation or trends. Option C is wrong because image classification models (e.g., convolutional neural networks) are designed to classify visual content in images, not to analyze numerical time series data; applying them to chart images would lose the underlying sequential numerical structure and is not a standard forecasting technique. Option D is wrong because decision trees map input features (including dates) to outcomes via hierarchical splits, but they do not inherently model temporal order, autocorrelation, or sequential patterns; they treat each observation independently and cannot capture time-dependent dynamics like seasonality or trends.

Practice this question →
181
MCQeasy

What is the purpose of a 'validation dataset' in machine learning?

A.Validating that the training data complies with data privacy regulations
B.A held-out data split used during development to tune hyperparameters and compare models
C.The original dataset before any preprocessing transformations are applied
D.Data that has been manually verified as 100% correct by domain experts
AnswerB

A validation dataset is held out from training and used to tune hyperparameters and select between candidate models, satisfying the need to compare models without touching the test set. The test set remains reserved for final unbiased evaluation.

Why this answer

A validation dataset is a held-out subset of the training data used during model development to tune hyperparameters and compare different models without bias. In Azure Machine Learning, this split is typically performed using the `train_test_split` function or automated via AutoML's cross-validation settings, ensuring that the model's performance on unseen data is accurately estimated before final evaluation on the test set.

Exam trap

The trap here is that candidates often confuse the validation dataset with the test dataset, but the validation set is used iteratively during development to tune the model, while the test set is reserved for final unbiased evaluation only after all tuning is complete.

How to eliminate wrong answers

Option A is wrong because validating compliance with data privacy regulations (e.g., GDPR, CCPA) is a data governance task, not a purpose of a validation dataset in machine learning; such checks are performed during data preparation and auditing, not during model training. Option C is wrong because the original dataset before preprocessing is called the 'raw dataset,' not a validation dataset; preprocessing transformations (e.g., normalization, encoding) are applied to the entire dataset before splitting, and the validation set is a subset of the preprocessed data. Option D is wrong because a validation dataset does not require manual verification by domain experts to be 100% correct; it is simply a random or stratified sample of the training data, and any labeling errors would affect all splits equally.

Practice this question →
182
MCQmedium

What is 'Azure Machine Learning's job submission' and what types of training jobs are supported?

A.Submitting applications to join the Azure AI Engineering team at Microsoft
B.Submitting training scripts to managed compute — command, sweep, pipeline, and AutoML job types
C.Submitting model predictions as batch jobs to process large datasets overnight
D.Scheduling when model monitoring jobs run to check for data drift
AnswerB

Job submission sends a training script or configuration to managed compute, where Azure Machine Learning handles orchestration. Command jobs run a single script, sweep jobs tune hyperparameters, pipeline jobs chain steps, and AutoML jobs automate model selection.

Why this answer

Azure Machine Learning's job submission is the process of sending a training script to a managed compute target for execution. The supported job types are command (running a script), sweep (hyperparameter tuning), pipeline (multi-step workflows), and AutoML (automated model selection and training). This makes option B correct because it accurately lists these four job types.

Exam trap

The trap here is confusing training jobs with other job types like batch inferencing or monitoring jobs, leading candidates to select option C or D because they see the word 'job' and assume it covers all Azure ML job types.

How to eliminate wrong answers

Option A is wrong because it describes applying for a job at Microsoft, not a technical feature of Azure Machine Learning. Option C is wrong because it describes batch inferencing (scoring) jobs, not training jobs; batch jobs are used for predictions, not model training. Option D is wrong because it describes model monitoring jobs for data drift detection, which are separate from training jobs and are part of Azure Machine Learning's monitoring capabilities.

Practice this question →
183
MCQhard

An online retailer wants to build a recommendation system that learns from user interactions. The system suggests a product, and if the user clicks it, it receives a positive reward; if ignored, a negative reward. Over time, the system learns to make better suggestions. Which type of machine learning best describes this approach?

A.Supervised learning
B.Unsupervised learning
C.Reinforcement learning
D.Semi-supervised learning
AnswerC

Reinforcement learning fits because the retailer's recommendation system is an agent that selects items to present (actions) to users (the environment) and observes engagement signals such as clicks as rewards. The agent's objective is to maximize cumulative reward over time by learning a policy that maps user state to optimal recommendations. This trial-and-error learning from delayed feedback—rather than from a fixed labeled dataset—is the defining characteristic of an RL problem.

Why this answer

Reinforcement learning is correct because the system learns by interacting with its environment (user clicks) and receiving rewards (positive for clicks, negative for ignores) to maximize cumulative reward over time. This trial-and-error feedback loop, without explicit labeled data, is the hallmark of reinforcement learning.

Exam trap

The trap here is that candidates confuse reinforcement learning with supervised learning because both involve feedback, but reinforcement learning uses evaluative feedback (rewards) rather than instructive feedback (labeled examples).

Why the other options are wrong

A

The system learns from rewards and penalties based on its actions (suggesting products) without explicit labeled examples, which is characteristic of reinforcement learning, not supervised learning.

B

Unsupervised learning finds hidden patterns in unlabeled data without explicit feedback, but this system learns from positive/negative rewards based on user clicks, which is a hallmark of reinforcement learning.

D

Semi-supervised learning uses a small amount of labeled data with a large amount of unlabeled data, but the scenario describes learning from rewards (positive/negative feedback) without explicit labeled examples, which is characteristic of reinforcement learning.

Practice this question →
184
MCQmedium

What is the purpose of Azure Machine Learning's dataset versioning?

A.Encrypting datasets with different security keys for each version
B.Tracking changes to training data over time to enable reproducibility and auditing
C.Creating multiple copies of training data in different storage regions
D.Limiting which team members can access different versions of training data
AnswerB

Dataset versioning in Azure Machine Learning snapshots each data change, letting you reproduce a training run against the exact data used and audit lineage. This satisfies the reproducibility and auditing constraint rather than merely storing files.

Why this answer

Azure Machine Learning's dataset versioning allows data scientists to track changes to training data over time by creating immutable snapshots of datasets. This ensures reproducibility of experiments and provides an audit trail, which is critical for compliance and debugging model performance regressions.

Exam trap

The trap here is that candidates confuse dataset versioning with data replication or security features, mistakenly thinking it creates multiple copies or enforces access controls, when its core purpose is reproducibility and auditability.

How to eliminate wrong answers

Option A is wrong because dataset versioning does not involve encryption key management; encryption is handled separately via Azure Key Vault or storage service encryption. Option C is wrong because versioning creates logical snapshots, not physical copies in different regions; geo-replication is a storage configuration, not a feature of dataset versioning. Option D is wrong because access control is managed through Azure RBAC and dataset permissions, not through versioning itself; versioning does not inherently restrict access to specific versions.

Practice this question →
185
MCQeasy

What is the difference between 'training' and 'inference' in machine learning?

A.Training creates models from data; inference uses trained models to make predictions
B.Training is for testing models; inference is for training them
C.They are the same process with different names for clarity
D.Training is for image models; inference is for text models
AnswerA

Training is the learning phase: an algorithm iteratively adjusts its internal parameters (weights and biases) by minimizing a loss function on labeled examples, capturing statistical patterns in the data. Inference is the production phase: the trained, frozen model performs a forward pass on new, unseen data to output predictions rapidly, without any parameter updates, enabling real-world use.

Why this answer

Training is the phase where a machine learning model learns patterns from labeled or unlabeled data by adjusting its internal parameters (e.g., weights in a neural network) to minimize a loss function. Inference is the subsequent phase where the trained model applies those learned patterns to new, unseen data to generate predictions or classifications. In Azure Machine Learning, training typically involves running a script on a compute target (e.g., a GPU cluster) and registering the resulting model, while inference is performed by deploying that model as a real-time endpoint or batch pipeline.

Exam trap

The trap here is that candidates confuse the terms 'training' and 'inference' as interchangeable or domain-specific, when in fact they represent distinct lifecycle phases with different computational and operational requirements in Azure Machine Learning.

How to eliminate wrong answers

Option B is wrong because training is not for testing models; testing (or validation) is a separate step to evaluate model performance, and inference is the application of a trained model, not a training phase. Option C is wrong because training and inference are fundamentally distinct processes with different goals, data requirements, and computational characteristics; they are not the same process with different names. Option D is wrong because both training and inference apply across all data modalities (image, text, tabular, audio, etc.) in Azure Machine Learning; training is not exclusive to image models, nor is inference exclusive to text models.

Practice this question →
186
MCQmedium

What is a confusion matrix's 'false positive' in medical screening?

A.A patient who tests positive and actually has the disease
B.A patient predicted to have a disease who is actually healthy
C.A patient who tests negative but actually has the disease
D.A patient correctly identified as healthy by the model
AnswerB

Here the model outputs 'disease present' (a positive prediction) for a person who is actually healthy (negative actual state), so the prediction is false relative to reality. This is precisely a false positive, or type I error, and in healthcare it triggers unnecessary worry, extra tests, and possibly invasive follow-up procedures. The existing explanation correctly identifies this as the right answer.

Why this answer

In a confusion matrix, a false positive occurs when the model predicts a positive outcome (e.g., disease present) but the actual ground truth is negative (healthy). This is a Type I error, and in medical screening it represents a healthy patient incorrectly flagged as having the disease, leading to unnecessary follow-up tests and anxiety.

Exam trap

The trap here is confusing 'false positive' with 'false negative' — candidates often mix up which axis (predicted vs. actual) defines the error, especially when the question uses medical screening terminology instead of standard ML terms.

How to eliminate wrong answers

Option A is wrong because it describes a true positive (TP), where the model correctly identifies a patient who actually has the disease. Option C is wrong because it describes a false negative (FN), where the model misses a patient who actually has the disease (Type II error). Option D is wrong because it describes a true negative (TN), where the model correctly identifies a healthy patient as healthy.

Practice this question →
187
MCQhard

What is 'federated learning' and when is it used for privacy-preserving AI?

A.Training a model using data from multiple countries governed by a federal legal system
B.Distributed training where devices share model updates (not raw data) — enabling privacy-preserving collaborative learning
C.A training approach where a federal government agency controls access to all training data
D.Combining predictions from models trained independently at multiple research institutions
AnswerB

Federated learning is a distributed training technique where each participant trains on its own local data and only shares model updates—such as gradients or weights—with a central aggregator. This enables a shared model to be improved collaboratively across multiple organizations without exposing sensitive raw data. Because raw data never leaves the local device, the approach provides privacy-preserving collaborative learning. This exactly matches the definition of federated learning.

Why this answer

Federated learning is a distributed machine learning technique where the model is trained across multiple decentralized devices or servers holding local data, without exchanging the raw data itself. Instead, only model updates (e.g., gradients or weights) are shared with a central server, which aggregates them to improve the global model. This approach preserves privacy because sensitive data never leaves the local device, making it ideal for scenarios like healthcare, finance, or mobile keyboard prediction where data cannot be centralized due to regulatory or privacy constraints.

Exam trap

The trap here is that candidates confuse 'federated' with 'federal' or 'government-controlled' systems, or mistake federated learning for simple ensemble methods, when the core concept is decentralized training with privacy-preserving model update sharing.

How to eliminate wrong answers

Option A is wrong because it confuses 'federated' with 'federal' legal systems; federated learning has nothing to do with countries governed by a federal legal structure, but rather refers to a decentralized training architecture. Option C is wrong because it incorrectly implies that a federal government agency controls access to training data; in federated learning, data remains on local devices and is never centrally controlled or accessed by any authority. Option D is wrong because it describes ensemble learning or model combination, not federated learning; federated learning involves iterative collaborative training with shared model updates, not simply combining independently trained models' predictions.

Practice this question →
188
MCQmedium

What is cross-validation in machine learning?

A.Training multiple different models and comparing their performance
B.Repeatedly training and evaluating the model on different data splits for reliable performance estimates
C.Checking if a model works correctly by running it backward
D.Training a model on two different datasets simultaneously
AnswerB

In k-fold cross-validation, the data is randomly partitioned into k equal-sized folds; the model is trained on k−1 folds and evaluated on the remaining fold, and this process is repeated k times so each example serves as validation data exactly once. The evaluation results from all folds are averaged to produce a more stable and less biased estimate of model performance than a single train/test split. This repeated resampling reduces the variance of the performance estimate and makes better use of limited labeled data.

Why this answer

Cross-validation is a technique for assessing how a machine learning model will generalize to an independent dataset. It involves partitioning the data into complementary subsets, training the model on one subset (the training fold), and validating it on the remaining subset (the validation fold), then repeating this process multiple times with different partitions. The final performance estimate is the average of the validation scores, which provides a more reliable and less biased measure than a single train-test split.

Exam trap

The trap here is that candidates confuse cross-validation with simply training multiple models (Option A), but cross-validation specifically refers to repeatedly training and evaluating the same model type on different data splits to obtain a stable performance estimate, not comparing different model architectures.

How to eliminate wrong answers

Option A is wrong because training multiple different models and comparing their performance describes model selection or ensemble methods, not cross-validation, which uses the same model architecture across different data splits. Option C is wrong because running a model backward is not a valid machine learning practice; cross-validation is a forward process of training and evaluating on different data splits, not a reverse execution of the algorithm. Option D is wrong because training a model on two different datasets simultaneously describes multi-task learning or data fusion, not cross-validation, which uses different splits of the same dataset sequentially.

Practice this question →
189
MCQhard

A data scientist trains a regression model to predict energy consumption for a smart building. The model achieves very low error on the training data but performs significantly worse on a held-out validation set. Which technique would most directly address this problem?

A.Feature engineering
B.Regularization
C.Cross-validation
D.Hyperparameter tuning
AnswerB

Regularization directly addresses overfitting by adding a penalty term to the loss function that grows with the magnitude of the model's coefficients. Techniques such as L1 (Lasso) and L2 (Ridge) force the model to keep weights small or drive some to zero, effectively reducing model complexity and variance. This penalty discourages the model from fitting noise in the training data, which is exactly why it is the correct method for the scenario described.

Why this answer

The model's low training error but high validation error indicates overfitting, where the model has memorized the training data rather than learning generalizable patterns. Regularization (e.g., L1 or L2) directly penalizes large coefficients, reducing model complexity and improving generalization to unseen data.

Exam trap

The trap here is that candidates confuse cross-validation (a performance evaluation method) with a technique to fix overfitting, or think hyperparameter tuning alone resolves overfitting without understanding that regularization is the specific mechanism to penalize complexity.

How to eliminate wrong answers

Option A is wrong because feature engineering can improve model performance by creating better input features, but it does not directly address overfitting caused by excessive model complexity. Option C is wrong because cross-validation is a technique for evaluating model performance and detecting overfitting, not a method to reduce it. Option D is wrong because hyperparameter tuning can help find optimal settings, but without regularization, tuning other hyperparameters (e.g., learning rate) may not directly constrain model complexity to prevent overfitting.

Practice this question →
190
MCQeasy

A data scientist trains a machine learning model to predict housing prices. On the training data, the model achieves an R-squared value of 0.99, but on a separate validation dataset it achieves an R-squared of only 0.65. What is the most likely issue with this model?

A.Overfitting
B.Underfitting
C.High bias
D.Insufficient training data
AnswerA

The classic signature of overfitting is a model that achieves very high accuracy on training data but shows a substantial drop on validation or test data. Because the model has enough capacity to memorize the training examples—including their noise and outliers—it fails to generalize to unseen patterns. The large gap between training and validation performance is the defining diagnostic for overfitting.

Why this answer

The model performs exceptionally well on the training data (R² = 0.99) but poorly on the validation data (R² = 0.65), which is a classic symptom of overfitting. Overfitting occurs when the model learns noise and specific patterns in the training set that do not generalize to unseen data, often due to excessive complexity (e.g., too many features or deep decision trees). In Azure Machine Learning, this can be detected by comparing training and validation metrics in automated ML runs or by using regularization techniques like L1/L2 penalties.

Exam trap

The trap here is that candidates may confuse high training accuracy with a good model, overlooking the validation gap, or incorrectly attribute the issue to underfitting or high bias because they focus on the low validation score without considering the training performance.

Why the other options are wrong

B

Underfitting occurs when the model performs poorly on both training and validation data, but here the training R-squared is very high (0.99) while validation is low (0.65), indicating the model memorized training data rather than failing to learn patterns.

C

High bias (underfitting) would cause poor performance on both training and validation data, not high training R² (0.99) with low validation R² (0.65). The discrepancy indicates overfitting, not bias.

D

The model performs well on training data (R²=0.99) but poorly on validation data (R²=0.65), indicating overfitting, not insufficient data. Insufficient data typically causes both training and validation performance to be poor.

Practice this question →
191
MCQmedium

A data scientist trains a binary classification model to detect a rare disease. The dataset contains 99% negative cases and only 1% positive cases. The model predicts all cases as negative, achieving an accuracy of 99% on the test set. However, the business requires the model to identify as many positive cases as possible. Which metric should the data scientist examine to best reveal that the model is failing to identify any positive cases?

A.Precision
B.Recall
C.F1 score
D.AUC-ROC
AnswerB

Recall, also called sensitivity or true positive rate, computes the proportion of actual positive cases the model correctly identifies, TP / (TP + FN). With no positive predictions, TP = 0 while FN equals the total number of real positive examples, so recall is exactly 0%. This zero is directly meaningful: it tells you the model failed to catch every single positive case, which is the core failure in this scenario. Unlike precision, recall does not depend on how many false positives are made, so it cleanly isolates the model's inability to detect positives.

Why this answer

Recall (sensitivity) measures the proportion of actual positive cases correctly identified by the model. With all predictions as negative, recall is 0%, directly revealing the model's failure to detect any positive cases despite the high accuracy.

Exam trap

The trap here is that candidates often choose accuracy as the primary metric, overlooking that high accuracy can mask poor performance on the minority class in imbalanced datasets.

How to eliminate wrong answers

Option A is wrong because precision measures the proportion of predicted positives that are actually positive; since the model predicts no positives, precision is undefined (division by zero) and does not reveal the failure to identify positives. Option C is wrong because the F1 score is the harmonic mean of precision and recall; with recall at 0%, the F1 score is 0, but it does not directly highlight the specific failure to detect positives as clearly as recall alone. Option D is wrong because AUC-ROC evaluates the model's ability to discriminate between classes across all thresholds; a model predicting all negatives can still have an AUC-ROC of 0.5 (random performance), which may not immediately signal the complete absence of positive predictions.

Practice this question →
192
MCQeasy

What is 'Azure Machine Learning designer' and who is it designed for?

A.A tool for designing Azure network infrastructure diagrams
B.A drag-and-drop visual interface for building ML pipelines without writing code
C.A user interface design tool for building AI-powered mobile applications
D.A visualisation tool for exploring and analysing completed model training runs
AnswerB

This is the correct definition. Azure ML Designer provides a drag-and-drop visual canvas within Azure Machine Learning Studio, allowing users to build ML pipelines without writing code. Users connect pre-built modules for data preparation, feature engineering, model training, evaluation, and deployment, creating reproducible workflows that can be published and operationalized. It is specifically designed for ML pipeline authoring, not for other design tasks.

Why this answer

Azure Machine Learning designer is a drag-and-drop visual interface that allows users to build, test, and deploy machine learning pipelines without writing code. It is designed for data scientists and developers who prefer a low-code or no-code approach to creating ML workflows, enabling them to focus on model design rather than programming syntax.

Exam trap

The trap here is that candidates confuse Azure Machine Learning designer with a general-purpose visualization or design tool, rather than recognizing it as a specific no-code ML pipeline builder within the Azure Machine Learning service.

How to eliminate wrong answers

Option A is wrong because Azure Machine Learning designer is not a tool for designing network infrastructure diagrams; that would be Azure Network Watcher or Visio, not an ML service. Option C is wrong because it is not a user interface design tool for building mobile applications; that would be Power Apps or Xamarin, not a machine learning pipeline builder. Option D is wrong because while the designer can visualize completed runs, its primary purpose is to build and configure pipelines interactively, not solely to explore or analyze completed training runs—that is more aligned with Azure Machine Learning studio's 'Experiments' or 'Models' tabs.

Practice this question →
193
MCQmedium

What is reinforcement learning?

A.A type of supervised learning that uses labeled training data
B.Training an agent through rewards and penalties in an interactive environment
C.A clustering technique that groups similar data automatically
D.Using previously trained models on new tasks
AnswerB

This is the correct definition of reinforcement learning. An agent operates in an environment, takes actions, and receives a scalar reward signal—positive for desirable behaviour and negative for undesirable—to learn a policy that maximises cumulative reward over time. This trial-and-error process is formalised as a Markov decision process, and the agent must balance exploration of unknown actions with exploitation of known rewarding ones. Through repeated interactions, the agent learns to associate environmental states with actions that yield the highest long-term return.

Why this answer

Reinforcement learning is a machine learning paradigm where an agent learns to make decisions by interacting with an environment, receiving rewards for desirable actions and penalties for undesirable ones. This trial-and-error process allows the agent to develop an optimal policy over time, distinct from supervised or unsupervised learning. In Azure, this is exemplified by services like Azure Machine Learning's reinforcement learning capabilities or integration with platforms like Ray RLlib.

Exam trap

The trap here is that candidates often confuse reinforcement learning with supervised learning because both involve 'learning from feedback,' but they fail to recognize that reinforcement learning uses delayed rewards and no explicit correct labels, unlike supervised learning's immediate, labeled guidance.

How to eliminate wrong answers

Option A is wrong because reinforcement learning is not a type of supervised learning; supervised learning requires labeled training data with known outputs, whereas reinforcement learning uses feedback from the environment without explicit labels. Option C is wrong because clustering is an unsupervised learning technique that groups similar data points automatically, not an interactive agent-based training process. Option D is wrong because using previously trained models on new tasks describes transfer learning, not reinforcement learning, which involves learning through rewards and penalties in an environment.

Practice this question →
194
MCQmedium

A data scientist is building a machine learning model to predict whether a loan applicant will default. The dataset includes features such as credit score, income, and loan amount, and the target variable is 'default' (yes/no). The data scientist wants to evaluate the model's performance using a metric that balances both false positives and false negatives. Which metric should the data scientist use?

A.Recall
B.F1 score
C.Accuracy
D.Precision
AnswerB

The F1 score is the harmonic mean of precision and recall, providing a balance between false positives and false negatives. In loan default prediction, both types of errors have significant costs, so a metric that considers both is ideal. The F1 score is high only when both precision and recall are high, making it the correct choice for this scenario.

Why this answer

The F1 score combines precision and recall into a single metric, balancing false positives and false negatives. In loan default prediction, both error types are costly, so a balanced metric is needed. Accuracy can be misleading with imbalanced data, while precision and recall each focus on only one type of error.

Therefore, the F1 score is the most appropriate evaluation metric.

Exam trap

The trap here is assuming accuracy is always the best metric, but with imbalanced data, accuracy can be high while the model fails to predict the minority class.

Practice this question →
195
MCQeasy

What is AutoML in Azure Machine Learning and what does it automate?

A.Automatically deploying models to production without human review
B.Automatically selecting algorithms, engineering features, and tuning hyperparameters to find the best model
C.Automatically collecting and labeling training data from the internet
D.Automatically writing Python code for custom ML algorithms
AnswerB

AutoML automates the end-to-end model building pipeline: given a training dataset and a target metric, it selects candidate algorithms, performs feature engineering such as imputation and one-hot encoding, and tunes hyperparameters using techniques like Bayesian optimization. The service runs multiple experiments in parallel and returns the highest-performing model according to the specified validation metric, relieving data scientists from tedious trial-and-error tuning.

Why this answer

AutoML in Azure Machine Learning automates the iterative process of algorithm selection, feature engineering, and hyperparameter tuning to identify the best-performing model for a given dataset. It systematically evaluates multiple machine learning pipelines and returns the model with the highest metric score, reducing manual trial-and-error. This helps data scientists and non-experts build high-quality models efficiently.

Exam trap

The trap here is that candidates confuse automation of model building with automation of the entire ML lifecycle, including deployment or data collection, leading them to select options A or C.

How to eliminate wrong answers

Option A is wrong because AutoML does not automatically deploy models to production; deployment is a separate step that requires explicit configuration and can include human review. Option C is wrong because AutoML does not collect or label data from the internet; it works with data you provide and does not automate data acquisition or labeling. Option D is wrong because AutoML does not write custom Python code for algorithms; it uses built-in algorithms and pipelines, not custom code generation.

Practice this question →
196
MCQeasy

What is the purpose of a test dataset in machine learning model development?

A.To provide additional examples for training the model
B.To provide an unbiased final evaluation of the trained model on unseen data
C.To tune hyperparameters and select the best model version
D.To monitor model performance after deployment
AnswerB

A test dataset is held back from training and hyperparameter tuning, then used once to estimate how the model generalises to unseen data. This satisfies the stem's requirement for an unbiased final evaluation, unlike validation data, which guides model selection and therefore leaks information.

Why this answer

The test dataset is used to provide an unbiased final evaluation of the trained model on unseen data. This is critical in machine learning because the model has never seen the test examples during training or validation, so the evaluation metrics (e.g., accuracy, precision, recall) reflect the model's true generalization ability. In Azure Machine Learning, the test dataset is typically split from the original data before any training begins and is only used once at the end of the model development lifecycle.

Exam trap

The trap here is that candidates often confuse the test dataset with the validation dataset, mistakenly thinking the test set is used for hyperparameter tuning or model selection, when in fact the test set must be reserved for a single, final unbiased evaluation.

How to eliminate wrong answers

Option A is wrong because the test dataset is not used for training; providing additional examples for training is the role of the training dataset, and using test data for training would cause data leakage and overestimate model performance. Option C is wrong because tuning hyperparameters and selecting the best model version is the purpose of a validation dataset (or cross-validation), not the test dataset; using the test set for this would bias the final evaluation. Option D is wrong because monitoring model performance after deployment is done with a separate monitoring pipeline using live inference data or a dedicated production dataset, not the original test dataset which is static and used only for final evaluation.

Practice this question →
197
MCQeasy

A data scientist trains a classification model to distinguish between images of cats and dogs. The model achieves 99% accuracy on the training set but only 75% accuracy on a validation set. Which concept best describes this situation?

A.Underfitting
B.Overfitting
C.Model bias
D.Data leakage
AnswerB

Overfitting is the correct diagnosis. The model achieves high accuracy on its training data because it has effectively memorized the training examples, including their random noise and idiosyncrasies, rather than learning the underlying pattern. When confronted with unseen validation data, that memorized detail does not transfer, so validation performance drops sharply. This high-variance behavior is the signature of too much model capacity relative to the amount of training data.

Why this answer

The model performs exceptionally well on the training data (99% accuracy) but significantly worse on unseen validation data (75% accuracy). This gap indicates the model has memorized noise and specific patterns in the training set rather than learning generalizable features, which is the classic definition of overfitting.

Exam trap

The trap here is that candidates see high accuracy and assume the model is good, failing to recognize that the large gap between training and validation accuracy is the hallmark of overfitting, not underfitting or bias.

Why the other options are wrong

A

Underfitting occurs when a model performs poorly on both training and validation sets, but here the model achieves 99% accuracy on training data, indicating it has learned the training data too well, not too little.

C

Model bias refers to errors due to overly simplistic assumptions, but here the model performs well on training data (99%) and poorly on validation (75%), indicating overfitting, not bias.

D

Data leakage refers to the model using information not available at inference time, which typically leads to overly optimistic performance. In this case, the model performs worse on validation data, not better, so leakage is not indicated.

Practice this question →
198
MCQmedium

What is precision in the context of binary classification model evaluation?

A.The proportion of actual positives that the model correctly identified
B.The proportion of positive predictions that are actually correct
C.The overall proportion of all predictions that are correct
D.The number of decimal places in the model's confidence score
AnswerB

Precision = true positives / (true positives + false positives). It measures how many of the model's positive predictions were actually correct, making it a direct check on false alarms. High precision means that when the model says a result is positive, it is usually right.

Why this answer

Precision measures the accuracy of positive predictions: it is the ratio of true positives to the sum of true positives and false positives. Option B correctly defines this as 'the proportion of positive predictions that are actually correct,' which is the standard definition used in Azure Machine Learning's classification metrics.

Exam trap

The trap here is that candidates often confuse precision with recall (Option A) because both involve true positives, but precision focuses on the correctness of positive predictions while recall focuses on capturing all actual positives.

How to eliminate wrong answers

Option A is wrong because it describes recall (sensitivity), not precision; recall focuses on how many actual positives were caught, not how many predicted positives were correct. Option C is wrong because it describes accuracy, which is the overall proportion of correct predictions (both positives and negatives) out of total predictions, not precision. Option D is wrong because it confuses the mathematical concept of precision in classification with numerical precision (decimal places) in confidence scores, which is unrelated to model evaluation metrics.

Practice this question →
199
MCQmedium

A data scientist is training a model to predict whether a customer will purchase a product (Yes/No). The dataset contains 90% 'No' and 10% 'Yes'. After training, the model achieves 90% accuracy. Which evaluation metric would be more informative to assess the model's performance on the minority class?

A.Mean Absolute Error (MAE)
B.F1 score
C.Area Under the Curve (AUC)
D.R-squared
AnswerB

F1 score is the harmonic mean of precision and recall, giving equal weight to both metrics. It is particularly valuable when the dataset is imbalanced because it directly penalizes false positives and false negatives from the minority-class perspective. Unlike accuracy, F1 does not let a majority-class bias dominate the evaluation, as it only considers the positive class's precision and recall. Therefore, it provides a single, interpretable number that reflects how well the model detects the rare (positive) outcome while maintaining reliability of its positive predictions.

Why this answer

In this imbalanced dataset (90% 'No', 10% 'Yes'), a model that always predicts 'No' would achieve 90% accuracy, making accuracy a misleading metric. The F1 score is the harmonic mean of precision and recall, specifically designed to evaluate a model's performance on the minority class by balancing false positives and false negatives. It is the most informative metric here because it directly measures how well the model identifies the rare 'Yes' purchases without being inflated by the majority class.

Exam trap

The trap here is that candidates see 90% accuracy and assume the model is performing well, failing to recognize that accuracy is misleading in imbalanced datasets, and they may incorrectly select AUC because it is a common classification metric, but it does not directly penalize poor minority-class performance like the F1 score does.

Why the other options are wrong

A

MAE is a regression metric that measures average absolute error between continuous predictions and actual values, not suitable for binary classification tasks like predicting Yes/No.

C

AUC measures the model's ability to distinguish between classes across all thresholds, but it does not specifically focus on the minority class's precision and recall, which are critical for imbalanced datasets.

D

R-squared is a metric for regression models, measuring the proportion of variance explained, but this is a binary classification problem (Yes/No purchase).

Practice this question →
← PreviousPage 3 of 3 · 199 questions total

Ready to test yourself?

Try a timed practice session using only Describe Fundamental Principles Of Machine Learning On Azure questions.

Start 20-question session