AI-900 Describe fundamental principles of machine learning on Azure Practice Test 9 — 15 Questions

Question 1

What is an endpoint in Azure Machine Learning?

Accepted Answer

A deployed ML model accessible via REST API for making predictions. In Azure Machine Learning, an endpoint is a REST API endpoint that exposes a deployed machine learning model for real-time inference. When you deploy a model to an Azure Kubernetes Service (AKS) or Azure Container Instances (ACI) cluster, Azure ML creates a scoring URI that clients can call with HTTP POST requests containing input data, and the endpoint returns predictions. This enables applications to integrate model predictions via standard HTTPS protocol.

Answer

A visual dashboard for monitoring model performance

Answer

The final training step that produces a saved model file

Answer

A data storage location for training datasets

Question 2

What is cross-validation in machine learning?

Accepted Answer

Repeatedly training and evaluating the model on different data splits for reliable performance estimates. Cross-validation is a technique for assessing how a machine learning model will generalize to an independent dataset. It involves partitioning the data into complementary subsets, training the model on one subset (the training fold), and validating it on the remaining subset (the validation fold), then repeating this process multiple times with different partitions. The final performance estimate is the average of the validation scores, which provides a more reliable and less biased measure than a single train-test split.

Answer

Training multiple different models and comparing their performance

Answer

Checking if a model works correctly by running it backward

Answer

Training a model on two different datasets simultaneously

Question 3

What is the Azure Machine Learning model registry?

Accepted Answer

A centralized repository for versioning, tracking, and managing trained ML models. The Azure Machine Learning model registry is a centralized repository within Azure Machine Learning that enables versioning, tracking, and management of trained machine learning models. It allows data scientists and MLOps engineers to register models with metadata, tags, and descriptions, and to manage multiple versions of the same model, facilitating reproducibility, collaboration, and deployment lifecycle management.

Answer

A marketplace for purchasing pre-built AI models

Answer

A compliance database for AI regulatory requirements

Answer

A system for monitoring models in production for data drift

Question 4

What is feature engineering in machine learning?

Accepted Answer

Selecting, transforming, and creating input variables from raw data to improve model performance. Feature engineering is the process of selecting, transforming, and creating input variables (features) from raw data to improve the performance of machine learning models. This step is critical because the quality and relevance of features directly impact a model's ability to learn patterns and generalize to new data. In Azure Machine Learning, feature engineering is often performed using tools like the 'Feature Engineering' step in automated ML or custom Python scripts with libraries such as pandas and scikit-learn.

Answer

Designing the hardware chips for running ML models

Answer

Selecting which neural network layers to include in a model

Answer

Writing code to deploy ML models as REST APIs

Question 5

What is data drift in the context of deployed machine learning models?

Accepted Answer

When production data distribution changes from the training data distribution over time. Data drift refers to the phenomenon where the statistical properties of the input data a deployed model receives in production change over time, diverging from the distribution of the data used during training. This degradation can cause the model's predictions to become less accurate or unreliable, even if the model itself remains unchanged. In Azure Machine Learning, data drift is monitored using dataset monitors that compare production data distributions against the training baseline.

Answer

When training data is accidentally deleted from storage

Answer

When a model's weights change during inference

Answer

When data is moved between different Azure storage accounts

Question 6

What is precision in the context of binary classification model evaluation?

Accepted Answer

The proportion of positive predictions that are actually correct. Precision measures the accuracy of positive predictions: it is the ratio of true positives to the sum of true positives and false positives. Option B correctly defines this as 'the proportion of positive predictions that are actually correct,' which is the standard definition used in Azure Machine Learning's classification metrics.

Answer

The proportion of actual positives that the model correctly identified

Answer

The overall proportion of all predictions that are correct

Answer

The number of decimal places in the model's confidence score

Question 7

What is recall (sensitivity) in the context of binary classification model evaluation?

Accepted Answer

The proportion of actual positives that the model correctly identified. Recall (sensitivity) measures the proportion of actual positive cases that the model correctly identifies. In binary classification, it answers: 'Of all the truly positive instances, how many did the model catch?' This is critical in scenarios where missing a positive (false negative) is costly, such as disease screening or fraud detection.

Answer

The proportion of positive predictions that are actually correct

Answer

The overall proportion of predictions that match the actual labels

Answer

How quickly the model can be updated with new training data

Question 8

What is the role of a label (also called target or ground truth) in supervised machine learning?

Accepted Answer

The correct output or answer associated with each training example that the model learns to predict. In supervised machine learning, the label (also called target or ground truth) is the known correct output for each training example. The model uses these labels during training to learn the mapping from input features to outputs, enabling it to make accurate predictions on new, unseen data. This is fundamental to supervised learning, where the algorithm minimizes the error between its predictions and the ground truth labels.

Answer

A category of input features used by the model

Answer

A text description attached to a model explaining what it does

Answer

A tag applied to Azure ML resources for organization

Question 9

What is the F1 score in machine learning evaluation?

Accepted Answer

The harmonic mean of precision and recall that balances both metrics. The F1 score is defined as the harmonic mean of precision and recall, calculated as 2 * (precision * recall) / (precision + recall). This metric provides a single score that balances both false positives and false negatives, making it especially useful when classes are imbalanced. In Azure Machine Learning, the F1 score is a standard evaluation metric for classification models, reported in automated ML runs and designer modules.

Answer

The first evaluation metric calculated before training a model

Answer

The proportion of predictions correct on the test set

Answer

A measure of how fast the model produces predictions

Question 10

What is an ML pipeline in Azure Machine Learning?

Accepted Answer

A workflow of connected steps for automating the end-to-end ML process. An ML pipeline in Azure Machine Learning is a workflow of connected steps that automates the end-to-end machine learning process, including data preparation, training, evaluation, and deployment. This enables reproducibility, reusability, and orchestration of complex ML tasks without manual intervention.

Answer

The networking infrastructure connecting Azure ML compute nodes

Answer

A data streaming service for real-time model predictions

Answer

A GitHub repository for storing ML model code

Question 11

What is a training job in Azure Machine Learning?

Accepted Answer

A single execution of a training script that produces a trained model and tracked metrics. A training job in Azure Machine Learning is a single execution of a training script that runs on a specified compute target, producing a trained model and logging metrics, parameters, and artifacts. This is the fundamental unit of model training in Azure ML, distinct from batch inference or data preprocessing.

Answer

A batch prediction job that scores new data against a deployed model

Answer

A scheduled report on model performance in production

Answer

A data preprocessing pipeline that cleans raw datasets

Question 12

What is the purpose of a test dataset in machine learning model development?

Accepted Answer

To provide an unbiased final evaluation of the trained model on unseen data. The test dataset is used to provide an unbiased final evaluation of the trained model on unseen data. This is critical in machine learning because the model has never seen the test examples during training or validation, so the evaluation metrics (e.g., accuracy, precision, recall) reflect the model's true generalization ability. In Azure Machine Learning, the test dataset is typically split from the original data before any training begins and is only used once at the end of the model development lifecycle.

Answer

To provide additional examples for training the model

Answer

To tune hyperparameters and select the best model version

Answer

To monitor model performance after deployment

Question 13

What is the role of a validation dataset in machine learning?

Accepted Answer

To tune hyperparameters and monitor performance during training without using test data. The validation dataset is used during model training to tune hyperparameters and monitor performance on unseen data, preventing overfitting without contaminating the test set. This allows iterative adjustments to model architecture or learning rate while keeping the test data reserved for final evaluation.

Answer

To provide the primary examples for training the model's weights

Answer

To provide the final, unbiased assessment of model performance

Answer

To store the model's trained weights for later use

Question 14

What is hyperparameter tuning in machine learning?

Accepted Answer

Searching for the best training configuration settings (learning rate, layers, etc.) to optimize model performance. Hyperparameter tuning is the process of systematically searching for the best combination of hyperparameters—such as learning rate, number of layers, batch size, or regularization strength—that control the training process itself, rather than being learned from data. In Azure Machine Learning, this is often automated using tools like HyperDrive, which runs multiple child runs with different hyperparameter configurations to find the set that maximizes model performance on a validation set.

Answer

Adjusting the training data labels to improve model accuracy

Answer

Reducing the number of features used by the model

Answer

Updating model weights based on new production data

Question 15

What does Azure Machine Learning's 'compute cluster' provide?

Accepted Answer

Scalable, auto-scaling cloud compute for running ML training jobs that scales to zero when idle. Azure Machine Learning's compute cluster provides a scalable, auto-scaling cloud compute environment specifically designed for running ML training jobs. It automatically scales up to handle large workloads and scales down to zero nodes when idle, optimizing cost and resource utilization.

Answer

A Kubernetes cluster for deploying trained models as REST APIs

Answer

A data storage cluster for distributing training datasets across nodes

Answer

A network of IoT sensors for collecting training data