AI-900 Describe fundamental principles of machine learning on Azure Practice Test 12 — 15 Questions

Question 1

What is 'confusion matrix' and what does it tell you about a classification model?

Accepted Answer

A table showing counts of correct and incorrect predictions broken down by predicted vs. actual class. A confusion matrix is a specific table layout that allows visualization of the performance of a classification model. It shows the counts of true positive, true negative, false positive, and false negative predictions, broken down by each actual class versus each predicted class. This directly tells you not just overall accuracy, but also the types of errors the model is making, which is critical for evaluating classifiers in Azure Machine Learning.

Answer

A measure of how confused users are when interacting with an AI system's predictions

Answer

A graphical display of how confident the model is across its entire test dataset

Answer

A diagram comparing the accuracy of multiple models on the same test set

Question 2

What is 'Azure Machine Learning pipelines' and why are they used?

Accepted Answer

Reusable orchestrated workflows that automate and version-control the full ML training lifecycle. Azure Machine Learning pipelines are reusable orchestrated workflows that automate and version-control the full ML training lifecycle, including data preparation, training, evaluation, and deployment. They enable reproducibility, parallel execution of steps, and easy sharing across teams, which is why option B is correct.

Answer

Network pipelines for transferring data between Azure regions at high speed

Answer

CI/CD pipelines in Azure DevOps for deploying application code to production

Answer

Data pipelines that ingest streaming data from IoT sensors into Azure storage

Question 3

What is 'Azure Machine Learning workspace' and what does it contain?

Accepted Answer

The top-level Azure resource that organises all ML artefacts including models, experiments, and compute for a project. An Azure Machine Learning workspace is the top-level Azure resource that serves as a centralized hub for all machine learning activities. It contains essential artifacts such as datasets, experiments, models, pipelines, compute targets (e.g., compute clusters, inference clusters), and endpoints, enabling end-to-end ML lifecycle management within a single project.

Answer

A physical office space at Microsoft where ML engineers develop Azure AI services

Answer

A virtual desktop environment pre-configured with ML tools for data scientists

Answer

A shared document repository for storing ML project documentation and reports

Question 4

What is 'neural architecture search' (NAS) and how does it relate to AutoML?

Accepted Answer

Automating the discovery of optimal neural network architectures using computational search. Neural Architecture Search (NAS) is an automated process that uses computational search methods—such as reinforcement learning, evolutionary algorithms, or gradient-based optimization—to discover optimal neural network architectures for a given task. It is a key component of AutoML because AutoML aims to automate the entire machine learning pipeline, including model selection and hyperparameter tuning, and NAS specifically automates the design of the neural network topology itself.

Answer

Searching the web for neural network architectures published in research papers

Answer

Querying a database of pre-built neural networks to find the closest match for a task

Answer

A legal search process for patenting new AI model architectures

Question 5

What is 'model explainability' using SHAP values in Azure Machine Learning?

Accepted Answer

Calculating each feature's contribution to a specific prediction to explain why the model made that decision. SHAP (SHapley Additive exPlanations) values are a game-theoretic approach that assigns each feature an importance value for a particular prediction. Option B is correct because SHAP values quantify the contribution of each input feature to the model's output, providing a local explanation for why a specific decision was made. This is distinct from global feature importance or model simplification.

Answer

Explaining the model's predictions using a simplified version of the model that is easier to interpret

Answer

Displaying the model's source code so users can verify what computations are performed

Answer

Testing the model on a separate evaluation dataset to report overall accuracy

Question 6

What is 'semi-supervised learning' and when is it useful?

Accepted Answer

Using small amounts of labelled data alongside large amounts of unlabelled data to train a model. Semi-supervised learning combines a small set of labeled data with a large set of unlabeled data to train a model. This approach is useful when labeling data is expensive or time-consuming, but large volumes of unlabeled data are readily available. The model first learns patterns from the labeled subset, then propagates those labels to the unlabeled data, iteratively improving its accuracy.

Answer

Training a model that is partially supervised by one human and partially by another

Answer

A model that receives feedback from users during deployment to improve over time

Answer

Training that automatically stops halfway through and resumes the next day

Question 7

What is 'Azure Machine Learning notebooks' and who typically uses them?

Accepted Answer

Interactive Jupyter notebook environments for data exploration and model prototyping by data scientists. Azure Machine Learning notebooks are interactive Jupyter notebook environments hosted within Azure Machine Learning studio. They allow data scientists to write and execute Python code for data exploration, visualization, and model prototyping directly in the cloud, with built-in access to compute instances and datasets. Option B correctly identifies both the technology (Jupyter notebooks) and the primary user role (data scientists).

Answer

Digital note-taking applications for recording meeting minutes during ML project planning

Answer

Automated logging notebooks that record all model training metrics without code

Answer

Read-only document viewers for reviewing completed ML experiment results

Question 8

What is 'model monitoring' in Azure Machine Learning after deployment?

Accepted Answer

Tracking deployed model performance and data drift over time to detect degradation. Model monitoring in Azure Machine Learning refers to the ongoing process of tracking a deployed model's performance metrics (such as accuracy or precision) and detecting data drift (changes in input data distribution) or concept drift (changes in the relationship between inputs and outputs) over time. This is critical because models can degrade in production even if they performed well during training, due to shifts in real-world data. Azure ML provides built-in monitoring capabilities, including drift detection and alerting, to ensure models remain reliable.

Answer

Watching the training loss curve during model training to detect overfitting

Answer

A dashboard showing the compute costs of running model inference in production

Answer

Monitoring the uptime and latency of the model serving endpoint

Question 9

What is 'curriculum learning' and how does it relate to training stability?

Accepted Answer

Training models on progressively harder examples to improve stability and convergence. Curriculum learning is a training strategy where a model is first exposed to simpler examples and then gradually introduced to more complex ones. This approach improves training stability by preventing the model from being overwhelmed by difficult patterns early on, which can cause large gradient updates and divergence. By structuring the learning process, the model converges more reliably and often achieves better generalization.

Answer

Designing a course curriculum using AI to personalise learning for students

Answer

A structured plan for the sequence of ML courses a data scientist should take

Answer

Using a pre-defined curriculum of hyperparameter values to systematically explore the search space

Question 10

What is 'training data' vs 'test data' in machine learning?

Accepted Answer

Training data fits the model; test data provides an unbiased estimate of real-world performance. Training data is used to fit the model's parameters (e.g., weights in a neural network or split criteria in a decision tree), while test data is held back and used only after training to evaluate the model's performance on unseen data. This separation provides an unbiased estimate of how the model will generalize to real-world data, which is critical for avoiding overfitting. In Azure Machine Learning, this split is typically managed via the `train_test_split` function or automated in AutoML pipelines.

Answer

Training data is collected first; test data is older data from an archive

Answer

Training data is labelled by humans; test data is labelled automatically by the model

Answer

Test data is always larger than training data to ensure reliable evaluation

Question 11

What is 'feature importance' in Azure Machine Learning and how is it used?

Accepted Answer

Quantifying how much each input variable contributes to a model's predictions. Feature importance is a technique in Azure Machine Learning that quantifies the contribution of each input variable (feature) to a model's predictions. It is used to interpret model behavior, identify the most influential features, and validate that the model aligns with domain knowledge. This is critical for debugging, improving model performance, and ensuring regulatory compliance.

Answer

Ranking which ML project features (notebooks, experiments, pipelines) are most used by the team

Answer

Determining which model features (capabilities) are included in each Azure ML pricing tier

Answer

The priority order in which data preprocessing steps are applied before training

Question 12

What is 'Azure Machine Learning datasets' and why are they important?

Accepted Answer

Versioned, registered data references enabling reproducibility, sharing, and lineage tracking in Azure ML. Azure Machine Learning datasets are versioned, registered data references that encapsulate metadata such as location, schema, and creation time, enabling reproducibility, sharing, and lineage tracking across experiments. They do not store the raw data files themselves but provide a pointer to the data source (e.g., Azure Blob Storage, Azure Data Lake), ensuring that every training run uses the exact same data snapshot, which is critical for auditability and collaboration.

Answer

The raw data files stored in Azure Blob Storage before any processing

Answer

Synthetic datasets automatically generated by Azure ML to supplement small training sets

Answer

Pre-labelled benchmark datasets provided by Microsoft for testing Azure ML models

Question 13

What is 'active learning' in Azure Machine Learning data labelling?

Accepted Answer

Strategically selecting the most informative examples for human labelling to maximise learning efficiency. Active learning in Azure Machine Learning data labelling is a technique where the model identifies the data points it is most uncertain about and prioritizes those for human review. This strategic selection maximizes the learning efficiency of the model by ensuring that each labelled example provides the highest possible information gain, reducing the total number of labels needed.

Answer

Having users actively participate in model training by rating AI responses

Answer

A training approach where the model actively searches the internet for additional training data

Answer

Continuous model training that runs actively in the background as new data arrives

Question 14

What is 'data preprocessing' and why is it important for machine learning?

Accepted Answer

Transforming raw data (handling nulls, scaling, encoding) to make it suitable for ML training. Data preprocessing is the transformation of raw data into a clean, structured format that machine learning algorithms can effectively learn from. Option B correctly identifies this as handling nulls, scaling numerical features, and encoding categorical variables, which are essential because ML models require numeric input and are sensitive to missing values and feature magnitudes.

Answer

Encrypting sensitive data before storing it in Azure for security compliance

Answer

The process of splitting raw data into training and test sets

Answer

Compressing data files to reduce the cost of Azure Blob Storage

Question 15

What is 'Azure Machine Learning's Responsible AI dashboard' and what does it include?

Accepted Answer

A unified tool for error analysis, interpretability, fairness, data exploration, and causal inference. The Responsible AI dashboard in Azure Machine Learning is a unified, integrated tool that combines multiple components for building and evaluating AI systems responsibly. It includes error analysis, model interpretability, fairness assessment, data exploration, and causal inference capabilities, all accessible through a single interface. This dashboard helps data scientists and developers understand model behavior, identify potential biases, and make informed decisions throughout the ML lifecycle.

Answer

A compliance checklist confirming a model meets Microsoft's responsible AI certification requirements

Answer

A monitoring dashboard showing responsible AI policy violations in production

Answer

A report auto-generated and submitted to regulators when a model is deployed