AI-900 Practice Question: Describe fundamental principles of machine learning on Azure
What is cross-validation in machine learning?
⚠ Common exam trap
Watch out — candidates often confuse cross-validation with simply training multiple models (Option A), but cross-validation specifically refers to repeatedly training and evaluating the same model type on different data splits to obtain a stable performance estimate, not comparing different model architectures.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Repeatedly training and evaluating the model on different data splits for reliable performance estimates
Cross-validation is a technique for assessing how a machine learning model will generalize to an independent dataset. It involves partitioning the data into complementary subsets, training the model on one subset (the training fold), and validating it on the remaining subset (the validation fold), then repeating this process multiple times with different partitions. The final performance estimate is the average of the validation scores, which provides a more reliable and less biased measure than a single train-test split.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Training multiple different models and comparing their performance
Why it's wrong here
Comparing multiple different models — for example, training a decision tree, logistic regression, and a neural network, and then comparing accuracy — is model selection or benchmarking, not cross-validation itself. Cross-validation is a specific evaluation protocol that repeatedly splits a single dataset to estimate the generalization performance of one model. While cross-validation is often used within a model comparison workflow, the technique itself does not involve training multiple algorithms; it rotates training and validation data for a given model to obtain reliable performance metrics.
- ✓
Repeatedly training and evaluating the model on different data splits for reliable performance estimates
Why this is correct
In k-fold cross-validation, the data is randomly partitioned into k equal-sized folds; the model is trained on k−1 folds and evaluated on the remaining fold, and this process is repeated k times so each example serves as validation data exactly once. The evaluation results from all folds are averaged to produce a more stable and less biased estimate of model performance than a single train/test split. This repeated resampling reduces the variance of the performance estimate and makes better use of limited labeled data.
- ✗
Checking if a model works correctly by running it backward
Why it's wrong here
Running a model backward is not a validation technique; in deep learning the backward pass is backpropagation, which computes gradients for weight updates, not a way to measure predictive quality. Cross-validation is a forward-only resampling procedure: data is split into train and test folds, the model is trained in the normal direction, and the predictions are compared with ground truth on the held-out fold. There is no mechanism by which reverse execution could expose generalization error.
- ✗
Training a model on two different datasets simultaneously
Why it's wrong here
Training concurrently on two different datasets, such as combining a primary dataset with an auxiliary one for multi-task learning, is not cross-validation. Cross-validation requires a single dataset to be partitioned into complementary training and validation folds, with the model repeatedly retrained and evaluated on rotated subsets. Simultaneous training on two datasets simply fits one model on more data; it produces no held-out evaluation and therefore cannot estimate generalization performance.
Go deeper
Related to this question
Learn chapter
Machine Learning Core Concepts
Key term
Machine learning
Machine learning is a branch of artificial intelligence where computers learn patterns from data to make decisions or predictions without being explicitly programmed for every task.
Key term
Model
In IT and AI, a model is a trained mathematical representation that learns patterns from data to make predictions or decisions.
About these practice questions
This AI-900 question is part of Courseiva's 985-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-900 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-900 exam.