Question 568 of 1,020

Quick Answer

The answer is Azure Machine Learning compute, which is a managed cloud infrastructure providing on-demand virtual machines and clusters for running ML training and inference workloads. This is correct because it abstracts away the underlying hardware management, allowing you to dynamically scale compute resources up or down based on job requirements, and supports both CPU and GPU instances for different model types. On the AI-900 exam, this concept tests your understanding of how Azure handles compute for machine learning without requiring you to manage physical servers—a common trap is confusing Azure Machine Learning compute with other Azure compute services like Azure Databricks or Azure Kubernetes Service, which serve different orchestration purposes. Remember, if the question asks about a fully managed, scalable environment specifically for ML jobs that you can spin up and tear down on demand, the answer is always Azure Machine Learning compute. Memory tip: think “ML compute = managed VMs for ML jobs only.”

AI-900 Practice Question: Describe fundamental principles of machine learning on Azure

This AI-900 practice question tests your understanding of describe fundamental principles of machine learning on azure. Match the stated requirement to the specific cloud service, access model, or configuration option — many options are valid in isolation but not for this scenario. After answering, compare your reasoning against the explanation and wrong-answer breakdown below. Once you have made your selection, read the full explanation to reinforce the concept and understand why each distractor is designed to mislead on exam day.

What is 'Azure Machine Learning compute' and what types are available?

Question 1easymultiple choice
Full question →

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

The managed cloud infrastructure (VMs, clusters) used to run ML training and inference workloads

Azure Machine Learning compute is a managed cloud infrastructure that provides on-demand virtual machines (VMs) and clusters for running machine learning training and inference workloads. It abstracts away the underlying hardware management, allowing you to dynamically scale compute resources up or down based on job requirements, and supports both CPU and GPU instances for different model types.

Key principle: Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

  • The mathematical computations performed by the model during training

    Why it's wrong here

    Training computations are model operations — Azure ML compute refers to the cloud infrastructure running those operations.

  • The managed cloud infrastructure (VMs, clusters) used to run ML training and inference workloads

    Why this is correct

    Azure ML compute provides managed infrastructure — compute instances for dev, clusters for training, inference clusters for serving.

    Related concept

    Read the scenario before looking for a memorised answer.

  • The number of floating-point operations a model performs per second

    Why it's wrong here

    FLOPS is a model performance metric — Azure ML compute is the infrastructure service, not a performance measurement.

  • A billing calculator that estimates the cost of running machine learning workloads

    Why it's wrong here

    Cost estimation is Azure Pricing Calculator — Azure ML compute is the actual infrastructure service for running ML workloads.

Common exam traps

Common exam trap: answer the scenario, not the keyword

The trap here is confusing the abstract concept of 'compute' (the infrastructure) with the mathematical computations or performance metrics, leading candidates to pick A or C instead of recognizing it as a managed cloud resource.

Detailed technical explanation

How to think about this question

Under the hood, Azure Machine Learning compute provisions compute targets as either single-node VMs or multi-node clusters using Azure Virtual Machine Scale Sets, with support for low-priority VMs to reduce costs. It integrates with Azure Container Registry to pull custom Docker images for reproducible environments, and automatically handles job scheduling, data staging, and cleanup. In a real-world scenario, you might use a GPU-based compute cluster (e.g., NC-series VMs) for training a deep learning model, then switch to a CPU-based inference cluster for serving predictions at scale.

KKey Concepts to Remember

  • Read the scenario before looking for a memorised answer.
  • Find the constraint that changes the correct option.
  • Eliminate answers that are true in general but not in this case.

TExam Day Tips

  • Watch for words such as best, first, most likely and least administrative effort.
  • Review why wrong options are wrong, not only why the correct option is correct.

Key takeaway

Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.

Real-world example

How this comes up in practice

A startup's cloud architect reviews their monthly bill and notices costs are higher than expected for a long-running batch job. Switching from on-demand instances to Reserved Instances — or using Spot/Preemptible VMs — can reduce compute costs by up to 72 %. Questions like this test whether you understand the tradeoffs between commitment, flexibility, and cost across cloud pricing models.

What to study next

Got this wrong? Here's your next step.

Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.

Related practice questions

Related AI-900 practice-question pages

Use these pages to review the topic behind this question. This is how one missed question becomes focused revision.

Practice this exam

Start a free AI-900 practice session

Short sessions build daily habit. Longer sessions build exam-day stamina. Try a timed session to simulate real conditions.

FAQ

Questions learners often ask

What does this AI-900 question test?

Describe fundamental principles of machine learning on Azure — This question tests Describe fundamental principles of machine learning on Azure — Read the scenario before looking for a memorised answer..

What is the correct answer to this question?

The correct answer is: The managed cloud infrastructure (VMs, clusters) used to run ML training and inference workloads — Azure Machine Learning compute is a managed cloud infrastructure that provides on-demand virtual machines (VMs) and clusters for running machine learning training and inference workloads. It abstracts away the underlying hardware management, allowing you to dynamically scale compute resources up or down based on job requirements, and supports both CPU and GPU instances for different model types.

What should I do if I get this AI-900 question wrong?

Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.

What is the key concept behind this question?

Read the scenario before looking for a memorised answer.

About these practice questions

Courseiva creates original exam-style practice questions with explanations and wrong-answer analysis. It does not publish real exam questions, exam dumps, or protected exam content. Learn why practice questions differ from exam dumps →

How Courseiva writes practice questions · Editorial policy

Same concept, more angles

2 more ways this is tested on AI-900

These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.

Variation 1. What does Azure Machine Learning's 'compute cluster' provide?

easy
  • A.A Kubernetes cluster for deploying trained models as REST APIs
  • B.Scalable, auto-scaling cloud compute for running ML training jobs that scales to zero when idle
  • C.A data storage cluster for distributing training datasets across nodes
  • D.A network of IoT sensors for collecting training data

Why B: Azure Machine Learning's compute cluster provides a scalable, auto-scaling cloud compute environment specifically designed for running ML training jobs. It automatically scales up to handle large workloads and scales down to zero nodes when idle, optimizing cost and resource utilization.

Variation 2. What is a 'compute instance' in Azure Machine Learning?

medium
  • A.A scalable cluster for running distributed training jobs across many nodes
  • B.A managed cloud workstation for interactive ML development with pre-installed tools
  • C.A virtual machine that automatically scales to run batch predictions
  • D.A serverless execution environment for ML inference requests

Why B: Option B is correct because a compute instance in Azure Machine Learning is a fully managed cloud workstation that provides a pre-configured environment with popular ML tools like Jupyter Notebooks, TensorFlow, and PyTorch. It is designed for interactive development, allowing data scientists to train and experiment with models without managing infrastructure.

Last reviewed: Jun 11, 2026

Question Discussion

Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.

Loading comments…

Sign in to join the discussion.

This AI-900 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-900 exam.