Courseiva

AI-200 · domain

Containerized AI Workloads

This domain covers packaging and running AI models in containers on Azure. You must know how Azure Container Registry handles image scanning and vulnerability detection, how Azure Container Apps configures ingress and HTTPS, and how AKS controls pod resources, scheduling, and availability through Kubernetes manifests and node topology.

105 questions30 easy41 medium34 hard

Focused practice

Practice Containerized AI Workloads questions

Scored sessions drawing only from this domain — pick a length below.

Start 20-question practice test →

What this domain covers

What to know about Containerized AI Workloads

Be able to configure ACR scanning, Container Apps external ingress, and AKS resource and scheduling settings from manifests. The most important thing is choosing the correct Kubernetes field or Azure setting for the stated availability, security, or resource goal.

Enabling Microsoft Defender for Containers or ACR image scanning to detect vulnerabilities on push

Configuring Azure Container Apps ingress with external access and HTTPS/TLS termination settings

Setting Kubernetes CPU requests and limits in a pod or container resource specification

Using pod anti-affinity or topology spread constraints to distribute pods across availability zones

Watch out for

Common Containerized AI Workloads exam traps

  • ▸Confusing image scanning with runtime threat protection; scanning happens at push or pull, not continuously inside a running container.
  • ▸Setting only CPU limits without requests, which can cause scheduling failures or unexpected throttling under load.
  • ▸Using pod affinity instead of anti-affinity, which co-locates pods and defeats the goal of spreading across fault domains.

Question index

All Containerized AI Workloads questions (105)

Click any question to see the full explanation, or start a practice session above.

1

You need to store custom AI container images in a private registry hosted within Azure. Which Azure service provides a managed Docker registry service?

Easy
2

You are deploying an AI workload to AKS and want to ensure that pods belonging to your application are distributed across different fault domains (availability zones) for high availability. Which Kubernetes feature should you configure?

Medium
3

You are troubleshooting slow inference latency in an AI application deployed on AKS. You suspect that network packets between inference pods are traversing unnecessary hops due to overlay routing. Which CNI mode should you have chosen for optimal direct routing?

Hard
4

You have an AI workload that requires persistent storage for large model checkpoints. Which storage type should you mount to an AKS pod for optimal performance?

Medium
5

You are configuring continuous deployment for an AI model container. Whenever a data scientist pushes code to a GitHub repository, you want Azure Container Registry to automatically build and tag the new container image without managing an external CI/CD build agent. What should you use?

Medium
6

Which Azure feature allows you to set up a private, internal-only container registry?

Easy
7

You are troubleshooting intermittent network timeout errors between microservices in an AKS cluster running an AI pipeline. You suspect that network policies are blocking required inter-pod communication. Which CNI plugin must be configured in AKS to enforce these network policies?

Hard
8

You are troubleshooting an AI inference container deployed in Azure Container Apps that is failing health probes. Which TWO diagnostic tools or logs can you examine in the Azure portal to investigate the failure?

Medium
9

Your enterprise requires that all container images deployed to Azure Kubernetes Service (AKS) must originate from approved corporate Azure Container Registries (ACRs). How can you enforce this restriction cluster-wide?

Easy
10

You are using Azure Container Apps. You need to deploy a new version of your AI model without downtime. Which deployment strategy should you configure?

Easy
11

You have an Azure Container Registry and an Azure Kubernetes Service cluster in different Azure regions. You want to ensure that AKS nodes pull container images from a local regional endpoint to minimize latency and cross-region data transfer fees. What feature should you configure on ACR?

Medium
12

You need to configure network security for an Azure Container Apps environment that hosts an internal AI scoring API. The API must only be reachable from a specific Azure Virtual Network (VNet) and blocked from public internet access. How should you configure the environment?

Hard
13

You need to deploy a containerized AI model to Azure Container Apps and configure it to scale based on Azure Service Bus queue messages. Which scaler should you specify?

Easy
14

You are managing an Azure Kubernetes Service (AKS) cluster that runs high-throughput AI model training jobs using NVIDIA Tensor Core GPUs. Pods frequently fail to schedule because of insufficient GPU memory across existing nodes. You need to ensure the cluster automatically provisions new GPU-enabled worker nodes when resource demands increase. What should you configure?

Medium
15

You are troubleshooting an AI application container in an AKS cluster that cannot resolve external domain names (e.g., huggingface.co). Which TWO Kubernetes components should you investigate?

Medium
16

You are deploying a containerized AI application to Azure Container Instances (ACI). The application needs to pull the container image from a private Azure Container Registry (ACR). You want to authenticate ACI to ACR without embedding credentials in the deployment configuration. What should you do?

Medium
17

You are managing an AKS cluster running resource-intensive AI training jobs. You want to ensure that nodes automatically scale up and down based on pending pod resource requests. Which component should you enable and configure?

Medium
18

Your development team is planning to deploy a containerized natural language processing model to Azure Container Apps. Which TWO features are natively supported by Azure Container Apps for managing application lifecycle and traffic? (Choose two.)

Medium
19

You are setting up image builds for a multi-architecture (AMD64 and ARM64) AI model container using Azure Container Registry Tasks. Which command or feature should you use to build images for both architectures simultaneously?

Hard
20

You are deploying a containerized AI model to Azure Container Apps. The model requires a GPU for inference. You configure the container app to use a workload profile with GPU support. However, when the app starts, it fails with an error indicating that the GPU is not available. You need to ensure the container can access the GPU. What should you do?

Medium
21

Which TWO of the following steps are required to enable GPU support for a pod in AKS?

Medium
22

You have a large image that takes a long time to pull. You want to speed up deployment in AKS. Which feature should you enable?

Medium
23

Which THREE of the following are security best practices for container registries?

Medium
24

You are deploying a containerized machine learning inference service to Azure Container Apps. The model artifact is large (15 GB) and must be securely loaded during container startup. What is the most efficient way to mount this model data into the container app?

Medium
25

You are configuring an Azure Kubernetes Service (AKS) cluster for enterprise AI workloads. Which THREE practices should you implement to enhance cluster security and isolation? (Choose three.)

Hard
26

You need to store private AI model weights in an Azure Container Registry (ACR). Which authentication method follows the principle of least privilege for an AKS cluster to pull these images?

Easy
27

You are building an AI container image and need to minimize its final size to speed up deployment times. Which multi-stage build practice should you follow?

Easy
28

You are configuring rolling updates for an AI model inference service on AKS with zero downtime requirements. Which THREE deployment or pod configuration settings should you configure?

Hard
29

Which THREE of the following options are important when configuring an AKS cluster for AI workloads?

Hard
30

You are building a container image for an AI application that will be deployed to Azure Container Instances (ACI). The image will be stored in Azure Container Registry (ACR). You need to ensure that the image can be pulled by ACI securely without embedding registry credentials in the image or in scripts. Which TWO of the following approaches can be used to authenticate ACI to ACR? (Choose two.)

Medium
31

Which THREE of the following are components of a standard Dockerfile for an AI application?

Easy
32

You are running a GPU-intensive AI workload in AKS. You want to ensure the pods are scheduled only on nodes that have GPUs. How do you enforce this?

Hard
33

You are configuring enterprise networking for an AKS cluster running sensitive AI models. Which THREE networking features should you implement for cluster security?

Hard
34

Your containerized AI application requires a specific version of a kernel driver that is not installed on the AKS nodes. What is the most efficient way to manage this?

Hard
35

Which TWO of the following are valid autoscaling options for AKS?

Medium
36

You need to deploy a real-time object detection model inside an Azure Container App. The application requires immediate scale-out when the queue length of incoming image processing requests exceeds a threshold. Which scaling rule type should you configure?

Medium
37

You are troubleshooting a containerized AI model running in an Azure Container App that crashes immediately upon startup with an exit code indicating an Out Of Memory (OOM) error. You need to inspect the container resource allocations. Where can you adjust the memory allocation for the container?

Medium
38

You are configuring continuous deployment for an AI model container using Azure DevOps and Azure Container Registry (ACR). You need to ensure that when a new container image is pushed to ACR, an event triggers an automated webhook that notifies an Azure Function to run post-deployment validation tests. Which event type should you subscribe to in the ACR webhook configuration?

Medium
39

Which THREE of the following are common reasons for a container image pull failure in AKS?

Easy
40

You are containerizing a large language model (LLM) inference API to run in Azure Container Apps. The model weights exceed 15 GB and cause container startup timeouts because the image takes too long to pull from Azure Container Registry (ACR). You need to optimize the container startup performance without reducing the model size. What is the best approach?

Hard
41

Your development team wants to push custom Docker images containing fine-tuned open-source LLMs to a secure, private registry hosted on Azure. Which Azure service should you use to store and manage these container images?

Easy
42

You need to deploy a microservice application that consists of an API gateway and an AI model inference container. The solution must scale automatically based on HTTP traffic and support zero scaling when idle to reduce costs, without requiring complex Kubernetes cluster management. Which service is best suited for this?

Easy
43

Which THREE of the following items should be configured to ensure your AI workload in AKS is observable?

Hard
44

You are configuring authentication between an Azure Container App running an AI model and an Azure OpenAI resource. To adhere to security best practices, you must avoid storing API keys in environment variables or code. How should you configure this?

Hard
45

You need to deploy a quick, stateless AI data processing script packaged in a container image without setting up Kubernetes or Container Apps. Which Azure service offers the fastest deployment for a single container instance?

Easy
46

Which TWO actions can you perform using Azure Container Registry Tasks (ACR Tasks)?

Easy
47

An AKS cluster is configured with KEDA for autoscaling an AI inferencing service based on Azure Queue Storage length. The pods fail to scale. Which component should you inspect first?

Hard
48

You are deploying a custom AI model container to Azure Container Apps. The container listens on port 8080 and requires health probes to verify readiness before routing traffic. How should you configure the probes?

Hard
49

You want to view real-time standard output logs from a container running in Azure Container Instances named 'ai-inferencing-aci'. Which Azure CLI command should you run?

Easy
50

You deploy an AI inferencing service to an Azure Kubernetes Service (AKS) cluster. The service uses an ONNX Runtime container. Users report intermittent 504 Gateway Timeouts during peak batch request loads. You notice that the application pods are being terminated due to Out-Of-Memory (OOM) errors during heavy inference loads. How should you resolve this issue in your Kubernetes deployment manifest?

Hard
51

You need to view the logs of a container that recently crashed in an AKS cluster. Which command is used?

Easy
52

You are deploying a model that requires a specific version of a non-standard OS library. You want to ensure the build environment is consistent across your team. What should you use?

Hard
53

You are deploying a web application container to Azure Container Apps and want to enable external HTTPS traffic. Which ingress setting must you configure?

Easy
54

You want to ensure your AI inference service is highly available across multiple regions. What is the recommended approach for container distribution?

Medium
55

Which TWO of the following are true about Azure Container Apps?

Easy
56

When configuring an Azure Container Instances container group, which TWO properties can you define?

Easy
57

You are configuring GPU time-slicing on an AKS cluster to maximize GPU utilization for multiple lightweight AI inference containers sharing a single NVIDIA A100 GPU. Where must you define the time-slicing configuration profile?

Hard
58

You are configuring network policies in an AKS cluster to isolate your AI inference pods from other namespaces. You notice that traffic is still flowing between namespaces despite applying a NetworkPolicy. What is the most likely cause?

Hard
59

Which type of registry is most suitable for storing images that are shared across an entire organization?

Easy
60

Your team is evaluating Azure Container Apps versus Azure Kubernetes Service (AKS) for hosting containerized AI workloads. Which TWO characteristics are advantages of Azure Container Apps over standard AKS? (Choose two.)

Easy
61

You are designing an MLOps pipeline on Azure Kubernetes Service (AKS) for a computer vision model. You need to configure GPU sharing among multiple inference pods on the same node to optimize cost. Which TWO actions should you take? Each correct answer presents part of the solution.

Medium
62

When managing Azure Container Registry (ACR), administrators can use ACR Tasks to automate tasks. Which TWO scenarios are valid use cases for ACR Tasks? (Choose two.)

Medium
63

You need to inspect the environment variables and configuration settings of a running container group in Azure Container Instances. Which Azure CLI command should you use?

Easy
64

You are configuring secure image signing and verification for your AI containers using Azure Container Registry and Notation. Which feature enables cryptographically signed container images?

Hard
65

You are deploying a containerized AI web API to Azure Container Apps. The API must be accessible from the public internet over HTTPS. You have already created the container app and deployed the image. Which of the following should you configure to enable external ingress with automatic HTTPS?

Easy
66

You are managing multiple containerized AI models in AKS. You want to implement a service mesh to handle traffic splitting and mTLS. Which tool should you integrate?

Medium
67

Your containerized AI application needs to access sensitive API keys. What is the most secure way to provide these to your application in Azure Container Apps?

Medium
68

You are running an AI inference workload in an Azure Kubernetes Service (AKS) cluster. The pods require access to an Azure Machine Learning workspace data store via managed identity without storing credentials in code. Which Kubernetes feature should you configure?

Medium
69

You are optimizing an AI model container image size. Which technique is most effective for reducing the footprint of an image based on a large Python deep learning framework?

Medium
70

You are troubleshooting an AI inference container in Azure Container Apps that fails to start because it cannot pull the base image from Azure Container Registry. Authentication fails with an unauthorized error. What is the recommended way to grant the Container App access to ACR?

Medium
71

You are deploying a distributed PyTorch training job across multiple nodes in an Azure Kubernetes Service (AKS) cluster. Which mechanism should you use to facilitate high-speed, low-latency inter-node communication required for gradient synchronization?

Medium
72

Your data science team pushes container images to Azure Container Registry (ACR). You need to ensure that every image pushed is automatically scanned for known vulnerabilities before being deployed to production. Which ACR feature should you enable?

Easy
73

Which THREE of the following are benefits of using ACR Tasks for containerized AI workloads?

Hard
74

You are optimizing a large language model container inference deployment on AKS using GPU-enabled nodes (NC-series). The inference server experiences frequent out-of-memory errors on the GPU device itself during high context lengths. Which Kubernetes configuration metric should you monitor and alert on?

Hard
75

You need to store sensitive database connection strings and AI API keys used by containerized applications running in Azure Container Apps. Which feature should you use to securely store and reference these values?

Easy
76

Which command-line interface tool is used to deploy and manage container images directly to Azure Container Registry?

Easy
77

You are deploying a high-performance AI model in AKS. You need to ensure the container has access to the underlying host's NVIDIA GPU. What must be configured in the Pod spec?

Hard
78

You are setting up auto-scaling for a containerized AI web app in Azure Container Apps. You want to scale based on the number of concurrent HTTP requests. Which scaler do you use?

Medium
79

You notice that your AKS pods are stuck in 'ContainerCreating' state. You check the events and see 'FailedMount'. What is the most likely cause?

Hard
80

Which TWO of the following are valid ways to authenticate an AKS cluster to an Azure Container Registry?

Easy
81

Which TWO of the following features help manage traffic to containerized applications?

Medium
82

Which TWO of the following techniques help optimize the performance of containerized AI models in AKS?

Hard
83

You are integrating Azure Container Registry with Azure Kubernetes Service. You want to enable authentication without storing static credentials (username/password) in Kubernetes secrets. What is the recommended integration method?

Hard
84

You have an AI scoring script that runs periodically. You want to execute this containerized workload on a schedule without managing virtual machines. Which Azure service is best suited for running containerized batch jobs on a schedule?

Medium
85

You are deploying a containerized AI inference API to Azure Container Apps. The container must read model files from an Azure Files share and write temporary logs to the same share. You need to configure the Container App so the share is available at a specific mount path inside the container. What should you do?

Medium
86

You have an AI model container hosted in Azure Container Registry. You want to ensure that every container image pushed to the registry is automatically scanned for known vulnerabilities before deployment. Which ACR feature should you enable?

Medium
87

You are running a containerized AI inference service on Azure Kubernetes Service (AKS). The service uses a large language model and requires 24 GB of GPU memory. You have a node pool with NVIDIA V100 GPUs (16 GB each). You need to ensure the pod can access sufficient GPU memory. What should you do?

Hard
88

You want to limit the CPU resources that a specific AI inference pod can consume. Which Kubernetes field do you configure?

Easy
89

You are deploying an AI model container in Azure Container Apps. Which TWO authentication mechanisms can you configure for securely pulling the image from a private Azure Container Registry?

Medium
90

You are running a containerized AI image classification service on Azure Kubernetes Service (AKS). The service must process images from an Azure Blob Storage account. You want the pods to access the storage without embedding credentials in the container image or Kubernetes secrets. Which authentication method should you use?

Hard
91

You are deploying an AI model container to Azure Container Apps. The container application needs to securely connect to an Azure SQL Database without storing plain-text database credentials in environment variables or application code. What is the recommended feature to use?

Medium
92

You are configuring secure ingress and network isolation for an Azure Container Apps environment. Which THREE capabilities are supported when configuring networking for Container Apps? (Choose three.)

Hard
93

You want to track the latency of your model inference API in production. Which Azure tool should you integrate into your containerized application?

Medium
94

You are troubleshooting high latency in an AI inference workload on AKS. You suspect the issue is caused by container startup time (cold starts). Which feature helps mitigate this?

Hard
95

You are building a container image for an AI model that requires GPU acceleration. You plan to run it on Azure Kubernetes Service (AKS). Which step must you take to ensure the pods can access GPU resources?

Medium
96

You are troubleshooting a containerized AI model deployment in Azure Container Apps that fails to pass its HTTP readiness probe. You need to inspect the container logs and runtime diagnostics. Which THREE tools or commands can you use to troubleshoot this issue? Each correct answer presents a complete solution.

Hard
97

You need to deploy a set of batch AI processing containers in Azure Container Instances that run to completion and then terminate. Which container group restart policy should you select?

Medium
98

You are configuring TLS termination for an AI model API hosted in Azure Container Apps using a custom domain name. Where must you upload or configure the custom SSL certificate?

Hard
99

You are deploying a containerized AI model to Azure Container Apps. The model requires a persistent volume to store intermediate results and a secret to access an external API. You need to configure the container app to meet these requirements. Which two actions should you perform? (Choose two.)

Hard
100

Which Azure feature allows you to scan images in your registry for vulnerabilities before deploying them to your production cluster?

Easy
101

You are deploying an AI model container to Azure Container Apps. The container requires persistent storage to cache downloaded Hugging Face model weights across container restarts. Which storage type should you attach to the Container App?

Medium
102

You are deploying a custom PyTorch model container image to Azure Container Apps. The container needs to scale out based on HTTP concurrent requests. Which built-in scale rule type should you configure in Azure Container Apps?

Easy
103

You are deploying an AI workload to Azure Container Apps. You need to ensure the container scales down to zero when there is no traffic. What should you configure?

Medium
104

Your organization requires that container images stored in Azure Container Registry (ACR) comply with security standards. Which TWO actions can you take to secure container images in ACR? (Choose two.)

Easy
105

You are designing a secure MLOps pipeline using Azure Container Registry. Which THREE practices should you implement to secure your AI container images?

Hard

Frequently asked questions

What does the Containerized AI Workloads domain cover on the AI-200 exam?
Be able to configure ACR scanning, Container Apps external ingress, and AKS resource and scheduling settings from manifests. The most important thing is choosing the correct Kubernetes field or Azure setting for the stated availability, security, or resource goal.
How many questions are in this domain?
This page lists all 105 Containerized AI Workloads questions in the AI-200 question bank. The actual exam draws from this domain proportionally to its weighting in the official exam blueprint.
What is the best way to practise this domain?
Start with a short focused session (10 questions) to identify gaps, then work through explanations. Repeat with a longer session once the weak areas feel solid.
Can I practise only Containerized AI Workloads questions?
Yes — the session launcher on this page filters questions to this domain only. Choose any session length for inline explanations and scoring.
Microsoft Certified: Azure AI Cloud Developer Associate (AI-200) (AI-200) Containerized AI Workloads Practice Questions