Microsoft Certified: Machine Learning Operations Engineer Associate (AI-300) (AI-300) (AI-300) — Questions 1–75

Which TWO techniques should you use to improve the accuracy of a RAG pipeline?

You are monitoring the cost of your GenAI infrastructure. You want to track usage per specific project. Which feature in Azure AI Foundry should you use?

You need to monitor the data drift of a model deployed in Azure ML. What is the first step you must take?

You are setting up a CI/CD pipeline for GenAI models. You need to evaluate the model's performance on a benchmark dataset before it is promoted to the production endpoint. Which Azure AI Foundry capability should be integrated into your pipeline?

Which Azure feature is used to define infrastructure as code for your Azure ML workspace?

Which THREE features does Azure AI Foundry provide to help developers?

Which THREE metrics can be logged during training to track performance in Azure ML?

You are configuring a CI/CD pipeline for model deployment. Which THREE actions must you perform to ensure model traceability?

You are deploying a model via a Managed Online Endpoint. You want to implement a Canary deployment where 10% of traffic is sent to a new model version. How do you configure this?

Which THREE factors contribute to increased latency in an LLM application?

Your team uses a custom Docker image for training. You need to update the image in the Azure Container Registry (ACR). What is the recommended workflow to ensure Azure ML picks up the latest version?

Your team is using Semantic Kernel for agent orchestration. You notice frequent transient errors when the agent interacts with multiple LLM services. How should you implement infrastructure-level resiliency?

Which TWO of the following can be used to manage Azure ML assets like environments and models?

Which TWO languages are natively supported for the Azure ML SDK?

You are deploying a model that requires specific GPUs. How do you ensure you get the right infrastructure?

When configuring observability for an AI application, which TWO telemetry types should you collect to analyze both performance and quality?

You want to automate the scaling of your AI agent orchestration. Which TWO components do you need to configure?

Which THREE metrics are critical for monitoring the health of a GenAI deployment?

You want to evaluate your prompt engineering changes quantitatively. Which method is most reliable for comparing two prompt versions?

You are configuring a chat application. What is the benefit of enabling streaming in the Azure OpenAI API?

Which THREE items are captured in the experiment lineage in Azure Machine Learning?

You are monitoring an Azure OpenAI deployment and need to identify if a model is outputting content that violates safety policies. Which Azure AI Content Safety feature should you enable to categorize harmful content?

You want to perform hyperparameter tuning using the 'HyperDrive' service. You have a requirement to stop poor-performing runs early to save compute costs. Which policy should you use?

A training job is consuming too much disk space on a compute cluster. What can you do to provide more persistent scratch space?

What is the benefit of using 'Model Catalog' in Azure AI Foundry?

In Azure ML, what is a 'Component'?

You are tracking LLM performance. Which metric is most critical to monitor if your cost-per-request is increasing unexpectedly?

In an LLM evaluation workflow, what does the 'Coherence' metric measure?

Which TWO resources are created inside an Azure Machine Learning workspace?

You are running a distributed training job using the 'PyTorch' framework on Azure Machine Learning. You need to configure the 'DistributionConfiguration'. Which setting is mandatory for multi-node training?

Your team needs to share a model across different workspaces. What is the most efficient way to achieve this in Azure Machine Learning?

You are setting up an evaluation suite for your LLM. Which THREE metrics are commonly provided by the 'Built-in' evaluators in Azure AI Prompt Flow?

Which TWO of the following are benefits of using Azure ML Environments?

You need to ensure that a training script running on Azure ML has access to secrets (like API keys) without hardcoding them in the script. What should you use?

You are deploying a high-throughput Large Language Model on Azure AI Foundry. You need to ensure the underlying infrastructure supports rapid auto-scaling based on request latency. Which configuration should you prioritize in the deployment settings?

You are securing an agent orchestration infrastructure where agents must access internal data stores. To prevent data exfiltration, you need to restrict all traffic to the Azure AI Foundry project to a private network. What should be configured?

Which TWO types of compute can be used for training in Azure Machine Learning?

You need to attach an existing Azure Kubernetes Service (AKS) cluster to your Azure ML workspace for model inference. Which credential type is required to establish this connection?

You are debugging an Azure ML pipeline. You want to see the stdout of a specific step that failed. How do you access this?

You are designing a quality assurance gate for your model. If a model output has a 'Violence' score of 0.8 according to Azure AI Content Safety, what is the best practice to handle it?

What is the primary purpose of a 'Labeling Project' in Azure Machine Learning?

You need to orchestrate a series of ML steps (Data prep, Training, Evaluation). Which Azure ML feature is specifically designed for this?

What is the purpose of a 'System-Assigned Managed Identity' in the context of an Azure AI project?

Which Azure Machine Learning resource provides a pre-configured environment for development?

What is the 'Workspace' in Azure Machine Learning?

When designing a content safety policy, which THREE categories are explicitly supported by the Azure AI Content Safety API?

When configuring a private endpoint for your Azure AI resource, which TWO of the following must be set up?

You are troubleshooting high latency in a RAG-based application. The vector search is fast, but the generation phase is slow. Which component should be scaled?

You are preparing a model for deployment. Which THREE items should you include in the model package?

What is the benefit of using 'Azure Machine Learning Datasets' (or Data Assets) over raw storage paths?

Which THREE items should you keep track of in your AI Foundry project to ensure good governance?

You want to evaluate how well your model adheres to specific brand guidelines. Which evaluation method is best suited for this?

You have a sudden spike in requests. What is the quickest way to check if you have hit your Azure OpenAI token quota?

You are deploying a large model. During the deployment, you encounter a 'Resource Not Available' error. What is the most likely cause?

You need to ensure that your LLM responses are filtered for harmful content. Which infrastructure component provides this capability?

You are setting up an Azure Machine Learning workspace and need to ensure that the workspace is not accessible from the public internet. Which networking feature should you configure?

You are managing model lifecycle security. Which THREE actions are recommended to secure your ML models?

Which service allows you to track ML models and their associated artifacts?

You are fine-tuning a model on Azure OpenAI and notice the training loss curve is fluctuating significantly. What is the most likely cause?

When sharing an AI project with a team, which resource group architecture is best practice for lifecycle management?

You have an automated deployment pipeline. You want to run an integration test on the model after deployment. Which tool is best suited for this?

You are auditing your model's safety logs and notice several 'jailbreak' attempts. Where can you find these logs in the Azure ecosystem?

You are experiencing throttling on your AI endpoint. Which TWO steps should you take?

You have a new model deployment that is incurring high costs. How can you find the top-consuming deployments?

Where do you define the model deployment settings, including instance count and version?

What is the purpose of a 'Datastore' in Azure Machine Learning?

Which TWO actions can you perform in the Azure Machine Learning studio?

A user wants to restrict the model's output to valid JSON format. What is the most effective way to ensure this?

What is the purpose of the Azure ML 'Model Registry'?

Which of the following is a key component of an observability strategy for Generative AI applications?

What is the primary function of an Azure ML 'Datastore'?

You are troubleshooting a deployment. Which THREE logs are most helpful to check?

You are troubleshooting a failed agent deployment. Which TWO areas should you inspect first?

Which THREE tools in Azure can be used to monitor the health and performance of your GenAI infrastructure?

Your team is deploying a large language model in Azure AI Foundry. You need to ensure that the inference endpoint remains highly available across different regions. Which configuration should you implement?