AI-300 Exam Questions and Answers

You need to implement a retraining trigger based on performance degradation. Which TWO metrics should you monitor to decide when to retrain?

You are configuring a CI/CD pipeline for model deployment. Which THREE actions must you perform to ensure model traceability?

You are building an Azure Machine Learning pipeline. You need to ensure that the pipeline components are reusable and versioned independently. What should you use?

You are orchestrating a multi-step ML pipeline in Azure Machine Learning. You need to ensure that a downstream step only executes if the upstream model training step finishes successfully, while allowing the pipeline to continue even if a non-critical logging step fails. Which configuration should you use?

You are deploying a model to an Azure Kubernetes Service (AKS) cluster. You need to ensure that the deployment handles traffic spikes by scaling based on GPU usage. Which setting must be enabled in the inference configuration?

You need to monitor the data drift of a model deployed in Azure ML. What is the first step you must take?

You are managing a multi-region GenAI deployment using Azure AI Foundry. To reduce latency for global users, what routing architecture should you implement?

You are monitoring the cost of your GenAI infrastructure. You want to track usage per specific project. Which feature in Azure AI Foundry should you use?

Your production agent application requires strict data isolation. You must ensure all requests to Azure OpenAI are routed through a private network. Which configuration is required?

Your team is using Semantic Kernel for agent orchestration. You notice frequent transient errors when the agent interacts with multiple LLM services. How should you implement infrastructure-level resiliency?

You need to audit all model access logs across your organization. What is the most effective approach?

You are implementing an agentic workflow using Azure AI Foundry. The agent needs to access a secure external API. How should you store the API key securely within the project?

A data scientist needs to access data in an Azure Data Lake Storage Gen2 account from Azure ML. You need to ensure the workspace uses the most secure method to access this data. What should you configure?

You want to automate the deployment of a model using GitHub Actions. Which file format is standard for defining the Azure ML CLI v2 deployment configuration?

You need to attach an existing Azure Kubernetes Service (AKS) cluster to your Azure ML workspace for model inference. Which credential type is required to establish this connection?

Your Azure ML training job fails with an 'Out of Memory' error on a GPU cluster. You need to ensure the job runs successfully without modifying the model code. What should you do?

You are creating a CI/CD pipeline in Azure DevOps. Which extension is essential to integrate Azure ML tasks into your build/release pipeline?

You are setting up an Azure Machine Learning workspace and need to ensure that the workspace is not accessible from the public internet. Which networking feature should you configure?

You are fine-tuning a model on Azure OpenAI and notice the training loss curve is fluctuating significantly. What is the most likely cause?

Which parameter in the Azure OpenAI API should be adjusted to make the model's output more deterministic and repeatable?

To optimize costs for an enterprise chatbot, you want to implement token usage monitoring. Which Azure service should you integrate to track token consumption per user?

You are optimizing a long-context application. Which technique is most effective for reducing context window costs in Azure OpenAI?

Your Azure OpenAI deployment is experiencing high latency during peak hours. You observe that input tokens are consistently high. Which strategy is most effective for reducing latency while maintaining quality?

Which feature in Azure OpenAI allows you to reserve throughput for a consistent user experience during high demand?

In an LLM evaluation workflow, what does the 'Coherence' metric measure?

You are monitoring an Azure OpenAI deployment and need to identify if a model is outputting content that violates safety policies. Which Azure AI Content Safety feature should you enable to categorize harmful content?

You are building a RAG application and notice that the model sometimes hallucinates information not present in the retrieved documents. Which evaluation metric should you prioritize to mitigate this?

You are deploying a GenAI app to production and want to track the 'Token Usage' and 'Latency' metrics per user session. Which service should you integrate with your application?

When using Prompt Flow for GenAI, where should you store your evaluation results to visualize them over time?

You need to detect 'jailbreak' attempts in your RAG application. You are implementing a custom evaluation pipeline. Which technique is most effective for identifying adversarial inputs designed to bypass system instructions?