troubleshooting

Which TWO techniques should you use to improve the accuracy of a RAG pipeline?

You are monitoring the cost of your GenAI infrastructure. You want to track usage per specific project. Which feature in Azure AI Foundry should you use?

You need to monitor the data drift of a model deployed in Azure ML. What is the first step you must take?

You are setting up a CI/CD pipeline for GenAI models. You need to evaluate the model's performance on a benchmark dataset before it is promoted to the production endpoint. Which Azure AI Foundry capability should be integrated into your pipeline?

Which Azure feature is used to define infrastructure as code for your Azure ML workspace?

Which THREE features does Azure AI Foundry provide to help developers?

Which THREE metrics can be logged during training to track performance in Azure ML?

You are configuring a CI/CD pipeline for model deployment. Which THREE actions must you perform to ensure model traceability?

You are deploying a model via a Managed Online Endpoint. You want to implement a Canary deployment where 10% of traffic is sent to a new model version. How do you configure this?

Which THREE factors contribute to increased latency in an LLM application?

Your team uses a custom Docker image for training. You need to update the image in the Azure Container Registry (ACR). What is the recommended workflow to ensure Azure ML picks up the latest version?

Your team is using Semantic Kernel for agent orchestration. You notice frequent transient errors when the agent interacts with multiple LLM services. How should you implement infrastructure-level resiliency?

Which TWO of the following can be used to manage Azure ML assets like environments and models?

Which TWO languages are natively supported for the Azure ML SDK?

You are deploying a model that requires specific GPUs. How do you ensure you get the right infrastructure?

When configuring observability for an AI application, which TWO telemetry types should you collect to analyze both performance and quality?

You want to automate the scaling of your AI agent orchestration. Which TWO components do you need to configure?

Which THREE metrics are critical for monitoring the health of a GenAI deployment?

You want to evaluate your prompt engineering changes quantitatively. Which method is most reliable for comparing two prompt versions?

You are configuring a chat application. What is the benefit of enabling streaming in the Azure OpenAI API?

Which THREE items are captured in the experiment lineage in Azure Machine Learning?

You are monitoring an Azure OpenAI deployment and need to identify if a model is outputting content that violates safety policies. Which Azure AI Content Safety feature should you enable to categorize harmful content?

You want to perform hyperparameter tuning using the 'HyperDrive' service. You have a requirement to stop poor-performing runs early to save compute costs. Which policy should you use?

A training job is consuming too much disk space on a compute cluster. What can you do to provide more persistent scratch space?

What is the benefit of using 'Model Catalog' in Azure AI Foundry?

In Azure ML, what is a 'Component'?

You are tracking LLM performance. Which metric is most critical to monitor if your cost-per-request is increasing unexpectedly?

In an LLM evaluation workflow, what does the 'Coherence' metric measure?

Which TWO resources are created inside an Azure Machine Learning workspace?

You are running a distributed training job using the 'PyTorch' framework on Azure Machine Learning. You need to configure the 'DistributionConfiguration'. Which setting is mandatory for multi-node training?

Your team needs to share a model across different workspaces. What is the most efficient way to achieve this in Azure Machine Learning?

You are setting up an evaluation suite for your LLM. Which THREE metrics are commonly provided by the 'Built-in' evaluators in Azure AI Prompt Flow?

Which TWO of the following are benefits of using Azure ML Environments?

You need to ensure that a training script running on Azure ML has access to secrets (like API keys) without hardcoding them in the script. What should you use?

You are deploying a high-throughput Large Language Model on Azure AI Foundry. You need to ensure the underlying infrastructure supports rapid auto-scaling based on request latency. Which configuration should you prioritize in the deployment settings?

You are securing an agent orchestration infrastructure where agents must access internal data stores. To prevent data exfiltration, you need to restrict all traffic to the Azure AI Foundry project to a private network. What should be configured?

Which TWO types of compute can be used for training in Azure Machine Learning?

You need to attach an existing Azure Kubernetes Service (AKS) cluster to your Azure ML workspace for model inference. Which credential type is required to establish this connection?

You are debugging an Azure ML pipeline. You want to see the stdout of a specific step that failed. How do you access this?

You are designing a quality assurance gate for your model. If a model output has a 'Violence' score of 0.8 according to Azure AI Content Safety, what is the best practice to handle it?

What is the primary purpose of a 'Labeling Project' in Azure Machine Learning?

You need to orchestrate a series of ML steps (Data prep, Training, Evaluation). Which Azure ML feature is specifically designed for this?

What is the purpose of a 'System-Assigned Managed Identity' in the context of an Azure AI project?

Which Azure Machine Learning resource provides a pre-configured environment for development?

What is the 'Workspace' in Azure Machine Learning?

When designing a content safety policy, which THREE categories are explicitly supported by the Azure AI Content Safety API?

When configuring a private endpoint for your Azure AI resource, which TWO of the following must be set up?

You are troubleshooting high latency in a RAG-based application. The vector search is fast, but the generation phase is slow. Which component should be scaled?

You are preparing a model for deployment. Which THREE items should you include in the model package?

What is the benefit of using 'Azure Machine Learning Datasets' (or Data Assets) over raw storage paths?

Which THREE items should you keep track of in your AI Foundry project to ensure good governance?

You want to evaluate how well your model adheres to specific brand guidelines. Which evaluation method is best suited for this?

You have a sudden spike in requests. What is the quickest way to check if you have hit your Azure OpenAI token quota?

You are deploying a large model. During the deployment, you encounter a 'Resource Not Available' error. What is the most likely cause?

You need to ensure that your LLM responses are filtered for harmful content. Which infrastructure component provides this capability?

You are setting up an Azure Machine Learning workspace and need to ensure that the workspace is not accessible from the public internet. Which networking feature should you configure?

You are managing model lifecycle security. Which THREE actions are recommended to secure your ML models?

Which service allows you to track ML models and their associated artifacts?

You are fine-tuning a model on Azure OpenAI and notice the training loss curve is fluctuating significantly. What is the most likely cause?

When sharing an AI project with a team, which resource group architecture is best practice for lifecycle management?

You have an automated deployment pipeline. You want to run an integration test on the model after deployment. Which tool is best suited for this?

You are auditing your model's safety logs and notice several 'jailbreak' attempts. Where can you find these logs in the Azure ecosystem?

You are experiencing throttling on your AI endpoint. Which TWO steps should you take?

You have a new model deployment that is incurring high costs. How can you find the top-consuming deployments?

Where do you define the model deployment settings, including instance count and version?

What is the purpose of a 'Datastore' in Azure Machine Learning?

Which TWO actions can you perform in the Azure Machine Learning studio?

A user wants to restrict the model's output to valid JSON format. What is the most effective way to ensure this?

What is the purpose of the Azure ML 'Model Registry'?

Which of the following is a key component of an observability strategy for Generative AI applications?

What is the primary function of an Azure ML 'Datastore'?

You are troubleshooting a deployment. Which THREE logs are most helpful to check?

You are troubleshooting a failed agent deployment. Which TWO areas should you inspect first?

Which THREE tools in Azure can be used to monitor the health and performance of your GenAI infrastructure?

Your team is deploying a large language model in Azure AI Foundry. You need to ensure that the inference endpoint remains highly available across different regions. Which configuration should you implement?

Your Azure OpenAI deployment is experiencing high latency during peak hours. You observe that input tokens are consistently high. Which strategy is most effective for reducing latency while maintaining quality?

When using Prompt Flow for GenAI, where should you store your evaluation results to visualize them over time?

To optimize the cost of your AI infrastructure, which THREE actions should you consider?

You are using MLflow to track experiments in Azure Machine Learning. You need to log a custom metric that is calculated every 100 iterations. Which MLflow function should you use?

You are deploying a custom model in a container. To ensure the model infrastructure is highly available, what is the best practice?

Which TWO of the following storage types can be registered as an Azure ML Datastore?

Which Azure feature should you use to restrict traffic to your AI Foundry project to specific IP addresses?

You are optimizing a model for a specific domain language. Which fine-tuning approach minimizes cost while maximizing domain adaptation?

Which TWO of the following strategies are commonly used to optimize for cost in Generative AI?

You need to update a prompt flow without downtime. What deployment strategy should you use?

You are orchestrating a multi-step ML pipeline in Azure Machine Learning. You need to ensure that a downstream step only executes if the upstream model training step finishes successfully, while allowing the pipeline to continue even if a non-critical logging step fails. Which configuration should you use?

Which THREE of the following are types of Azure ML endpoints?

You are experiencing latency issues with a model deployed on a Managed Online Endpoint. What is the first thing you should check?

A team uses Azure Machine Learning to track experiments. You need to ensure that every run is associated with a specific git commit hash to ensure reproducibility. Where should this be configured?

You need to ensure that training data is encrypted at rest in the Blob Storage linked to your Azure Machine Learning workspace. How do you ensure this?

You are evaluating an LLM application using Prompt Flow. You want to measure the 'Groundedness' of the model response relative to the retrieved context. Which evaluator should you configure?

Which TWO of the following are benefits of using the Azure ML CLI v2 for your MLOps pipelines?

You are implementing a retraining trigger for a demand forecasting model. You want to trigger a pipeline execution only when the drift metric for the 'Price' feature exceeds a predefined threshold. Which service should you integrate with Azure Machine Learning?

Which THREE parameters directly affect the output structure or style of an LLM response?

You are configuring a 'Managed Online Endpoint' for a very large model (10GB+). The deployment is failing during the 'pulling image' phase. What is the most likely cause?

You need to monitor the health of your deployed Azure ML models. Which service is integrated directly with Azure ML to provide automated metrics and logging?

You are using GitHub Actions. You want to authenticate to Azure without using hardcoded credentials. What should you use?

You want to track your model experiments and compare their performance metrics. Which Azure ML feature provides this capability?

When configuring a compute instance, which setting allows you to automatically stop the instance during periods of inactivity?

You need to audit all model access logs across your organization. What is the most effective approach?

You want to automate the deployment of a model using GitHub Actions. Which file format is standard for defining the Azure ML CLI v2 deployment configuration?

You are creating a 'Pipeline' and want to share a dataset across multiple steps. What is the most efficient way to access this data?

You are reviewing the 'Run History' in Azure Machine Learning. You want to compare the training time of two different experiments. Which UI feature should you use?

You are deploying a model to an Azure Kubernetes Service (AKS) cluster. You need to ensure that the deployment handles traffic spikes by scaling based on GPU usage. Which setting must be enabled in the inference configuration?

Which THREE of the following are key components of a robust MLOps strategy in Azure?

You are creating a CI/CD pipeline in Azure DevOps. Which extension is essential to integrate Azure ML tasks into your build/release pipeline?

You want to automate the evaluation of your LLM application using a 'Golden Dataset'. What is the primary purpose of this dataset in an MLOps pipeline?

You are setting up an MLOps pipeline and need to ensure that only approved models are deployed. Which feature should you use?

Which THREE settings are part of the 'InferenceConfig' object in Azure ML?

You are configuring a 'Managed Online Endpoint' for production. You want to ensure high availability. What should you configure?

Which THREE metrics are critical for monitoring a production Generative AI system?

An agent orchestration system is timing out because it waits too long for tool output. How can you optimize the infrastructure handling of tool calls?

You are automating the deployment of your AI project. What is the recommended tool to manage infrastructure-as-code (IaC) for Azure AI Foundry?

A data scientist needs to access data in an Azure Data Lake Storage Gen2 account from Azure ML. You need to ensure the workspace uses the most secure method to access this data. What should you configure?

Your production agent application requires strict data isolation. You must ensure all requests to Azure OpenAI are routed through a private network. Which configuration is required?

You need to ensure that your model inference code has access to the latest secret keys without hardcoding them. What is the recommended integration?

You have a large set of documents for a RAG system. How should you optimize retrieval speed?

You are configuring a connection to a vector store. What is the best way to handle the secret credential?

You have an Azure Machine Learning pipeline that uses 'PipelineData' to pass information between steps. You want to share data between a training step and a scoring step. What is the recommended way to persist this data?

Which TWO of the following are required to secure an Azure ML workspace using a Private Link?

You are optimizing your Azure ML pipeline performance. Which THREE steps should you take to reduce execution time?

You are troubleshooting a model deployment failure where the container fails to start due to missing environment variables. Where do you find the logs to identify the cause?

You are using Azure AI Studio to evaluate your model. Which tool allows you to perform batch testing on a large dataset of prompts?

Which THREE of the following are components of an Azure AI Foundry project?

You are implementing a custom container for model training. You need to push the image to the 'Azure Container Registry' (ACR) linked to your workspace. What is the correct command?

You are building an Azure Machine Learning pipeline. You need to ensure that the pipeline components are reusable and versioned independently. What should you use?

In an LLM pipeline, what is the primary risk of relying solely on automated 'Groundedness' evaluators?

Which parameter in the Azure OpenAI API should be adjusted to make the model's output more deterministic and repeatable?

You are managing a multi-workspace environment. You need to restrict the ability to create new compute clusters to only specific users. Where should you apply this control?

You are optimizing prompt latency by reducing tokens. Which of the following is the most effective way to reduce input token count for a recurring task?

Your team wants to use prompt versioning. Where should this be managed in the AI Foundry workflow?

You are moving a model from a local environment to Azure Machine Learning. Which file is required to define the entry script for the model inference?

You are optimizing a long-context application. Which technique is most effective for reducing context window costs in Azure OpenAI?

Which TWO of the following are recommended methods for identifying 'hallucinations' in a RAG system?

You are monitoring model drift. Which TWO features are required to configure a Data Drift Monitor?

An application is hitting rate limits on the Azure OpenAI service. Which action is the most standard approach for handling this in production?

You need to prevent data egress from your Azure ML environment. What configuration is required?

What is the primary benefit of using Azure ML compute clusters instead of compute instances for training?

You are designing the infrastructure for a multi-agent system. Which THREE of the following are essential components to ensure agent orchestration scalability?

Which feature in Azure OpenAI allows you to reserve throughput for a consistent user experience during high demand?

You want to enforce a policy that all models must be registered before being deployed. Which feature should you use to implement this constraint?

You are configuring an 'Azure Machine Learning Compute Cluster' for a heavy training job. You want to ensure it shuts down automatically when no jobs are running. What setting should you configure?

You are automating model registration using the Azure ML CLI. You need to ensure the registration only happens if the model accuracy is above 0.9. How do you implement this condition?

You need to debug a training job that is failing inside a specific Docker container. What is the best way to investigate?

A team is scaling a GenAI application that utilizes multiple models via model-as-a-service. You notice that inference requests are being throttled. What is the most effective infrastructure-level adjustment to handle the increased load?

Which TWO methods are best for debugging an LLM pipeline that fails on complex queries?

You have an automated model training pipeline that is failing intermittently due to compute availability. What should you configure to ensure the pipeline is more resilient?

You are planning a production GenAI deployment. Which THREE of the following are necessary infrastructure considerations?

You are managing a multi-region GenAI deployment using Azure AI Foundry. To reduce latency for global users, what routing architecture should you implement?

You are deploying a model that requires a high-memory compute for inference. You are using a 'Managed Online Endpoint'. Where do you specify the instance type for this deployment?

You are building a RAG application. Where should you store the indexed documents for optimal retrieval performance?

You are optimizing the cost of your GenAI infrastructure. You have several agents running in Prompt Flow that are idle for large portions of the day. Which runtime configuration should be modified?

You are deploying a GenAI app to production and want to track the 'Token Usage' and 'Latency' metrics per user session. Which service should you integrate with your application?

Which component in an Azure ML pipeline definition is responsible for specifying the runtime environment, including Python packages and Conda dependencies?

You are configuring a batch scoring job. You need to ensure that the job processes data in parallel to reduce completion time. What property should you adjust in the 'ParallelRunConfig'?

Which TWO of the following are valid ways to authenticate to an Azure AI Foundry project?

Which Azure AI Foundry feature allows you to evaluate your model's performance?

A pipeline step fails because it cannot find a file in the datastore. What is the most likely cause?

You notice that your fine-tuned model is 'forgetting' base capabilities after training on a small dataset. What strategy should you use to mitigate this?

You are configuring an agent orchestration system using Prompt Flow. You need to capture trace data for every step in the agent's reasoning process. Which infrastructure component must be enabled to visualize this in Azure AI Foundry?

You are deploying a model as a real-time endpoint. You want to ensure the deployment can handle sudden spikes in traffic. Which scaling configuration should you enable?

What is the recommended approach for managing configuration settings for different environments (Dev, Test, Prod) in an AI application?

Which THREE of the following are valid compute targets for Azure Machine Learning training?

Which TWO of the following are benefits of using Prompt Flow for orchestration?

You are managing model versioning in Azure Machine Learning Registry. You need to promote a model from 'Staging' to 'Production' without creating a new asset version. Which command or action should you perform?

You are using Azure Machine Learning Pipelines. Which THREE triggers can be used to start a pipeline?

You are building a RAG application and notice that the model sometimes hallucinates information not present in the retrieved documents. Which evaluation metric should you prioritize to mitigate this?

You are defining an Azure Machine Learning environment for a training job. The environment requires a specific set of Python libraries. What is the best practice for defining these dependencies?

Which cost-tracking tool in the Azure portal allows you to view usage by specific Azure OpenAI deployments?

You are debugging a prompt that is performing poorly on edge cases. You decide to use a 'Chain-of-Thought' approach. Why does this improve performance?

Which THREE types of information are found in a Run Object in Azure ML?

You want to measure 'Relevance' in a RAG application. The relevance evaluator detects how well the response answers the user query. If the model provides a factually correct answer that does not address the prompt, which metric will capture this failure?

Which TWO of the following are effective ways to reduce hallucination?

Which TWO metrics are most useful for evaluating the 'User Experience' in a conversational agent?

Which THREE of the following represent lifecycle stages of an ML model in Azure ML?

You need to ensure that your Azure ML models are deployed with high availability across multiple regions. Which deployment strategy should you configure?

You need to implement a retraining trigger based on performance degradation. Which TWO metrics should you monitor to decide when to retrain?

Which infrastructure artifact acts as the primary container for organizing and managing your models, deployments, and associated connections in Azure AI Foundry?

A developer is troubleshooting an agent that is failing to connect to an external tool. Which THREE of the following infrastructure settings should be verified?

Which THREE actions are essential when managing a 'Golden Dataset' for LLM evaluation?

You need to detect 'jailbreak' attempts in your RAG application. You are implementing a custom evaluation pipeline. Which technique is most effective for identifying adversarial inputs designed to bypass system instructions?

Which THREE of the following are common reasons for a model deployment to fail on a Managed Online Endpoint?

You are onboarding a team to Azure AI Foundry. You need to assign the minimum permissions for a developer to deploy and test a model. Which role should you assign?

You are configuring a 'Managed Online Endpoint' with SSL termination. Where do you manage the SSL certificates?

What is the primary function of a 'Prompt Template' in an Azure AI Prompt Flow?

What is the primary benefit of 'Prompt Versioning' in an MLOps lifecycle?

You are implementing an agentic workflow using Azure AI Foundry. The agent needs to access a secure external API. How should you store the API key securely within the project?

Your team wants to monitor the safety of model outputs. Which THREE steps should you take?

You notice your model is outputting redundant information. Which parameter specifically targets the penalty for repeating tokens?

You want to automate the testing of your prompt flows as part of your CI/CD pipeline. Which tool should you use?

Which THREE steps are necessary to successfully fine-tune an Azure OpenAI model?

Your team wants to perform 'Red Teaming' on your application. Which activity describes this process correctly?

You notice your model deployment status is 'Succeeded' but inference requests are failing. Where should you first check for connectivity issues?

Which THREE factors influence the cost of an Azure ML Compute Cluster?

You need to monitor the 'latency' and 'token usage' of your model deployments in real-time. Which tool provides the most granular view?

What is the primary function of the 'Prompt Flow' tool within Azure AI Foundry?

When implementing LLM-as-a-judge for evaluation, which TWO factors can influence the reliability of your results?

Which THREE security features are essential for a production Azure ML deployment?

Your Azure ML training job fails with an 'Out of Memory' error on a GPU cluster. You need to ensure the job runs successfully without modifying the model code. What should you do?

You are reviewing the infrastructure architecture for a GenAI application that requires strict regulatory compliance. Which TWO of the following configurations are required to ensure data privacy and residency?

Which THREE components are required to define a 'Managed Online Deployment'?

To optimize costs for an enterprise chatbot, you want to implement token usage monitoring. Which Azure service should you integrate to track token consumption per user?

Which technique is most appropriate for optimizing RAG performance when the vector database returns too much noisy information?

A model is exhibiting data drift. You have created a drift monitor. What is the next step to automate the retraining?