AI-300 Practice Test 2 — 30 Questions

Question 1

You need to ensure that your LLM responses are filtered for harmful content. Which infrastructure component provides this capability?

Accepted Answer

Azure AI Content Safety. Azure AI Content Safety is the integrated service used within AI Foundry to monitor and filter model outputs.

Answer

Azure Monitor

Answer

Azure Key Vault

Answer

Azure Bastion

Question 2

You are automating the deployment of your AI project. What is the recommended tool to manage infrastructure-as-code (IaC) for Azure AI Foundry?

Accepted Answer

Azure Bicep. Bicep is the native, recommended IaC tool for Azure, providing deep integration for AI Foundry resources.

Answer

Azure DevOps pipelines

Answer

Azure CLI alone

Answer

Python script with Azure SDK

Question 3

You are onboarding a team to Azure AI Foundry. You need to assign the minimum permissions for a developer to deploy and test a model. Which role should you assign?

Accepted Answer

Azure AI Developer. The 'Azure AI Developer' role provides sufficient permissions to manage resources and perform model deployments within the project.

Answer

Owner

Answer

Reader

Answer

Contributor

Question 4

You notice your model deployment status is 'Succeeded' but inference requests are failing. Where should you first check for connectivity issues?

Accepted Answer

The 'Endpoints' tab in Azure AI Foundry. The 'Endpoints' view in the AI Foundry project shows the connectivity status and endpoint URLs for the model.

Answer

The 'Keys' tab in the Azure Portal

Answer

Azure Subscription usage reports

Answer

Azure Storage Account logs

Question 5

Which TWO of the following are valid ways to authenticate to an Azure AI Foundry project?

Accepted Answer

API Keys.. Entra ID (RBAC) and API Keys are the two primary methods for securing access to AI resources.

Answer

Hardcoded usernames in the code.

Answer

Local file-based passwords.

Answer

Public IP allow-listing only.

Question 6

Which TWO of the following are benefits of using Prompt Flow for orchestration?

Accepted Answer

Integrated testing and evaluation.. Prompt Flow offers a visual interface for complex flows and integrated evaluation, which simplifies orchestration.

Answer

Removal of the need for an LLM.

Answer

No need for authentication.

Answer

Automatic hardware management.

Question 7

Which TWO metrics are most useful for evaluating the 'User Experience' in a conversational agent?

Accepted Answer

Relevance. Latency and the quality of the answer (Relevance) are the primary drivers of user satisfaction.

Answer

Disk I/O speed

Answer

Model training loss

Answer

GPU voltage

Question 8

You are planning a production GenAI deployment. Which THREE of the following are necessary infrastructure considerations?

Accepted Answer

Implementing Private Link for network isolation.. Security, scalability, and monitoring are the three pillars of a production-ready AI infrastructure.

Answer

Using the cheapest SKU regardless of capacity.

Answer

Hardcoding credentials in the code.

Question 9

You are using MLflow to track experiments in Azure Machine Learning. You need to log a custom metric that is calculated every 100 iterations. Which MLflow function should you use?

Accepted Answer

'mlflow.log_metric()'.. The 'mlflow.log_metric' function is used to log key-value pairs of metrics, which can be called within the training loop.

Answer

'mlflow.set_tag()'.

Answer

'mlflow.log_artifact()'.

Answer

'mlflow.log_param()'.

Question 10

You want to automate the testing of your prompt flows as part of your CI/CD pipeline. Which tool should you use?

Accepted Answer

Prompt Flow CLI. The 'pf' (Prompt Flow) CLI is designed to run flows and evaluations programmatically in CI/CD pipelines.

Answer

Azure Logic Apps

Answer

Azure Functions

Answer

Azure AI Search test console

Question 11

You are experiencing throttling on your AI endpoint. Which TWO steps should you take?

Accepted Answer

Check current usage against quota limits.. To resolve throttling, you need to either optimize usage or increase the available quota/capacity.

Answer

Disable all security features.

Answer

Change the model version to one that is faster but less smart.

Answer

Delete all existing deployments.

Question 12

You are building a RAG application. Where should you store the indexed documents for optimal retrieval performance?

Accepted Answer

Azure AI Search. Azure AI Search is the native indexer and retriever for AI Foundry RAG applications.

Answer

Azure Blob Storage

Answer

Azure Cache for Redis

Answer

Azure SQL Database

Question 13

Which THREE factors contribute to increased latency in an LLM application?

Accepted Answer

The size/complexity of the chosen model.. Model size, input/output token count, and network transit time are the main drivers of latency.

Answer

The number of system messages used.

Answer

The use of JSON output mode.

Question 14

You want to automate the scaling of your AI agent orchestration. Which TWO components do you need to configure?

Accepted Answer

Autoscale policies.. Auto-scaling is driven by metrics and defined by policies that govern instance counts.

Answer

A manual human-in-the-loop review.

Answer

Hardcoded instance counts.

Answer

Static IP addresses.

Question 15

What is the primary function of a 'Prompt Template' in an Azure AI Prompt Flow?

Accepted Answer

To define the structure of the prompt with dynamic inputs. A prompt template allows users to define the structure of the prompt while injecting dynamic variables.

Answer

To cache previous responses

Answer

To perform load balancing

Answer

To automatically retrain the model

Question 16

You have a new model deployment that is incurring high costs. How can you find the top-consuming deployments?

Accepted Answer

Use 'Cost Analysis' in the Azure Portal.. The cost analysis tool in the Azure portal allows you to group costs by 'Resource' or 'Tag' to identify top-consuming deployments.

Answer

Check the 'Activity Log'.

Answer

Check the Azure AI Foundry 'Deployments' page.

Answer

Review the 'Quotas' tab.

Question 17

You are configuring a chat application. What is the benefit of enabling streaming in the Azure OpenAI API?

Accepted Answer

Reduces time-to-first-token (TTFT) perception for the end-user.. Streaming improves perceived latency by delivering tokens as they are generated.

Answer

Increases the model's accuracy.

Answer

Removes the need for a system prompt.

Answer

Decreases the total number of tokens consumed.

Question 18

What is the primary function of the 'Prompt Flow' tool within Azure AI Foundry?

Accepted Answer

To create and test prompt-based workflows.. Prompt Flow is a development tool designed to streamline the entire development cycle of AI applications, from prototyping to deployment.

Answer

To manage Azure subscriptions.

Answer

To perform data visualization.

Answer

To manage firewall rules.

Question 19

You are configuring an agent orchestration system using Prompt Flow. You need to capture trace data for every step in the agent's reasoning process. Which infrastructure component must be enabled to visualize this in Azure AI Foundry?

Accepted Answer

Enable Azure Monitor diagnostic settings to stream Prompt Flow logs to a Log Analytics workspace.. Enabling the connection to an Azure Log Analytics workspace within the Prompt Flow project settings allows for the storage and visualization of trace data.

Answer

Configure the Prompt Flow runtime to use a Managed Identity with read access to the Blob Storage account.

Answer

Deploy a specialized Azure Function to intercept and log flow run events.

Answer

Increase the timeout threshold in the runtime environment settings.

Question 20

You want to measure 'Relevance' in a RAG application. The relevance evaluator detects how well the response answers the user query. If the model provides a factually correct answer that does not address the prompt, which metric will capture this failure?

Accepted Answer

Relevance. Relevance specifically measures if the response directly addresses the user's intent.

Answer

Fluency

Answer

Coherence

Answer

Groundedness