AI-300 Practice Test 15 — 15 Questions

Question 1

You are optimizing a long-context application. Which technique is most effective for reducing context window costs in Azure OpenAI?

Accepted Answer

Summarizing conversation history before passing to the next prompt.. Summarizing previous turns in a conversation history reduces the number of tokens sent in each request, lowering costs.

Answer

Using a smaller batch size.

Answer

Disabling streaming responses.

Answer

Increasing the frequency penalty.

Question 2

Your production agent application requires strict data isolation. You must ensure all requests to Azure OpenAI are routed through a private network. Which configuration is required?

Accepted Answer

Enable 'Public Network Access' set to 'Disabled' on the Azure AI resource.. To ensure traffic stays within the private network, you must configure Azure AI Services with Private Link and ensure all traffic is routed through a private endpoint.

Answer

Deploy the model inside a dedicated 'Azure Kubernetes Service' node pool.

Answer

Configure a 'Service Tag' for Azure OpenAI in the Firewall settings.

Answer

Add the 'Virtual Network' to the 'Allowed Subnets' in the AI Service.

Question 3

When implementing LLM-as-a-judge for evaluation, which TWO factors can influence the reliability of your results?

Accepted Answer

The specific prompt instructions provided to the judge LLM. The choice of judge model and the design of the system prompt for the judge significantly impact the result quality.

Answer

The color of the application dashboard

Answer

The number of tokens available in the workspace quota

Answer

The location of the storage account

Question 4

Which Azure feature should you use to restrict traffic to your AI Foundry project to specific IP addresses?

Accepted Answer

Azure AI Services 'Networking' (Firewall) settings. IP Firewall rules in the Azure AI Services resource allow you to define allowed client IP ranges.

Answer

Azure Active Directory Conditional Access

Answer

Network Security Groups (NSG) on the VM

Answer

Azure Front Door WAF

Question 5

Which THREE tools in Azure can be used to monitor the health and performance of your GenAI infrastructure?

Accepted Answer

Azure Log Analytics. Application Insights, Log Analytics, and Azure Monitor are core observability tools.

Answer

Azure Front Door

Answer

Azure Active Directory

Question 6

You are setting up an evaluation suite for your LLM. Which THREE metrics are commonly provided by the 'Built-in' evaluators in Azure AI Prompt Flow?

Accepted Answer

Coherence. The standard built-in metrics in Prompt Flow include Groundedness, Relevance, and Coherence.

Answer

Deployment cost

Answer

Training duration

Question 7

Which infrastructure artifact acts as the primary container for organizing and managing your models, deployments, and associated connections in Azure AI Foundry?

Accepted Answer

Azure AI Project. An Azure AI project is the core resource that organizes models, deployments, connections, and flow assets within the Azure AI Foundry ecosystem.

Answer

Azure AI Resource

Answer

Azure Machine Learning Workspace

Answer

Azure Resource Group

Question 8

You are auditing your model's safety logs and notice several 'jailbreak' attempts. Where can you find these logs in the Azure ecosystem?

Accepted Answer

Log Analytics Workspace. Azure AI Content Safety logs, when integrated with Azure Monitor/Log Analytics, allow for auditing and analysis of safety events.

Answer

Azure Key Vault

Answer

Azure Resource Graph

Answer

Azure Active Directory

Question 9

You are designing the infrastructure for a multi-agent system. Which THREE of the following are essential components to ensure agent orchestration scalability?

Accepted Answer

Horizontal Pod Autoscaling (HPA) for inference services.. Scalability in agent systems requires load balancing, message queuing, and state management to handle concurrent agent tasks and ensure high throughput.

Answer

Azure Data Lake Storage for model weights.

Answer

Azure Bastion for secure management.

Question 10

You need to monitor the 'latency' and 'token usage' of your model deployments in real-time. Which tool provides the most granular view?

Accepted Answer

Azure Monitor with diagnostic logs. Azure Monitor with custom log queries against the diagnostic logs of the AI resource provides the most granular view.

Answer

Azure Billing dashboard

Answer

Azure Activity Log

Answer

Azure AI Foundry 'Overview' tab

Question 11

An agent orchestration system is timing out because it waits too long for tool output. How can you optimize the infrastructure handling of tool calls?

Accepted Answer

Implement 'Asynchronous' execution patterns for long-running tools.. Implementing tool-specific timeouts within the agent definition helps prevent long-running tasks from stalling the overall orchestration chain.

Answer

Increase the 'CPU count' on the hosting server.

Answer

Increase the 'Global Timeout' for the entire agent.

Answer

Reduce the 'System Prompt' size.

Question 12

What is the primary benefit of 'Prompt Versioning' in an MLOps lifecycle?

Accepted Answer

It ensures reproducibility and enables easy rollbacks. Versioning prompts allows for tracking changes, reverting to previous versions, and comparing performance over time.

Answer

It increases model training speed

Answer

It eliminates the need for evaluation

Answer

It automatically generates unit tests

Question 13

You are managing a multi-region GenAI deployment using Azure AI Foundry. To reduce latency for global users, what routing architecture should you implement?

Accepted Answer

Use Azure Front Door to route traffic to the nearest regional AI Foundry endpoint.. Azure Front Door provides global HTTP load balancing and site acceleration, which is critical for reducing latency in geographically dispersed GenAI applications.

Answer

Implement 'Private Link' for every regional endpoint.

Answer

Deploy Azure Traffic Manager with 'Performance' routing.

Answer

Configure 'Global VNet Peering' between model endpoints.

Question 14

You are implementing an agentic workflow using Azure AI Foundry. The agent needs to access a secure external API. How should you store the API key securely within the project?

Accepted Answer

Store the key in an 'Azure Key Vault' and reference it as a 'Connection' in the AI Project.. Azure AI Foundry provides a 'Connections' feature that allows storing credentials as secrets, which can then be referenced by agents.

Answer

Pass the key as an environment variable in the deployment YAML.

Answer

Hardcode the key in the prompt template.

Answer

Save the key in a local '.env' file in the code repository.

Question 15

You are troubleshooting high latency in a RAG-based application. The vector search is fast, but the generation phase is slow. Which component should be scaled?

Accepted Answer

Increase the 'Instances' count for the LLM deployment.. If the generation phase is slow, you likely need to scale the LLM inference endpoint (e.g., increasing instances or provisioned capacity).

Answer

Optimize the vector database index.

Answer

Reduce the 'temperature' setting.

Answer

Increase the 'Embedding Model' throughput.