AI-300 Genaiops Infrastructure — 10 Questions

Question 1

To optimize token throughput for a high-traffic chatbot, you decide to enable 'Provisioned Throughput' for your Azure OpenAI deployment. What must you consider?

Accepted Answer

Use 'Azure Monitor' to view the 'Tokens Per Minute' metric.. Provisioned Throughput Units (PTUs) provide dedicated capacity, but they require a commitment to a specific throughput level which impacts cost and availability.

Answer

It can only be used with models deployed in the 'East US' region.

Answer

It automatically scales the number of tokens based on CPU usage.

Answer

Check the 'Quota' tab in the Azure Portal.

Answer

Enable 'Diagnostic Settings' for the Azure AI resource.

Answer

It is incompatible with 'Streaming' requests.

Answer

Query the 'ModelUsage' table in Log Analytics.

Question 2

You are managing a multi-region GenAI deployment using Azure AI Foundry. To reduce latency for global users, what routing architecture should you implement?

Accepted Answer

Use Azure Front Door to route traffic to the nearest regional AI Foundry endpoint.. Azure Front Door provides global HTTP load balancing and site acceleration, which is critical for reducing latency in geographically dispersed GenAI applications.

Answer

Implement 'Private Link' for every regional endpoint.

Answer

Deploy Azure Traffic Manager with 'Performance' routing.

Answer

Configure 'Global VNet Peering' between model endpoints.

Question 3

You are monitoring the cost of your GenAI infrastructure. You want to track usage per specific project. Which feature in Azure AI Foundry should you use?

Accepted Answer

Use 'Resource Tags' on the Azure AI project resource.. Tags are the standard mechanism in Azure for grouping resources and tracking costs associated with specific projects or teams.

Answer

Configure 'Cost Analysis' alerts in the Azure Portal.

Answer

Implement 'Azure Policy' to restrict resource types.

Answer

Switch to 'Pay-As-You-Go' subscription model.

Question 4

Your production agent application requires strict data isolation. You must ensure all requests to Azure OpenAI are routed through a private network. Which configuration is required?

Accepted Answer

Enable 'Public Network Access' set to 'Disabled' on the Azure AI resource.. To ensure traffic stays within the private network, you must configure Azure AI Services with Private Link and ensure all traffic is routed through a private endpoint.

Answer

Deploy the model inside a dedicated 'Azure Kubernetes Service' node pool.

Answer

Configure a 'Service Tag' for Azure OpenAI in the Firewall settings.

Answer

Add the 'Virtual Network' to the 'Allowed Subnets' in the AI Service.

Question 5

Your team is using Semantic Kernel for agent orchestration. You notice frequent transient errors when the agent interacts with multiple LLM services. How should you implement infrastructure-level resiliency?

Accepted Answer

Use an 'Azure API Management' policy to implement a retry pattern.. Implementing exponential backoff and retries via the 'RetryHandler' in the HttpClient factory or Semantic Kernel settings is the standard approach for infrastructure-level resiliency.

Answer

Disable the 'Streaming' flag in the agent request.

Answer

Switch the model to a higher tier instance type.

Answer

Increase the 'Timeout' parameter in the model deployment manifest.

Question 6

You need to audit all model access logs across your organization. What is the most effective approach?

Accepted Answer

Enable 'Diagnostic Settings' to send logs to a 'Log Analytics Workspace'.. Enabling diagnostic settings on the Azure AI Services resource to send logs to a Log Analytics workspace is the standard for organization-wide auditing.

Answer

Review individual request headers in the app logs.

Answer

Use 'Azure Advisor' to detect unauthorized access.

Answer

Download the 'Model Usage' report from the billing console.

Question 7

You are implementing an agentic workflow using Azure AI Foundry. The agent needs to access a secure external API. How should you store the API key securely within the project?

Accepted Answer

Store the key in an 'Azure Key Vault' and reference it as a 'Connection' in the AI Project.. Azure AI Foundry provides a 'Connections' feature that allows storing credentials as secrets, which can then be referenced by agents.

Answer

Pass the key as an environment variable in the deployment YAML.

Answer

Hardcode the key in the prompt template.

Answer

Save the key in a local '.env' file in the code repository.

Question 8

You are deploying a high-throughput Large Language Model on Azure AI Foundry. You need to ensure the underlying infrastructure supports rapid auto-scaling based on request latency. Which configuration should you prioritize in the deployment settings?

Accepted Answer

Configure the 'Scale' settings in the deployment to use a custom metric based on 'Request Latency'.. Auto-scaling for Azure AI Model Catalog deployments is managed via the 'Scale' tab, specifically targeting 'Instances' to handle request concurrency.

Answer

Enable 'Load Balancing' in the Azure AI Search resource.

Answer

Increase the 'Quota' of the underlying Azure subscription.

Answer

Set the minimum instance count to 0 in the deployment configuration.

Question 9

You need to ensure that your LLM responses are filtered for harmful content. Which infrastructure component provides this capability?

Accepted Answer

Azure AI Content Safety. Azure AI Content Safety is the integrated service used within AI Foundry to monitor and filter model outputs.

Answer

Azure Monitor

Answer

Azure Key Vault

Answer

Azure Bastion

Question 10

An agent orchestration system is timing out because it waits too long for tool output. How can you optimize the infrastructure handling of tool calls?

Accepted Answer

Implement 'Asynchronous' execution patterns for long-running tools.. Implementing tool-specific timeouts within the agent definition helps prevent long-running tasks from stalling the overall orchestration chain.

Answer

Increase the 'CPU count' on the hosting server.

Answer

Increase the 'Global Timeout' for the entire agent.

Answer

Reduce the 'System Prompt' size.