AI-300 Multiple Select — 40 Questions

Question 1

You need to implement a retraining trigger based on performance degradation. Which TWO metrics should you monitor to decide when to retrain?

Accepted Answer

Model prediction precision. Accuracy and precision are key performance indicators that signify model decay.

Answer

CPU usage of the inference cluster

Answer

Network latency

Answer

Number of active users

Question 2

You are optimizing your Azure ML pipeline performance. Which THREE steps should you take to reduce execution time?

Accepted Answer

Mount datasets instead of downloading them.. Caching (reuse), parallelizing steps, and using efficient data access methods are key.

Answer

Increase the number of workspaces.

Answer

Use smaller compute clusters for everything.

Question 3

Which THREE metrics can be logged during training to track performance in Azure ML?

Accepted Answer

Model accuracy.. Accuracy, loss, and custom metrics are standard loggable items.

Answer

Compute instance IP address.

Answer

Workspace subscription ID.

Question 4

To optimize the cost of your AI infrastructure, which THREE actions should you consider?

Accepted Answer

Deleting unused model deployments.. Choosing the right SKU, cleaning up unused deployments, and using reserved capacity are standard cost-optimization steps.

Answer

Deploying all models in every available region.

Answer

Always selecting the 'Premium' SKU.

Question 5

Which THREE items should you keep track of in your AI Foundry project to ensure good governance?

Accepted Answer

Quota usage.. Governance relies on tracking tags, role assignments, and quotas.

Answer

User passwords.

Answer

Personal browser history.

Question 6

Which TWO methods are best for debugging an LLM pipeline that fails on complex queries?

Accepted Answer

Inspecting raw input and output tokens via logs.. Prompt logging and trace inspection are the best ways to understand why a model fails on specific inputs.

Answer

Increasing the number of API users.

Answer

Disabling all security controls.

Answer

Deleting the deployment and rebuilding it.

Question 7

You are troubleshooting a failed agent deployment. Which TWO areas should you inspect first?

Accepted Answer

The endpoint availability status.. Deployment logs and endpoint connectivity are the primary sources for identifying deployment failures.

Answer

The Azure status page.

Answer

The user profile settings.

Answer

The billing usage report.

Question 8

Which TWO of the following can be used to manage Azure ML assets like environments and models?

Accepted Answer

Azure CLI v2. The Azure ML Studio UI and the CLI v2 are both primary interfaces for asset management.

Answer

Azure Monitor

Answer

Azure Logic Apps

Answer

Power BI

Question 9

Which THREE of the following are components of an Azure AI Foundry project?

Accepted Answer

Prompt Flows.. Models, connections, and prompt flows are foundational components within the AI Foundry project environment.

Answer

Azure Key Vault (the resource itself).

Answer

Azure Subscriptions.

Question 10

Which THREE metrics are critical for monitoring the health of a GenAI deployment?

Accepted Answer

Request Latency.. Latency, throughput (tokens per second), and error rates are the standard health metrics for AI deployments.

Answer

User email addresses.

Answer

CPU Usage of the host node.

Question 11

Which TWO of the following are valid ways to authenticate to an Azure AI Foundry project?

Accepted Answer

API Keys.. Entra ID (RBAC) and API Keys are the two primary methods for securing access to AI resources.

Answer

Hardcoded usernames in the code.

Answer

Local file-based passwords.

Answer

Public IP allow-listing only.

Question 12

Which TWO of the following are benefits of using Prompt Flow for orchestration?

Accepted Answer

Integrated testing and evaluation.. Prompt Flow offers a visual interface for complex flows and integrated evaluation, which simplifies orchestration.

Answer

Removal of the need for an LLM.

Answer

No need for authentication.

Answer

Automatic hardware management.

Question 13

Which TWO metrics are most useful for evaluating the 'User Experience' in a conversational agent?

Accepted Answer

Relevance. Latency and the quality of the answer (Relevance) are the primary drivers of user satisfaction.

Answer

Disk I/O speed

Answer

Model training loss

Answer

GPU voltage

Question 14

You are planning a production GenAI deployment. Which THREE of the following are necessary infrastructure considerations?

Accepted Answer

Implementing Private Link for network isolation.. Security, scalability, and monitoring are the three pillars of a production-ready AI infrastructure.

Answer

Using the cheapest SKU regardless of capacity.

Answer

Hardcoding credentials in the code.

Question 15

You are experiencing throttling on your AI endpoint. Which TWO steps should you take?

Accepted Answer

Check current usage against quota limits.. To resolve throttling, you need to either optimize usage or increase the available quota/capacity.

Answer

Disable all security features.

Answer

Change the model version to one that is faster but less smart.

Answer

Delete all existing deployments.

Question 16

Which THREE factors contribute to increased latency in an LLM application?

Accepted Answer

The size/complexity of the chosen model.. Model size, input/output token count, and network transit time are the main drivers of latency.

Answer

The number of system messages used.

Answer

The use of JSON output mode.

Question 17

You want to automate the scaling of your AI agent orchestration. Which TWO components do you need to configure?

Accepted Answer

Autoscale policies.. Auto-scaling is driven by metrics and defined by policies that govern instance counts.

Answer

A manual human-in-the-loop review.

Answer

Hardcoded instance counts.

Answer

Static IP addresses.

Question 18

Which TWO of the following are recommended methods for identifying 'hallucinations' in a RAG system?

Accepted Answer

Using an LLM-as-a-judge to compare against ground truth. Comparing output to source context (groundedness) and using a reference-based evaluation are standard methods.

Answer

Checking for grammatical errors

Answer

Measuring model response speed

Answer

Counting total prompt tokens

Question 19

Which THREE features does Azure AI Foundry provide to help developers?

Accepted Answer

Evaluation.. Model Catalog, Prompt Flow, and Evaluation are key developer-facing features in Azure AI Foundry.

Answer

Azure Active Directory creation.

Answer

Direct physical hardware access.

Question 20

When configuring a private endpoint for your Azure AI resource, which TWO of the following must be set up?

Accepted Answer

A virtual network with a dedicated subnet.. A private endpoint requires a target subnet and a private DNS zone for resolution.

Answer

A load balancer.

Answer

A firewall rule allowing all traffic.

Answer

A public IP address.