AI-300 Practice Test 2 — 25 Questions

Question 1

You are debugging a prompt that is performing poorly on edge cases. You decide to use a 'Chain-of-Thought' approach. Why does this improve performance?

Accepted Answer

It enables the model to break down complex logic into sequential steps.. Chain-of-Thought (CoT) prompting instructs the model to produce intermediate reasoning steps before the final answer, which improves accuracy on multi-step logic, arithmetic, and edge cases by giving the model more compute and context to work through ambiguity. This sequential decomposition is why CoT helps on problems where a direct answer would skip critical reasoning.

Answer

It bypasses the safety alignment layer.

Answer

It forces the model to use more input tokens, reducing costs.

Answer

It reduces the context window size.

Question 2

Which TWO metrics are most useful for evaluating the 'User Experience' in a conversational agent?

Accepted Answer

Relevance. Relevance (A) is a core user-experience metric for a conversational agent because it measures whether the agent's responses actually address the user's intent, which directly determines perceived usefulness and satisfaction. Latency (C) is equally essential since response time governs conversational flow; high latency makes interactions feel sluggish and breaks the natural turn-taking users expect. Disk I/O speed (B) is an infrastructure metric that affects backend performance but is not a direct measure of how users experience the conversation. Model training loss (D) is an offline optimization signal describing how well the model fits training data, not the quality of live interactions. GPU voltage (E) is a hardware-level electrical measurement with no bearing on conversational user experience.

Answer

Disk I/O speed

Answer

Model training loss

Answer

GPU voltage

Question 3

Which THREE of the following represent lifecycle stages of an ML model in Azure ML?

Accepted Answer

Training. Training (A) is a correct lifecycle stage because it is the phase where Azure ML runs a training script/job on compute to fit model parameters and produce a model artifact. Registration (C) is correct because the trained model is registered in the Azure ML workspace model registry, giving it a versioned, named asset that can be tracked and consumed downstream. Deployment (D) is correct because the registered model is then deployed to an endpoint (e.g., ACI/AKS/managed online endpoint) for real-time or batch inference, completing the operational lifecycle. Data Cleaning (B) is a data-preparation activity rather than a distinct ML model lifecycle stage in Azure ML, and Policy Enforcement (E) is a governance/compliance concern, not a model lifecycle stage.

Answer

Data Cleaning

Answer

Policy Enforcement

Question 4

You notice your model deployment status is 'Succeeded' but inference requests are failing. Where should you first check for connectivity issues?

Accepted Answer

The 'Endpoints' tab in Azure AI Foundry. The 'Endpoints' view in the AI Foundry project shows the connectivity status and endpoint URLs for the model.

Answer

The 'Keys' tab in the Azure Portal

Answer

Azure Subscription usage reports

Answer

Azure Storage Account logs

Question 5

Your team wants to perform 'Red Teaming' on your application. Which activity describes this process correctly?

Accepted Answer

Controlled adversarial testing to find safety and security gaps. Red Teaming involves adversarial testing to find edge cases, safety flaws, and security vulnerabilities.

Answer

Unit testing code snippets

Answer

Automated performance testing for latency

Answer

A/B testing two different model versions

Question 6

A developer is troubleshooting an agent that is failing to connect to an external tool. Which THREE of the following infrastructure settings should be verified?

Accepted Answer

The Azure AI Foundry 'Connections' configuration for the specific tool.. Option A is correct because the Azure AI Foundry 'Connections' configuration defines the endpoint, authentication, and credentials the agent uses to reach an external tool, so a misconfigured connection would directly cause connection failures. Option B is correct because the Prompt Flow runtime relies on environment variables (for example API keys, endpoint URLs, or proxy settings) to authenticate and route requests to external tools, and missing or incorrect values break connectivity. Option E is correct because outbound traffic from the runtime must be permitted by Network Security Group rules; if the NSG blocks the destination port or IP, the agent cannot establish the connection. Option C is not relevant because the Azure Resource Group location is a metadata/placement attribute and does not govern outbound connectivity or tool authentication. Option D is not relevant because the LLM model version affects model behavior and output quality, not the network or credential path used to connect to an external tool.

Answer

The Azure Resource Group location.

Answer

The model version of the LLM.

Question 7

You need to detect 'jailbreak' attempts in your RAG application. You are implementing a custom evaluation pipeline. Which technique is most effective for identifying adversarial inputs designed to bypass system instructions?

Accepted Answer

Adversarial input classification using a dedicated judge model. Adversarial evaluation using a 'jailbreak' detection model or prompt-based evaluation is the standard approach to identify bypass attempts.

Answer

Token usage tracking

Answer

Latency threshold monitoring

Answer

Semantic similarity scoring

Question 8

You are onboarding a team to Azure AI Foundry. You need to assign the minimum permissions for a developer to deploy and test a model. Which role should you assign?

Accepted Answer

Azure AI Developer. The 'Azure AI Developer' role provides sufficient permissions to manage resources and perform model deployments within the project.

Answer

Owner

Answer

Reader

Answer

Contributor

Question 9

What is the primary function of a 'Prompt Template' in an Azure AI Prompt Flow?

Accepted Answer

To define the structure of the prompt with dynamic inputs. A prompt template allows users to define the structure of the prompt while injecting dynamic variables.

Answer

To cache previous responses

Answer

To perform load balancing

Answer

To automatically retrain the model

Question 10

What is the primary benefit of 'Prompt Versioning' in an MLOps lifecycle?

Accepted Answer

It ensures reproducibility and enables easy rollbacks. Prompt versioning ensures reproducibility by tracking changes to prompts over time, allowing you to revert to a previous version if a new prompt degrades performance. It also enables easy rollbacks, which is critical in MLOps for maintaining stable production systems. It does not directly affect training speed, evaluation necessity, or test generation.

Answer

It increases model training speed

Answer

It eliminates the need for evaluation

Answer

It automatically generates unit tests

Question 11

You are planning a production GenAI deployment. Which THREE of the following are necessary infrastructure considerations?

Accepted Answer

Implementing Private Link for network isolation.. Security, scalability, and monitoring are the three pillars of a production-ready AI infrastructure.

Answer

Using the cheapest SKU regardless of capacity.

Answer

Hardcoding credentials in the code.

Question 12

What is the purpose of a 'System-Assigned Managed Identity' in the context of an Azure AI project?

Accepted Answer

To provide a secure identity for the resource to interact with other Azure services.. Managed identities allow the project or compute resource to securely access other Azure resources (like Key Vault or storage) without managing explicit credentials.

Answer

To automatically encrypt all data in transit.

Answer

To allow users to log in to the project portal.

Answer

To provide public IP connectivity.

Question 13

You want to automate the scaling of your AI agent orchestration. Which TWO components do you need to configure?

Accepted Answer

Autoscale policies.. Auto-scaling is driven by metrics and defined by policies that govern instance counts.

Answer

A manual human-in-the-loop review.

Answer

Hardcoded instance counts.

Answer

Static IP addresses.

Question 14

When using Prompt Flow for GenAI, where should you store your evaluation results to visualize them over time?

Accepted Answer

Azure Machine Learning workspace. Prompt Flow logs evaluation runs to the Azure Machine Learning workspace, where they can be viewed in the Runs tab.

Answer

GitHub repository

Answer

Azure Blob Storage

Answer

Local file system

Question 15

You are configuring a CI/CD pipeline for model deployment. Which THREE actions must you perform to ensure model traceability?

Accepted Answer

Register the model in the Azure ML Model Registry with versioning. Option B is correct because registering the model in the Azure ML Model Registry with versioning creates an immutable, uniquely identifiable record (name:version) that links each deployed artifact to its exact lineage, enabling rollback and audit. Option C is correct because adding experiment tags to the model artifact attaches metadata such as run ID, dataset version, and git commit, which are queryable and provide the contextual provenance needed to trace a model back to its training experiment. Option E is correct because storing the training script hash in the model properties creates a cryptographic fingerprint that proves which exact code produced the model, ensuring reproducibility and detecting any drift between the deployed model and its source code. Option A is not appropriate because a shared local folder is not versioned, not immutable, and not accessible across pipeline agents, so it cannot guarantee traceability. Option D is incorrect because deleting training logs destroys the audit trail and provenance evidence required for traceability.

Answer

Use a shared local folder for model artifacts

Answer

Delete all training logs after deployment

Question 16

You are managing a multi-workspace environment. You need to restrict the ability to create new compute clusters to only specific users. Where should you apply this control?

Accepted Answer

Azure RBAC on the Workspace. RBAC (Role-Based Access Control) at the workspace level determines which users can interact with compute resources.

Answer

Network Security Group

Answer

Azure Storage Access Policies

Answer

Azure ML Datastore configuration

Question 17

In Azure ML, what is a 'Component'?

Accepted Answer

A reusable pipeline step. A component is a reusable, versioned building block for an ML pipeline.

Answer

A storage account

Answer

A user role

Answer

A physical server

Question 18

Which Azure feature is used to define infrastructure as code for your Azure ML workspace?

Accepted Answer

Azure Bicep. Azure Bicep is the recommended tool for defining and deploying Azure resources as code.

Answer

Azure Portal

Answer

PowerShell

Answer

Azure CLI

Question 19

You want to automate the testing of your prompt flows as part of your CI/CD pipeline. Which tool should you use?

Accepted Answer

Prompt Flow CLI. The 'pf' (Prompt Flow) CLI is designed to run flows and evaluations programmatically in CI/CD pipelines.

Answer

Azure Logic Apps

Answer

Azure Functions

Answer

Azure AI Search test console

Question 20

Which THREE steps are necessary to successfully fine-tune an Azure OpenAI model?

Accepted Answer

Prepare and upload a training dataset in JSONL format.. Option B is correct because Azure OpenAI fine-tuning requires a training dataset uploaded as a JSONL file with chat-completion formatted examples (messages with role/content pairs), which the service uses to adapt the model. Option D is correct because you must choose a base model that supports fine-tuning (for example gpt-35-turbo, gpt-4o-mini, or babbage-002/davinci-002) and that is available in the region where you create the fine-tune job. Option E is correct because after submitting the fine-tuning job you track its status and metrics (training loss, token usage, and completion state) via the Azure OpenAI Studio or the REST API, and you only deploy the resulting model once the job succeeds. Option A is not needed because Azure OpenAI manages the weight updates internally; you never edit model weights in code. Option C is not required because content filtering is a separate safety configuration and disabling the input filter is neither necessary nor recommended for fine-tuning.

Answer

Manually update the model weights in the code.

Answer

Disable the input filter in the portal.