AI-102 Implement generative AI solutions Practice Test 8 — 15 Questions

Question 1

You deploy a chat application using Azure OpenAI Service. Users report that the model sometimes generates inappropriate content. You need to implement a safety system that can be customized for your organization's policies. What should you use?

Accepted Answer

Use Azure AI Content Safety with custom categories and severity thresholds. Option D is correct because Azure AI Content Safety provides customizable content filters that can be tailored to organizational policies. Option A is wrong because Azure AD provides authentication, not content filtering. Option B is wrong because while it has some safety, it is not as customizable as Content Safety. Option C is wrong because responsible AI templates are guidelines, not a deployable filter.

Answer

Use the content filter system in Azure OpenAI Studio

Answer

Apply responsible AI templates from Azure AI Studio

Answer

Configure Microsoft Entra ID Conditional Access policies

Question 2

Your organization uses Azure OpenAI Service with a data source configured as 'Azure OpenAI on your data'. You notice that the responses include outdated information even though the underlying data source has been updated. What is the most likely cause?

Accepted Answer

The index in Azure Cognitive Search has not been refreshed. When using Azure OpenAI Service with 'Azure OpenAI on your data', the responses are generated by querying an Azure Cognitive Search index that contains your data. If the underlying data source has been updated but the responses still include outdated information, the most likely cause is that the index in Azure Cognitive Search has not been refreshed to reflect those updates. The model itself does not store or cache the data; it relies on the index at query time, so an outdated index directly leads to outdated responses.

Answer

The model is using a cached version of the prompt

Answer

The data source is configured to sync only daily

Answer

The Azure CDN is caching the responses

Question 3

You need to provide a generative AI solution that can answer questions based on a large set of PDF documents stored in Azure Blob Storage. The solution must support natural language queries and return citations from the documents. Which Azure service combination should you use?

Accepted Answer

Azure Cognitive Search and Azure OpenAI Service with 'on your data'. Option C is correct because Azure Cognitive Search indexes the PDFs and Azure OpenAI on your data uses that index to answer with citations. Option A is wrong because Form Recognizer is for extraction, not Q&A. Option B is wrong because Azure ML is for training, not search. Option D is wrong because Azure AI Bot Service alone doesn't index documents.

Answer

Azure Machine Learning and Azure Kubernetes Service

Answer

Azure AI Bot Service and Azure Functions

Answer

Azure AI Document Intelligence and Azure AI Translator

Question 4

Which TWO are valid ways to manage cost when using Azure OpenAI Service in a production application?

Accepted Answer

Use a smaller model like GPT-3.5-turbo instead of GPT-4 for simpler tasks. Option C is correct because using a smaller model like GPT-3.5-turbo for simpler tasks directly reduces the per-token cost compared to GPT-4, which is significantly more expensive. Azure OpenAI Service charges based on model tier and token usage, so selecting the appropriate model for the task complexity is a primary cost management strategy.

Answer

Fine-tune the model to reduce the number of examples needed in prompts

Answer

Increase the temperature parameter to 1.0

Answer

Provision more PTUs to get a lower rate per token

Question 5

Which THREE components are required to build a custom copilot using Microsoft Copilot Studio that can answer questions from a SharePoint document library?

Accepted Answer

A Microsoft Copilot Studio copilot. Options A, C, and E are correct. A copilot is needed as the interface. SharePoint must be configured as a data source. A knowledge source (cognitive search) enables indexing and retrieval. Option B is wrong because Azure OpenAI is not required; Copilot Studio uses its own AI. Option D is wrong because Power Automate is not required for basic Q&A.

Answer

A Power Automate flow to trigger the copilot

Answer

An Azure OpenAI Service deployment

Question 6

Which TWO statements about Azure OpenAI Service content filters are true?

Accepted Answer

They can be configured with severity levels (low, medium, high). Option A is correct because Azure OpenAI Service content filters can be configured with severity levels (low, medium, high) to control the strictness of filtering for each content category. This allows administrators to fine-tune the filter sensitivity based on their application's risk tolerance and compliance requirements.

Answer

They only filter the output of the model

Answer

They cannot be customized for specific use cases

Answer

They are bypassed when using PTU deployments

Question 7

You are building a chatbot for a retail company using Azure OpenAI Service. The chatbot must provide product recommendations based on customer preferences. To ensure the chatbot does not generate harmful or inappropriate responses, you need to implement a content filtering solution. What should you use?

Accepted Answer

Azure OpenAI Service content filtering. Azure OpenAI Service content filtering is the correct choice because it provides built-in, configurable filters that block harmful or inappropriate content at the model level, directly within the Azure OpenAI endpoint. This ensures that the chatbot's product recommendations remain safe without requiring external services, as the filtering is applied to both input prompts and output completions based on severity levels for categories like hate, violence, and self-harm.

Answer

Azure AI Content Safety

Answer

Azure AI Search

Answer

Microsoft Purview Information Protection

Question 8

You are deploying a generative AI solution using Azure OpenAI Service. The solution must comply with data residency requirements that mandate all data processing and storage remain within a specific geographic region. You need to configure the service to meet these requirements. What should you do?

Accepted Answer

Deploy the Azure OpenAI Service resource in the required region. Option B is correct because deploying the Azure OpenAI Service resource in the required region ensures data processing and storage stay within that region. Option A is wrong because data residency is determined by the region of the resource, not the model. Option C is wrong because data residency is not related to the content filtering configuration. Option D is wrong because the resource endpoint is region-specific but does not affect data residency.

Answer

Use a custom endpoint that routes traffic to the required region

Answer

Select a model that is only available in the required region

Answer

Configure content filtering to block data leaving the region

Question 9

You are developing a generative AI application that uses Azure OpenAI Service to summarize large documents. The application experiences high latency when processing requests. You need to reduce the latency without changing the model. What should you do?

Accepted Answer

Reduce the max_tokens parameter in the API request. Reducing the max_tokens parameter limits the length of the generated response, which directly reduces the processing time required by the Azure OpenAI Service to produce the output. Since latency is caused by the model generating a long sequence of tokens, capping the output tokens decreases the number of autoregressive decoding steps, thereby lowering response time without altering the underlying model.

Answer

Increase the temperature parameter

Answer

Increase the top_p parameter

Answer

Increase the max_tokens parameter

Question 10

You are using Azure OpenAI Service to generate code snippets for a development team. You notice that the generated code sometimes contains security vulnerabilities. You need to minimize the risk of generating insecure code while maintaining productivity. What should you do?

Accepted Answer

Use system messages to instruct the model to prioritize security. Option D is correct because system messages set the behavior of the model, instructing it to prioritize security. Option A is wrong because disabling content filtering would not address security vulnerabilities. Option B is wrong because fine-tuning requires labeled data and may not be practical. Option C is wrong because temperature affects creativity, not security.

Answer

Fine-tune the model on a dataset of secure code

Answer

Set the temperature parameter to 0

Answer

Disable content filtering to allow more flexibility

Question 11

You are building a customer support chatbot using Azure OpenAI Service. The chatbot must only answer questions related to the company's products and policies. It should refuse to answer off-topic questions. You need to implement this restriction effectively. What should you do?

Accepted Answer

Implement Retrieval Augmented Generation (RAG) with your product and policy data. Option A is correct because Retrieval Augmented Generation (RAG) grounds the model's responses in your specific product and policy data by retrieving relevant documents from a vector database (e.g., Azure Cognitive Search) and injecting them into the prompt. This ensures the chatbot can only answer questions that have matching context in your data, and it naturally refuses off-topic queries because no relevant documents are retrieved, allowing the system to return a default refusal message. RAG provides a dynamic, data-driven boundary without modifying the underlying model.

Answer

Fine-tune the model on a dataset of product-related conversations

Answer

Use a system message that instructs the model to stay on topic

Answer

Set the temperature parameter to 0 to reduce randomness

Question 12

You are deploying a generative AI solution using Azure OpenAI Service. You need to monitor the usage and costs associated with the service. What should you use?

Accepted Answer

Azure Monitor. Azure Monitor is the correct choice because it provides detailed metrics, logs, and alerts for Azure OpenAI Service usage, including token consumption, request counts, and latency. This data is essential for tracking costs and usage patterns, as Azure OpenAI charges based on tokens processed. Azure Monitor integrates directly with the service to surface these operational metrics.

Answer

Microsoft Purview

Answer

Azure Advisor

Answer

Azure Cost Management

Question 13

You are using Azure OpenAI Service to generate marketing copy. The marketing team reports that the generated content sometimes contains factual inaccuracies. You need to improve the factual accuracy of the generated content. What should you do?

Accepted Answer

Include relevant context and facts in the prompt. Option B is correct because providing relevant context in the prompt gives the model factual information to base its response on. Option A is wrong because reducing temperature does not improve factual accuracy. Option C is wrong because increasing max_tokens does not improve accuracy. Option D is wrong because disabling content filtering does not address inaccuracies.

Answer

Increase the max_tokens parameter

Answer

Decrease the temperature parameter

Answer

Disable content filtering

Question 14

You are building a generative AI application that uses Azure OpenAI Service. The application must handle sensitive user data and comply with GDPR. You need to ensure that the service does not store or log user prompts and completions. What should you configure?

Accepted Answer

Disable data logging in the Azure OpenAI Service resource. Option C is correct because disabling data logging in the Azure OpenAI Service resource ensures that prompts and completions are not stored. Option A is wrong because the region does not affect logging. Option B is wrong because content filtering does not prevent logging. Option D is wrong because the resource endpoint does not affect logging.

Answer

Deploy the resource in a GDPR-compliant region

Answer

Configure content filtering to block sensitive data

Answer

Use a custom endpoint that anonymizes data

Question 15

You are developing a generative AI solution that uses Azure OpenAI Service. You need to control the creativity of the generated responses. Which parameter should you adjust?

Accepted Answer

temperature. Option B is correct because the temperature parameter controls the randomness of the output. Option A is wrong because max_tokens controls output length. Option C is wrong because top_p is another randomness parameter, but temperature is more direct. Option D is wrong because frequency_penalty reduces repetition.

Answer

top_p

Answer

max_tokens

Answer

frequency_penalty