AI-102 Implement generative AI solutions Practice Test 8 — 15 Questions

Question 1

You are building a conversational AI system using Azure OpenAI Service. The system must maintain context across multiple user turns. Which parameter determines how many previous messages are considered for the next response?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

The length of the messages array in the API call. The Azure OpenAI Service API uses a `messages` array in the request body to represent the conversation history. Each entry in this array corresponds to a previous turn (with roles like 'user', 'assistant', or 'system'), and the length of this array directly determines how many prior messages are considered when generating the next response. By including more messages, you extend the context window; by truncating the array, you limit it.

Answer

max_tokens

Answer

temperature

Answer

top_p

Question 2

You have configured a system message for an Azure OpenAI chat completion deployment as shown in the exhibit. Users are reporting that the assistant sometimes refuses to answer questions that are clearly within the scope of the provided data. What is the most likely issue?

Accepted Answer

The system message encourages the model to err on the side of caution, leading to false-negative refusals.. The system message likely contains overly cautious language (e.g., 'only answer if you are certain' or 'do not speculate'), which causes the model to refuse answering even when the data clearly supports the response. This is a known behavior in Azure OpenAI chat completions where the system message's tone and constraints directly influence refusal rates, leading to false-negative refusals.

Answer

The system message explicitly prohibits making up information, which is correct behavior.

Answer

The system message does not include instructions to use the provided data.

Answer

The temperature parameter is set too high, causing the model to hallucinate.

Question 3

You are implementing a generative AI solution using Azure OpenAI. You need to ensure that the model's outputs do not contain certain inappropriate words or phrases. Which feature should you configure?

Accepted Answer

Content filters. Content filters in Azure OpenAI are specifically designed to detect and block inappropriate words or phrases in both prompts and completions. They operate at the service level, applying configurable severity thresholds for categories like hate, violence, sexual content, and self-harm, ensuring model outputs adhere to policy without requiring prompt engineering or data modifications.

Answer

System message instructions

Answer

Grounding with your data

Answer

Max tokens limit

Question 4

You run the Azure CLI command shown in the exhibit. After a few minutes, the deployment fails with a quota error. What is the most likely cause?

Accepted Answer

The requested capacity of 10 exceeds the available quota for the gpt-4 model in that region.. The quota error indicates that the requested capacity (10 units) for the gpt-4 model exceeds the available quota in the target region. Azure OpenAI deployments require sufficient model-specific quota, which is region- and model-specific. The error is not related to SKU name validity, model version deprecation, or resource group existence.

Answer

The SKU name 'Standard' is invalid for Azure OpenAI deployments.

Answer

The model version '0613' is deprecated and no longer available.

Answer

The resource group name 'myResourceGroup' does not exist.

Question 5

You are using Azure OpenAI to generate product descriptions. You notice that the descriptions are often too similar to each other. Which parameter should you adjust to increase diversity?

Accepted Answer

Increase the temperature value.. Increasing the temperature parameter makes the model more creative by raising the probability of sampling lower-probability tokens, which increases diversity in the generated text. A higher temperature (e.g., 0.9) flattens the probability distribution, so the model is less likely to always pick the most probable next word, resulting in more varied outputs.

Answer

Decrease the top_p value.

Answer

Increase the max_tokens value.

Answer

Increase the frequency_penalty value.

Question 6

You are designing a generative AI solution using Azure OpenAI Service with your own data indexed in Azure AI Search. Which THREE components are essential for the retrieval-augmented generation (RAG) pattern?

Accepted Answer

Data ingestion pipeline to Azure AI Search. A data ingestion pipeline is essential to load and index your data into Azure AI Search, enabling the retrieval step in RAG. Without this pipeline, the search index would have no data to query, breaking the retrieval-augmented generation pattern.

Answer

Azure Functions for orchestration

Answer

Azure API Management for rate limiting

Question 7

You are deploying a chat application using Azure OpenAI. The application should only answer questions based on a specific set of internal documents. Which THREE features should you use?

Accepted Answer

Azure AI Search index with the internal documents. Azure AI Search indexes allow you to ingest internal documents and perform vector or hybrid search over them. When integrated with Azure OpenAI, the search results are used as grounding context for the model, ensuring responses are based solely on your data.

Answer

Content filters to block out-of-domain questions

Answer

Fine-tuning the model on the internal documents

Question 8

You are testing an Azure OpenAI chat completion. The response shown in the exhibit is returned. What does the finish_reason of 'content_filter' indicate?

Accepted Answer

The model's response was blocked by the content filter.. The 'content_filter' finish_reason indicates that the Azure OpenAI content filtering system detected that the model's generated response violated one of the configured content policies (e.g., hate, violence, self-harm, sexual content). The response was therefore blocked before being returned to the user, and the finish_reason explicitly signals this filtering action rather than a normal completion or a stop due to token limits.

Answer

There was a system error during processing.

Answer

The user's prompt was flagged by the content filter.

Answer

The model refused to answer due to insufficient data.

Question 9

You have deployed a chatbot using Azure OpenAI with a system message as shown. The chatbot sometimes provides incorrect answers that are not supported by the sources. What is the most likely cause?

Accepted Answer

The system message does not guarantee grounding; the model may still hallucinate.. A system message in Azure OpenAI provides instructions and context but does not enforce factual grounding. The model can still generate responses that are not supported by the provided sources (hallucination), especially if the system message is not explicitly designed to restrict the model to only use the given data. Grounding requires additional techniques like retrieval-augmented generation (RAG) or explicit constraints in the prompt.

Answer

Content filters are incorrectly configured, allowing harmful content.

Answer

The data ingestion pipeline has errors, so the sources are not available.

Answer

The temperature parameter is too low, causing repetitive answers.

Question 10

You are developing a solution that uses Azure OpenAI to generate customer support responses. You want to prevent the model from repeating the same phrases. Which parameter should you adjust?

Accepted Answer

frequency_penalty. The frequency_penalty parameter (option D) is correct because it directly reduces the likelihood of the model repeating the same phrases by penalizing tokens that have already appeared in the generated text. A higher frequency_penalty value (e.g., 0.5 to 1.0) decreases the probability of reusing tokens, making the output more diverse and less repetitive. This is specifically designed to address repetition in generative AI responses.

Answer

top_p

Answer

presence_penalty

Answer

temperature

Question 11

You are developing a chat application that uses Azure OpenAI Service to answer customer queries. The solution must ensure that the model does not generate harmful or offensive content. Which Azure AI service should you configure?

Accepted Answer

Azure AI Content Safety. Azure AI Content Safety is specifically designed to detect and filter harmful or offensive content in text and images, making it the appropriate service to integrate with an Azure OpenAI chat application to enforce content safety policies. It provides APIs for content moderation, including severity-based filtering for hate, self-harm, sexual, and violence categories, which directly addresses the requirement to prevent the model from generating harmful output.

Answer

Azure AI Bot Service

Answer

Azure AI Search

Answer

Azure AI Language

Question 12

You are deploying a generative AI application using Azure OpenAI Service. The application must generate responses in multiple languages while maintaining high accuracy. You need to minimize token usage. Which approach should you recommend?

Accepted Answer

Use a base model with a system message to output in the desired language. Azure OpenAI Service base models (e.g., GPT-4) natively support multilingual generation via a system message that sets the desired output language. This approach avoids the overhead of translation pipelines or fine-tuning, directly minimizing token usage while maintaining high accuracy through the model's inherent multilingual capabilities.

Answer

Translate all input to English and then translate output back

Answer

Fine-tune a model for each target language

Answer

Use a separate deployment for each language

Question 13

You are building a generative AI solution using Azure OpenAI Service. The application must retrieve information from a large private knowledge base. You need to ensure the model uses only relevant documents from the knowledge base to generate answers. Which feature should you configure?

Accepted Answer

Use Azure OpenAI On Your Data with vector search. B is correct because Azure OpenAI On Your Data with vector search enables the model to retrieve only the most semantically relevant documents from a private knowledge base by converting both the user query and the documents into high-dimensional vectors and performing similarity search. This ensures the model's responses are grounded in the specific, relevant information without exposing the entire knowledge base to the model.

Answer

Implement a custom prompt flow

Answer

Configure a content filter

Answer

Fine-tune the model with the knowledge base

Question 14

You are using Azure OpenAI Service to generate product descriptions. The output is often too verbose. You need to reduce the length of generated text without changing the model. Which parameter should you adjust?

Accepted Answer

Max tokens. Max tokens controls the total length of the generated response by capping the number of tokens (words/subwords) the model can output. Reducing this value directly truncates the output, making descriptions shorter without altering the model or its behavior. Other parameters influence randomness or repetition but do not enforce a strict length limit.

Answer

Frequency penalty

Answer

Temperature

Answer

Top-p (nucleus sampling)

Question 15

You are using Azure OpenAI Service to summarize customer emails. The summaries must be concise and contain only key information. Which prompt engineering technique should you apply?

Accepted Answer

Use few-shot prompting with examples of desired summaries. Few-shot prompting is the correct technique because it provides the model with explicit examples of desired input-output pairs (e.g., a verbose email and its concise summary). This guides the model to learn the exact format, tone, and level of detail required for the summaries, which is critical for consistency in a production summarization pipeline. Without examples, the model may default to its training distribution and produce overly verbose or irrelevant output.

Answer

Use chain-of-thought prompting

Answer

Use zero-shot prompting with a one-sentence instruction

Answer

Use negative prompting to avoid verbose output