AI-900 Describe features of generative AI workloads on Azure — 100 Questions

Question 1

A developer is using Azure OpenAI Service to generate product descriptions. They want the output to be highly focused and deterministic, with less randomness. Which parameter should they decrease?

Accepted Answer

Temperature. Temperature controls randomness in Azure OpenAI. Lowering the temperature parameter makes the output more focused and deterministic. Max tokens controls length, while presence and frequency penalties influence repetition rather than core randomness.

Answer

Max tokens

Answer

Presence penalty

Answer

Frequency penalty

Question 2

A quality assurance team at a software company uses Azure OpenAI Service to generate compliance reports. They need the model to produce the exact same output for a given prompt every time the API is called, to ensure reproducibility during testing. Which parameter should they set to achieve this deterministic behavior?

Accepted Answer

Set temperature to 0. Setting temperature to 0 forces the model to choose the most likely token at each step, eliminating randomness and producing deterministic outputs for the same prompt. This is essential for reproducibility in testing scenarios where identical results are required across API calls.

Answer

Set frequency penalty to 1

Answer

Set top_p to 1

Answer

Set max_tokens to the expected output length

Question 3

A marketing team uses Azure OpenAI Service to generate taglines for a new advertising campaign. They want the output to be more predictable and less surprising, sticking to the most common phrases and avoiding unusual combinations. Which parameter should they decrease?

Accepted Answer

Temperature. Temperature controls randomness by scaling token probabilities; decreasing it favors high-probability tokens. Top P (nucleus sampling) controls the cumulative probability threshold; decreasing it also restricts outputs to a smaller set of probable tokens. Both make output more conservative and predictable. The original explanation is misleading because reducing Top P also avoids unusual combinations.

Answer

Frequency penalty

Answer

Presence penalty

Question 4

A marketing team wants to use a generative AI model to produce social media posts that match their brand's specific tone and style. They have a small set of example posts written by their copywriters. Which approach should they use to customize the model's outputs without retraining the entire model?

Accepted Answer

Prompt engineering with carefully designed instructions. Prompt engineering, especially few-shot prompting, allows the model to match a desired tone and style by providing example posts in the instruction. It does not involve any training or weight updates, satisfying the 'without retraining' requirement. Fine-tuning (B) requires a large dataset and involves further training, which conflicts with the constraint. Grounding (C) adds context but does not effectively customize style, and content filtering (D) is for safety, not style.

Answer

Fine-tuning the model on the example posts

Answer

Grounding the model with a knowledge base of brand guidelines

Answer

Implementing a content filter to enforce brand rules

Question 5

A developer is using Azure OpenAI to generate code snippets for a banking application. The developer wants to minimize the risk that the generated code contains security vulnerabilities or malicious instructions, even if the prompt is ambiguous. Which Azure OpenAI feature should the developer configure to address this concern?

Accepted Answer

Use a specific system message that requests secure code. A system message guides the model to follow secure coding practices, directly addressing security vulnerabilities. Content filters are a safety layer for harmful content but are not designed to identify code-level vulnerabilities.

Answer

Set the temperature parameter to 0

Answer

Enable content filters

Answer

Set max_tokens to a low value

Question 6

What is grounding in the context of generative AI and Retrieval Augmented Generation (RAG)?

Accepted Answer

Connecting AI responses to verified information from a knowledge base to improve accuracy. Grounding in generative AI and RAG refers to the process of constraining a language model's output to information retrieved from a trusted, external knowledge base (e.g., Azure Cognitive Search, vector databases). This prevents the model from generating hallucinated or outdated content by anchoring its responses to verified facts, which is essential for enterprise applications requiring high accuracy.

Answer

Training an AI model from scratch on domain-specific data

Answer

Removing biases from a trained language model

Answer

Converting text responses into speech output

Question 7

A marketing team wants to use Azure AI to automatically generate unique product descriptions for thousands of items in an e-commerce catalog based on a few keywords provided by the inventory team. Which Azure service should they use?

Accepted Answer

A. Azure OpenAI Service. Azure OpenAI Service provides access to large language models (LLMs) like GPT-4, which are specifically designed for generative tasks such as creating unique, human-like text from a few input keywords. This makes it the ideal choice for automatically generating product descriptions at scale, as it can produce varied and contextually relevant content without requiring pre-labeled training data.

Answer

B. Azure Computer Vision

Answer

C. Language Understanding (LUIS)

Answer

D. Azure Machine Learning

Question 8

A company is developing a chatbot that can both answer customer questions in natural language and create images on demand (e.g., 'Generate a picture of a product prototype'). Which combination of Azure generative AI models should they integrate?

Accepted Answer

A. GPT-4 for text and DALL-E for images. GPT-4 is a generative AI model optimized for natural language understanding and generation, making it ideal for answering customer questions in a conversational manner. DALL-E is a generative AI model specifically designed to create images from textual descriptions, enabling the chatbot to generate product prototypes on demand. Together, they cover both text and image generation requirements.

Answer

B. GPT-3 for text and Custom Vision for images

Answer

C. BERT for text and OCR for images

Answer

D. Language Understanding (LUIS) and Face API

Question 9

A game development company uses Azure OpenAI Service to automatically generate in-game dialog for non-player characters (NPCs) based on character profiles. They need to ensure the generated text does not contain offensive language or harmful suggestions. Which Azure OpenAI Service feature should they configure to prevent this?

Accepted Answer

Content filters. Content filters in Azure OpenAI Service allow you to define categories of harmful content (e.g., hate, violence, self-harm) and set severity thresholds. When generating NPC dialog, the service automatically evaluates each output against these filters and blocks or flags any text that violates the configured policies, ensuring offensive language or harmful suggestions are prevented.

Answer

Model deployment

Answer

Token limit

Answer

Prompt engineering

Question 10

A company uses Azure OpenAI Service to generate marketing copy for social media posts. They want to prevent the model from producing content that contains offensive language, harmful stereotypes, or violent themes that go against their brand guidelines. Which feature should the company configure within Azure OpenAI Service?

Accepted Answer

Configuring the content filtering (responsible AI filters). B is correct because Azure OpenAI Service includes built-in content filtering (responsible AI filters) that automatically detects and blocks offensive language, harmful stereotypes, and violent themes in both input prompts and generated outputs. This feature enforces brand guidelines without requiring custom model modifications or manual oversight.

Answer

Fine-tuning the model with a custom dataset

Answer

Increasing the token limit per response

Answer

Using prompt engineering techniques

Question 11

A company uses Azure OpenAI Service to power a chat-based support assistant. They have extensive knowledge base documents that contain the correct information. The company wants the assistant to answer questions solely based on the provided documents and avoid generating plausible-sounding but incorrect information. Which approach should they implement to minimize the risk of such fabrications?

Accepted Answer

Retrieval Augmented Generation (RAG) — provide relevant document excerpts as context in the prompt. Retrieval Augmented Generation (RAG) is the correct approach because it grounds the model's responses in actual, retrieved document excerpts provided as context in the prompt. This ensures the assistant answers based solely on the supplied knowledge base, directly minimizing the risk of hallucination (plausible-sounding but incorrect information) by constraining the model to the retrieved facts.

Answer

Increase the temperature parameter to 1.0 to force more creative responses

Answer

Fine-tune the model on the knowledge base documents using supervised learning

Answer

Use prompt engineering with a system message that tells the model to never make up facts

Question 12

A marketing team uses Azure OpenAI Service to generate multiple variations of a product description from a single prompt. They want the generated descriptions to be more creative and diverse, rather than repetitive. Which parameter should they increase to achieve this?

Accepted Answer

Temperature. Increasing the Temperature parameter makes the model more creative and diverse by raising the randomness of token selection. At higher temperatures (e.g., 0.8–1.0), the model assigns more weight to less probable tokens, producing varied and unexpected outputs. This directly addresses the need for diverse product descriptions rather than repetitive ones.

Answer

Max tokens

Answer

Top probability

Answer

Frequency penalty

Question 13

A company uses Azure OpenAI Service to power an AI assistant that helps customers with product troubleshooting. The assistant must maintain the conversation history to provide contextually relevant answers across multiple turns. Which API endpoint should be used for this purpose?

Accepted Answer

Chat Completions API. The Chat Completions API is designed for multi-turn conversational scenarios because it accepts a list of messages with roles (system, user, assistant) that represent the conversation history. This allows the model to maintain context across multiple interactions, making it the correct choice for an AI assistant that needs to provide contextually relevant answers over several turns.

Answer

Completions API

Answer

Embeddings API

Answer

Fine-tuning

Question 14

A marketing agency wants to use Azure OpenAI Service to generate product descriptions that consistently match a client's distinctive brand voice. They have a collection of 50 sample descriptions written in the desired tone and style. Which Azure OpenAI Service capability should they use to specialize the model to produce text that closely matches this style?

Accepted Answer

Fine-tuning. Fine-tuning (C) is the correct choice because it allows the marketing agency to train the Azure OpenAI model on their 50 sample descriptions, adjusting the model's weights to specialize its output to match the client's distinctive brand voice. Unlike prompt engineering or parameter adjustments, fine-tuning creates a custom model that internalizes the style and tone from the provided examples, enabling consistent generation without needing lengthy instructions in every prompt.

Answer

Temperature parameter adjustment

Answer

Prompt engineering with detailed instructions

Answer

Content filtering

Question 15

A marketing team uses Azure OpenAI Service to generate headline ideas for a campaign. They find the generated headlines are often too similar and lack creativity. Which parameter should they increase to introduce more randomness in the generated text?

Accepted Answer

Temperature. (Temperature) is correct because temperature controls the randomness of token selection in the model's probability distribution. Increasing temperature (e.g., from 0.7 to 1.0) flattens the probability curve, making lower-probability tokens more likely to be chosen, which introduces more diversity and creativity in the generated headlines.

Answer

Frequency penalty

Answer

Top_p (nucleus sampling)

Answer

Presence penalty

Question 16

A game development studio uses Azure OpenAI Service to generate unique backstories for non-player characters (NPCs). They want the generated stories to be coherent and relevant to a given character class (e.g., warrior, mage) but also creative and varied. Which parameter should the studio adjust primarily to increase the creativity and variety of the generated text?

Accepted Answer

Increase the temperature parameter. Increasing the temperature parameter makes the model's output more random by scaling the probability distribution over tokens, which encourages less likely word choices and thus increases creativity and variety in generated text. For the game studio, a higher temperature (e.g., 0.8–1.0) will produce more diverse and imaginative backstories for different character classes, while still maintaining coherence if not set too high.

Answer

Increase the top_p parameter

Answer

Increase the frequency_penalty parameter

Answer

Decrease the max_tokens parameter

Question 17

A marketing team wants to use Azure OpenAI Service to generate product descriptions that consistently match a specific brand voice. They have a small set of example descriptions that demonstrate the desired tone. They want to adapt the model without retraining it from scratch. Which approach should they take?

Accepted Answer

Use prompt engineering with few-shot learning by including the example descriptions in the prompt. Prompt engineering with few-shot learning allows the model to infer the desired brand voice from the example descriptions included directly in the prompt, without requiring retraining. This approach leverages the model's in-context learning capability, where it adapts its output based on the provided examples while keeping the base model unchanged.

Answer

Fine-tune the base model on the example descriptions

Answer

Increase the temperature parameter to the maximum value

Answer

Train a new model using Azure Machine Learning

Question 18

A company uses Azure OpenAI Service to generate long technical reports. To manage costs, the development team needs to accurately estimate the number of tokens that a given prompt will consume before making any API call. Which Azure OpenAI Service feature should they use to obtain this estimate?

Accepted Answer

The Token Counter tool in Azure OpenAI Studio. The Token Counter tool in Azure OpenAI Studio is specifically designed to estimate the number of tokens a prompt will consume before making an API call. This allows developers to predict costs accurately by calculating token usage for both input and expected output, without incurring actual API charges.

Answer

The Chat Completions API

Answer

The Embeddings API

Answer

The Content Filter configuration

Question 19

A developer is using Azure OpenAI Service to generate product descriptions. They want the output to be highly focused and deterministic, with less randomness. Which parameter should they decrease?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Frequency penalty. The frequency penalty parameter reduces repetition by penalizing tokens that have already appeared in the generated text, making the model less likely to reuse the same functions or loops. Increasing this value directly discourages the model from generating repetitive patterns, which is exactly the issue described.

Answer

Temperature

Answer

Max tokens

Answer

Top P

Question 20

A marketing team uses Azure OpenAI Service to generate marketing copy. They notice the generated text is often repetitive, using the same phrases and words multiple times. Which parameter should they increase to directly reduce this repetition?

Accepted Answer

Frequency penalty. Frequency penalty directly reduces repetition by penalizing tokens that have already appeared in the generated text. A higher frequency penalty value (e.g., 0.5 to 1.0) decreases the likelihood of the model reusing the same phrases or words, making the output more diverse and less repetitive.

Answer

Temperature

Answer

Top-p

Answer

Max tokens