The answer is to decrease the temperature parameter. Lowering the temperature reduces the randomness of the model’s output, making it more deterministic and focused by forcing the selection of higher-probability tokens, which directly addresses the issue of overly verbose or off-topic responses in your trivia bot. On the Microsoft Azure AI Engineer Associate AI-102 exam, this concept tests your understanding of how to tune the temperature parameter in Azure OpenAI for response focus, often appearing in scenario-based questions where you must choose between adjusting temperature, top_p, or frequency penalty. A common trap is confusing temperature with top_p—remember that temperature controls the overall randomness curve, while top_p narrows the token pool. For a quick memory tip, think “cool it down to lock it down”: decreasing temperature cools the creative spark, locking the model onto the most relevant path.
AI-102 Plan and manage an Azure AI solution Practice Question
This AI-102 practice question tests your understanding of plan and manage an azure ai solution. Match the stated requirement to the specific cloud service, access model, or configuration option — many options are valid in isolation but not for this scenario. After answering, compare your reasoning against the explanation and wrong-answer breakdown below. Once you have made your selection, read the full explanation to reinforce the concept and understand why each distractor is designed to mislead on exam day.
Exhibit
{
"completions": [
{
"role": "user",
"content": "What is the capital of France?"
},
{
"role": "assistant",
"content": "The capital of France is Paris."
}
],
"max_tokens": 50,
"temperature": 0.7,
"top_p": 0.95
}
Refer to the exhibit. You are using Azure OpenAI to build a trivia bot. The bot responds correctly to simple questions but sometimes gives overly verbose or off-topic answers. Which parameter should you adjust to make responses more focused?
{
"completions": [
{
"role": "user",
"content": "What is the capital of France?"
},
{
"role": "assistant",
"content": "The capital of France is Paris."
}
],
"max_tokens": 50,
"temperature": 0.7,
"top_p": 0.95
}
A
Increase temperature
Why wrong: Increasing temperature makes responses more random and less focused.
B
Decrease top_p
Why wrong: Decreasing top_p can reduce randomness but temperature is more straightforward.
C
Increase max_tokens
Why wrong: Increasing max_tokens allows longer responses but does not improve focus.
D
Decrease max_tokens
Why wrong: Decreasing max_tokens cuts off responses but does not improve focus on the topic.
E
Decrease temperature
Lower temperature makes the model more deterministic and focused.
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Decrease temperature
Decreasing the temperature parameter reduces the randomness of the model's output, making it more deterministic and focused. For a trivia bot that gives overly verbose or off-topic answers, lowering temperature (e.g., from 0.7 to 0.3) forces the model to choose higher-probability tokens, which typically correspond to more concise and relevant responses.
Key principle: Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
✗
Increase temperature
Why it's wrong here
Increasing temperature makes responses more random and less focused.
✗
Decrease top_p
Why it's wrong here
Decreasing top_p can reduce randomness but temperature is more straightforward.
✗
Increase max_tokens
Why it's wrong here
Increasing max_tokens allows longer responses but does not improve focus.
✗
Decrease max_tokens
Why it's wrong here
Decreasing max_tokens cuts off responses but does not improve focus on the topic.
✓
Decrease temperature
Why this is correct
Lower temperature makes the model more deterministic and focused.
Related concept
Read the scenario before looking for a memorised answer.
Common exam traps
Common exam trap: answer the scenario, not the keyword
Microsoft often tests the misconception that max_tokens controls response focus, but candidates must understand that max_tokens only limits length, not content relevance, while temperature directly influences the model's creativity and adherence to the prompt.
Detailed technical explanation
How to think about this question
Temperature controls the softmax distribution over token probabilities: lower values (e.g., 0.1) sharpen the distribution, making the model almost greedy, while higher values (e.g., 1.0) flatten it, increasing diversity. In practice, for factual QA tasks like trivia, temperatures below 0.5 are common to reduce hallucination and tangential responses. The top_p parameter works alongside temperature but operates by dynamically selecting a cumulative probability threshold (e.g., 0.9) and sampling only from that set, which can still allow diverse tokens if the distribution is flat.
KKey Concepts to Remember
Read the scenario before looking for a memorised answer.
Find the constraint that changes the correct option.
Eliminate answers that are true in general but not in this case.
TExam Day Tips
→Watch for words such as best, first, most likely and least administrative effort.
→Review why wrong options are wrong, not only why the correct option is correct.
Key takeaway
Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Real-world example
How this comes up in practice
A cloud solutions architect for a retail company is evaluating services for a new workload. The correct answer here reflects best practice for the specific scenario described — not a general cloud recommendation. Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option. Cloud exam questions reward reading the constraint carefully: the same technology can be right or wrong depending on the use case.
What to study next
Got this wrong? Here's your next step.
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
Plan and manage an Azure AI solution — This question tests Plan and manage an Azure AI solution — Read the scenario before looking for a memorised answer..
What is the correct answer to this question?
The correct answer is: Decrease temperature — Decreasing the temperature parameter reduces the randomness of the model's output, making it more deterministic and focused. For a trivia bot that gives overly verbose or off-topic answers, lowering temperature (e.g., from 0.7 to 0.3) forces the model to choose higher-probability tokens, which typically correspond to more concise and relevant responses.
What should I do if I get this AI-102 question wrong?
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
What is the key concept behind this question?
Read the scenario before looking for a memorised answer.
About these practice questions
Courseiva creates original exam-style practice questions with explanations and wrong-answer analysis. It does not publish real exam questions, exam dumps, or protected exam content. Learn why practice questions differ from exam dumps →
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
This AI-102 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-102 exam.
Question Discussion
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
Sign in to join the discussion.