AI-900 Practice Question: Describe features of generative AI workloads on Azure
What is the 'frequency penalty' parameter in Azure OpenAI API calls?
⚠ Common exam trap
It's easy for candidates to confuse 'frequency penalty' with rate limiting or cost controls, because the word 'penalty' suggests a punitive mechanism, but it is purely a sampling parameter for output diversity.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
A parameter that reduces repetition of words already present in the response
The 'frequency penalty' parameter in Azure OpenAI API calls is designed to reduce the likelihood of the model repeating words or phrases that have already appeared in the generated response. It works by applying a penalty proportional to the frequency of tokens already used, encouraging more diverse and less repetitive text output. This is distinct from the 'presence penalty', which penalizes tokens based on whether they have appeared at all, regardless of frequency.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
A cost multiplier based on how often you call the API
Why it's wrong here
Frequency penalty is not a billing or cost-control mechanism; Azure OpenAI pricing is based on the number of tokens processed, not on how often you call the API. It is a generation parameter that adjusts the probability of tokens already used in the response, so it has no effect on cost or call frequency.
- ✓
A parameter that reduces repetition of words already present in the response
Why this is correct
Correct. The frequency penalty is a sampling parameter in Azure OpenAI that subtracts from a token's logit score proportionally to the number of times that token has already appeared in the generated response. This reduces the chance of the model reusing the same words or phrases, mitigating repetitive, looping text. A higher value more strongly discourages repetition.
- ✗
A rate limiting parameter controlling maximum API calls per minute
Why it's wrong here
Rate limiting is a subscription-level or API management constraint that caps requests per minute, not a parameter sent with a single inference request. The frequency penalty operates inside a single generation call, modifying the logits of previously used tokens to discourage repetitive output, and says nothing about API throughput.
- ✗
A filter that removes profanity based on how frequently it appears
Why it's wrong here
This option conflates repetition control with content moderation. Profanity filtering is handled by Azure's content safety and moderation services, which evaluate text against prohibited categories. Frequency penalty, by contrast, is a sampler parameter that lowers the score of any token that has already appeared, regardless of whether it is profane, and does not remove or block specific words.
Go deeper
Related to this question
About these practice questions
One of 985 original AI-900 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-900 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-900 exam.