A content creator uses Azure OpenAI to generate unique story ideas for a fantasy novel. They want the output to be highly creative and unpredictable, avoiding common clichés. Which parameter should they primarily increase to achieve this?
Temperature directly controls the softmax distribution used to sample each next token. Higher values (e.g., 0.9) flatten the probability curve, making less-likely tokens more probable and therefore generating more creative, unpredictable text; lower values (e.g., 0.1) sharpen the curve toward the most likely token. For a content creator seeking unique outputs, temperature is the primary lever for overall randomness and creative variety.
Why this answer
Increasing the Temperature parameter makes the model's output more random and less deterministic, which is ideal for generating highly creative and unpredictable story ideas. A higher temperature (e.g., 0.9–1.0) increases the probability of sampling less likely tokens, reducing repetition and clichés.
Exam trap
The trap here is that candidates often confuse Temperature with Top p, thinking both control randomness equally, but Temperature directly adjusts the softmax distribution's sharpness while Top p only limits the sampling pool.
How to eliminate wrong answers
Option B (Top p) is wrong because Top p (nucleus sampling) controls the cumulative probability threshold for token selection, which can also increase diversity but is less direct for overall randomness than Temperature. Option C (Frequency penalty) is wrong because it reduces the likelihood of repeating the same tokens or phrases, which helps avoid repetition but does not primarily increase creativity or unpredictability. Option D (Presence penalty) is wrong because it penalizes tokens that have already appeared in the text, encouraging new topics but not directly controlling the randomness of token selection.