Techniques to Improve Generative AI Model Output →easyMultiple ChoiceObjective-mapped

Generative AI Leader Practice Question: Techniques to Improve Generative AI Model Output

Exhibit

{
  "instances": [{"prompt": "Write a poem about AI."}],
  "parameters": {
    "temperature": 0.0,
    "maxOutputTokens": 256,
    "topP": 1.0,
    "topK": 40
  }
}

Refer to the exhibit. A data scientist sends a prediction request to a text generation model with the following parameters and receives repetitive output. Which parameter should be changed?

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

✓

Increase temperature to 0.5

Temperature 0.0 makes the model deterministic, leading to repetitive text. Increasing temperature to 0.5 introduces randomness. Decreasing topP may help but temperature is the direct cause. Increasing topK adds diversity but less effect, decreasing max tokens doesn't fix repetition.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

✗
Decrease topP to 0.5
Why it's wrong here
Reduces token pool but may not fix determinism.
✗
Increase topK to 100
Why it's wrong here
Increases diversity but temperature is the root cause.
✗
Decrease maxOutputTokens
Why it's wrong here
Shorter output but still repetitive.
✓
Increase temperature to 0.5
Why this is correct
Introduces randomness to avoid repetition.

Go deeper

Generative AI Leader Practice Question: Techniques to Improve Generative AI Model Output

Exhibit

Why each option matters

Option-by-option breakdown

Related to this question