Generative AI Leader Practice Question: Techniques to Improve Generative AI Model Output
Despite applying safety filters, a generative AI model still produces toxic outputs in some cases. Which additional technique should be applied?
⚠ Common exam trap
A common misconception is that adjusting static parameters (like temperature or filter thresholds) can solve alignment problems, when in fact dynamic human-in-the-loop methods like RLHF are required for nuanced safety issues.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Use RLHF with human feedback to reduce toxicity
RLHF (Reinforcement Learning from Human Feedback) directly addresses toxicity by using human evaluators to rank model outputs, then fine-tuning the model to prefer less toxic responses. This technique teaches the model to avoid harmful patterns that safety filters might miss, as filters are static and can be bypassed by adversarial prompts or nuanced toxicity.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Add more examples of toxic content to training
Why it's wrong here
Adding toxic examples to training data teaches the model to reproduce that content, worsening the problem rather than mitigating it. Curating training data is the right lever for shaping desired behaviour, but only when adding benign, representative examples that steer outputs away from toxicity.
- ✗
Increase the filter threshold
Why it's wrong here
Raising the threshold blocks more outputs but does not stop toxic content that already passes filtering, since the model still generates it; it merely shifts the boundary and increases false positives. Threshold tuning suits scenarios where benign content is being over-blocked, not where harmful outputs evade detection entirely.
- ✓
Use RLHF with human feedback to reduce toxicity
Why this is correct
RLHF fine-tunes the model using human rankings of outputs, directly penalising toxic responses and steering generation toward safer behaviour. This addresses residual toxicity that static safety filters miss, satisfying the stem's need for an additional mitigation beyond filtering.
- ✗
Decrease the model's temperature
Why it's wrong here
Lowering temperature makes sampling more deterministic, not safer; a toxic pattern with high probability still surfaces. Temperature controls randomness in token selection, so it suits reproducibility or creativity tuning, not removing harmful content that the model has learned to produce.
Go deeper
Related to this question
About these practice questions
One of 1,008 original Generative AI Leader practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This Generative AI Leader practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the Generative AI Leader exam.