Generative AI Leader Practice Question: Techniques to Improve Generative AI Model Output
A data scientist fine-tunes a model on a small proprietary dataset. After fine-tuning, the model repeats training examples verbatim. What is the most effective mitigation?
⚠ Common exam trap
Google Gen AI Leader often tests the misconception that reducing temperature or training longer improves generalization, when in fact these actions either increase determinism (and memorization) or worsen overfitting on small datasets.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Add regularization like dropout and use a smaller learning rate.
Overfitting on a small dataset causes the model to memorize training examples rather than generalize. Adding dropout introduces noise that forces the model to learn more robust features, while a smaller learning rate prevents the model from over-optimizing on the limited data. Together, these regularization techniques reduce the model's capacity to memorize verbatim outputs.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Reduce the temperature during inference to 0.
Why it's wrong here
Temperature 0 makes decoding deterministic but does not stop the model reproducing memorised training text; the memorisation originates in the weights, not sampling randomness. It is tempting because low temperature curbs creative variation, and would be correct for tasks needing consistent, repeatable outputs.
- ✗
Train for more epochs to improve generalization.
Why it's wrong here
Additional epochs on a small dataset deepen memorisation, increasing verbatim reproduction rather than improving generalisation. It is tempting because more training usually raises accuracy on larger corpora, and would be correct when underfitting is the diagnosed problem rather than overfitting.
- ✗
Use early stopping based on validation loss.
Why it's wrong here
Early stopping halts training when validation loss stops improving, which curbs overfitting but does not prevent verbatim memorisation of small datasets; the model can still reproduce examples. It is tempting because it is the standard remedy for overfitting, and would be correct if the validation loss were rising while generalisation degraded.
- ✓
Add regularization like dropout and use a smaller learning rate.
Why this is correct
Verbatim repetition indicates overfitting to the small proprietary dataset. Dropout randomly deactivates neurons during training, while a smaller learning rate prevents sharp memorisation of individual examples, directly reducing the model's tendency to reproduce training data.
Go deeper
Related to this question
About these practice questions
Courseiva writes every Generative AI Leader question from scratch — 1,008 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This Generative AI Leader practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the Generative AI Leader exam.