Generative AI Leader Fundamentals of Generative AI Practice Question
A data scientist notices that a Gemini model generates inconsistent responses to similar prompts. What is the likely cause?
⚠ Common exam trap
Google Cloud often tests the misconception that fine-tuning or prompt length is the primary cause of output inconsistency, when in fact the sampling parameters (temperature and top_p) directly control randomness and are the most common culprit.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
The top_p or temperature parameters are set too high causing randomness
High temperature (e.g., >1.0) or high top_p (e.g., >0.9) increases the randomness of token sampling, causing the model to select less probable tokens. This directly leads to inconsistent responses for similar prompts, as the model's output distribution becomes more uniform and less deterministic.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Model is not fine-tuned enough
Why it's wrong here
Inconsistent responses to similar prompts stem from sampling randomness, chiefly non-zero temperature, not insufficient fine-tuning. It tempts because fine-tuning is associated with output quality, and it would be correct where a model consistently produces wrong or off-domain answers rather than varying valid ones.
- ✗
The prompt is too short
Why it's wrong here
Prompt length affects specificity, not run-to-run variance; identical short prompts still return identical output at temperature zero. It is tempting because vague, brief prompts do produce broad answers, so shortening feels causal. The actual driver here is sampling randomness, which the temperature parameter governs.
- ✗
The temperature setting is too low
Why it's wrong here
Low temperature sharpens the probability distribution toward the highest-likelihood token, making repeated outputs more deterministic, not less. It is tempting because temperature is the sampling control, so any inconsistency appears temperature-related. The stem's variance instead indicates high temperature or a non-zero top-k/top-p sampling setting.
- ✓
The top_p or temperature parameters are set too high causing randomness
Why this is correct
Temperature and top_p control sampling randomness; high values widen the probability distribution over candidate tokens. That directly produces the inconsistent outputs observed for similar prompts, since the model samples differently each call rather than selecting the highest-probability token.
Go deeper
Related to this question
About these practice questions
This Generative AI Leader question is part of Courseiva's 1,008-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This Generative AI Leader practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the Generative AI Leader exam.