Quick Answer
The answer is to reduce the model size or add dropout regularization. This directly addresses the classic overfitting scenario where your training loss decreases but validation loss increases during fine-tuning on Vertex AI, meaning the model is memorizing the training data rather than learning generalizable patterns. Reducing model capacity or introducing dropout forces the model to learn more robust features by limiting its ability to rely on spurious correlations. On the Google Cloud Generative AI Leader exam, this question tests your understanding of regularization techniques in the context of fine-tuning large language models, often appearing as a trap where candidates might mistakenly suggest more data or longer training—which would worsen overfitting. Remember the mnemonic “Drop to Stop”: when validation loss climbs, drop model size or add dropout to stop the overfit.
This Generative AI Leader practice question tests your understanding of fundamentals of generative ai. The scenario asks you to isolate a root cause — eliminate options that address a different problem before choosing. After answering, compare your reasoning against the explanation and wrong-answer breakdown below. Once you have made your selection, read the full explanation to reinforce the concept and understand why each distractor is designed to mislead on exam day.
A team is fine-tuning a large language model on custom data using Vertex AI. They find that the training loss decreases but validation loss increases. What is the best course of action?
Clue words in this question
Noticing these words before you look at the options changes how you read each choice.
Clue: "best"
Why it matters: Signals that multiple options may be partially correct. Choose the option that most directly solves the exact problem described, not the one that sounds most complete.
Increase the number of training epochs.
Why wrong: More epochs exacerbate overfitting.
Reduce the model size or add dropout regularization.
Regularization techniques combat overfitting.
Increase the learning rate.
Why wrong: Higher learning rate may cause divergence, not solve overfitting.
Switch to a smaller batch size.
Why wrong: Batch size affects convergence but not directly overfitting.
Answer choices
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
Reduce the model size or add dropout regularization.
The increasing validation loss while training loss decreases is a classic sign of overfitting, where the model memorizes the training data but fails to generalize. Reducing model size or adding dropout regularization directly combats overfitting by limiting the model's capacity or introducing noise during training, which forces the model to learn more robust features. This is the best course of action because it addresses the root cause without further exacerbating the problem.
Key principle: Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Answer analysis
For each option: why learners choose it and why it is or isn't the right answer here.
Increase the number of training epochs.
Why it's wrong here
More epochs exacerbate overfitting.
Reduce the model size or add dropout regularization.
Why this is correct
Regularization techniques combat overfitting.
Clue confirmation
The clue word "best" in the question point toward this answer.
Related concept
Read the scenario before looking for a memorised answer.
Increase the learning rate.
Why it's wrong here
Higher learning rate may cause divergence, not solve overfitting.
Switch to a smaller batch size.
Why it's wrong here
Batch size affects convergence but not directly overfitting.
Common exam traps
Google Cloud often tests the distinction between underfitting and overfitting, and the trap here is that candidates may confuse increasing validation loss with underfitting and incorrectly choose to increase epochs or learning rate, rather than recognizing the hallmark divergence of overfitting.
Detailed technical explanation
Overfitting occurs when the model's capacity (number of parameters) is too high relative to the dataset size, causing it to learn noise and spurious correlations. Dropout regularization works by randomly dropping a fraction of neurons during each forward pass, effectively training an ensemble of sub-networks and reducing co-adaptation of features. In Vertex AI, this can be implemented via the model's training configuration or by modifying the architecture in the custom training script, and the dropout rate is a hyperparameter typically tuned between 0.1 and 0.5.
Key takeaway
Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Real-world example
A cloud solutions architect for a retail company is evaluating services for a new workload. The correct answer here reflects best practice for the specific scenario described — not a general cloud recommendation. Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option. Cloud exam questions reward reading the constraint carefully: the same technology can be right or wrong depending on the use case.
What to study next
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
Fundamentals of Generative AI — study guide chapter
Learn the concepts, then practise the questions
Fundamentals of Generative AI practice questions
Targeted practice on this topic area only
All Generative AI Leader questions
500 questions across all exam domains
Google Cloud Generative AI Leader Generative AI Leader study guide
Full concept coverage aligned to exam objectives
Generative AI Leader practice test guide
How to use practice tests most effectively before exam day
Related practice questions
Use these pages to review the topic behind this question. This is how one missed question becomes focused revision.
Practise Generative AI Leader questions linked to Fundamentals of Generative AI.
Practise Generative AI Leader questions linked to Business Strategies for Generative AI Solutions.
Practise Generative AI Leader questions linked to Google Cloud's Generative AI Offerings.
Practise Generative AI Leader questions linked to Techniques to Improve Generative AI Model Output.
Practise Generative AI Leader questions linked to Generative AI Leader fundamentals.
Practise Generative AI Leader questions linked to Generative AI Leader scenario.
Practise Generative AI Leader questions linked to Generative AI Leader troubleshooting.
Practice this exam
Short sessions build daily habit. Longer sessions build exam-day stamina. Try a timed session to simulate real conditions.
FAQ
Fundamentals of Generative AI — This question tests Fundamentals of Generative AI — Read the scenario before looking for a memorised answer..
The correct answer is: Reduce the model size or add dropout regularization. — The increasing validation loss while training loss decreases is a classic sign of overfitting, where the model memorizes the training data but fails to generalize. Reducing model size or adding dropout regularization directly combats overfitting by limiting the model's capacity or introducing noise during training, which forces the model to learn more robust features. This is the best course of action because it addresses the root cause without further exacerbating the problem.
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
Yes — watch for: "best". Signals that multiple options may be partially correct. Choose the option that most directly solves the exact problem described, not the one that sounds most complete.
Read the scenario before looking for a memorised answer.
About these practice questions
Courseiva creates original exam-style practice questions with explanations and wrong-answer analysis. It does not publish real exam questions, exam dumps, or protected exam content. Learn why practice questions differ from exam dumps →
Same concept, more angles
These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.
Variation 1. Refer to the exhibit. A data scientist is fine-tuning a model. The training loss and accuracy are improving each epoch. However, after training, the model performs poorly on a held-out validation set. What is the most likely issue?
hardWhy D: The model's training loss and accuracy improve each epoch, but performance on the validation set is poor. This classic symptom indicates overfitting, where the model memorizes the training data (including noise) rather than learning generalizable patterns. In fine-tuning, this often occurs when the model is trained for too many epochs or the dataset is too small relative to model capacity.
Variation 2. You are a data scientist at a financial institution. You are using Vertex AI to fine-tune a large language model (LLM) for generating financial reports. You have prepared a dataset of 10,000 examples. During fine-tuning, you notice that the training loss is decreasing steadily, but the validation loss is increasing after 5 epochs. The model's generated reports on the validation set contain many factual errors and nonsensical statements. You suspect overfitting. You have limited compute budget and need to improve generalization. What should you do?
hardWhy D: Early stopping with a patience of 2 epochs is the correct approach because it directly addresses overfitting by halting training when the validation loss fails to improve for a specified number of epochs. This preserves the model's generalization ability without requiring additional compute or data, which aligns with the limited budget constraint. In Vertex AI, early stopping is a built-in hyperparameter tuning strategy that monitors validation metrics and stops the job to prevent further degradation.
Last reviewed: Jun 30, 2026
This Generative AI Leader practice question is part of Courseiva's free Google Cloud certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the Generative AI Leader exam.
Question Discussion
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
Sign in to join the discussion.