The answer is to use early stopping based on validation loss. This directly addresses overfitting during fine-tuning, where the model memorizes training data rather than generalizing, causing the validation loss to rise while training loss continues to fall. Early stopping halts training the moment validation performance degrades, preserving the best model weights and saving compute resources. On the AWS Certified AI Practitioner AIF-C01 exam, this scenario tests your understanding of model optimization techniques within SageMaker’s built-in algorithms or custom training loops. A common trap is to continue training longer, hoping validation loss will recover, but that only worsens overfitting. Remember the mnemonic: “When validation climbs, stop on time.”
AIF-C01 Fundamentals of Generative AI Practice Question
This AIF-C01 practice question tests your understanding of fundamentals of generative ai. The scenario asks you to isolate a root cause — eliminate options that address a different problem before choosing. After answering, compare your reasoning against the explanation and wrong-answer breakdown below. Once you have made your selection, read the full explanation to reinforce the concept and understand why each distractor is designed to mislead on exam day.
A data scientist is fine-tuning a large language model on Amazon SageMaker for a text summarization task. The training loss decreases steadily but the validation loss starts increasing after a few epochs. What should the scientist do to address this issue?
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Use early stopping based on validation loss
The validation loss increasing while training loss decreases is a classic sign of overfitting. Early stopping based on validation loss halts training when the validation loss stops improving, preventing overfitting and saving computational resources. This is a standard technique in SageMaker's built-in training algorithms and custom training scripts.
Key principle: Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
✗
Reduce the batch size
Why it's wrong here
Reducing batch size may increase gradient noise and does not directly fix overfitting.
✗
Increase the learning rate
Why it's wrong here
Increasing learning rate may cause divergence or instability, not address overfitting.
✗
Increase the number of training epochs
Why it's wrong here
More epochs would exacerbate overfitting.
✓
Use early stopping based on validation loss
Why this is correct
Early stopping prevents overfitting by halting training when validation loss stops improving.
Related concept
Read the scenario before looking for a memorised answer.
Common exam traps
Common exam trap: answer the scenario, not the keyword
Cisco often tests the distinction between overfitting and underfitting; the trap here is that candidates may mistakenly think increasing epochs (Option C) always improves performance, ignoring the validation loss divergence that signals overfitting.
Detailed technical explanation
How to think about this question
Early stopping works by monitoring a metric (e.g., validation loss) and stopping training if no improvement is seen for a specified number of epochs (patience). Under the hood, SageMaker's `Estimator` class can accept a `checkpoint_s3_uri` and `tensorboard_output_config` to log metrics, and early stopping logic is typically implemented via a custom `EarlyStopping` callback in frameworks like PyTorch or TensorFlow. In real-world scenarios, combining early stopping with learning rate scheduling (e.g., ReduceLROnPlateau) can further improve generalization.
KKey Concepts to Remember
Read the scenario before looking for a memorised answer.
Find the constraint that changes the correct option.
Eliminate answers that are true in general but not in this case.
TExam Day Tips
→Watch for words such as best, first, most likely and least administrative effort.
→Review why wrong options are wrong, not only why the correct option is correct.
Key takeaway
Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Real-world example
How this comes up in practice
A startup's cloud architect reviews their monthly bill and notices costs are higher than expected for a long-running batch job. Switching from on-demand instances to Reserved Instances — or using Spot/Preemptible VMs — can reduce compute costs by up to 72 %. Questions like this test whether you understand the tradeoffs between commitment, flexibility, and cost across cloud pricing models.
What to study next
Got this wrong? Here's your next step.
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
Fundamentals of Generative AI — This question tests Fundamentals of Generative AI — Read the scenario before looking for a memorised answer..
What is the correct answer to this question?
The correct answer is: Use early stopping based on validation loss — The validation loss increasing while training loss decreases is a classic sign of overfitting. Early stopping based on validation loss halts training when the validation loss stops improving, preventing overfitting and saving computational resources. This is a standard technique in SageMaker's built-in training algorithms and custom training scripts.
What should I do if I get this AIF-C01 question wrong?
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
What is the key concept behind this question?
Read the scenario before looking for a memorised answer.
About these practice questions
Courseiva creates original exam-style practice questions with explanations and wrong-answer analysis. It does not publish real exam questions, exam dumps, or protected exam content. Learn why practice questions differ from exam dumps →
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
This AIF-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AIF-C01 exam.
Question Discussion
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
Sign in to join the discussion.