AI0-001 Machine Learning and Deep Learning Practice Question
While training a deep neural network, the loss function fails to converge and oscillates wildly. Which adjustment is most likely to stabilize training?
⚠ Common exam trap
CompTIA often tests the misconception that increasing model complexity (more layers) or using more data (test set) directly fixes training instability, when in fact the learning rate is the primary culprit for oscillation and non-convergence.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Reduce the learning rate
When the loss function oscillates wildly and fails to converge, it typically indicates that the learning rate is too high, causing the optimizer to overshoot the minima. Reducing the learning rate allows the gradient descent updates to take smaller, more stable steps, which helps the loss converge smoothly. This is a fundamental hyperparameter tuning step in deep learning training.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Increase the number of hidden layers
Why it's wrong here
Adding hidden layers increases model capacity and gradient path length, worsening the oscillation rather than damping it. It is tempting because extra depth often improves accuracy on complex tasks, and would be the right adjustment when the network is underfitting rather than unstable.
- ✗
Decrease the batch size
Why it's wrong here
Smaller batches increase gradient variance, amplifying the wild swings rather than damping them. It is tempting because small batches often improve generalisation and fit limited memory, and would be the right adjustment when the model is overfitting or GPU memory is constrained.
- ✓
Reduce the learning rate
Why this is correct
An excessively large learning rate causes the optimiser to overshoot minima, producing the wild oscillation described. Reducing it shrinks each weight update, letting the loss descend smoothly toward convergence instead of bouncing across the loss surface.
- ✗
Use a test set
Why it's wrong here
A test set only evaluates generalisation after training; it does not alter gradient updates, so oscillation persists. It is tempting because test data is central to model validation, and would be the correct choice when the concern is detecting overfitting rather than stabilising convergence.
About these practice questions
Courseiva writes every AI0-001 question from scratch — 962 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.