AI0-001 AI Concepts and Foundations Practice Question
A financial institution is deploying a reinforcement learning agent to optimize stock trading decisions. The agent is trained in a simulated environment that mimics historical market data. After deployment, the agent performs well initially but then suffers large losses during a period of high volatility that was underrepresented in the training data. The team wants to make the agent more robust to such market conditions without retraining from scratch. They have a budget for additional simulation compute and access to a broader historical dataset including past crises. The agent uses a deep Q-network (DQN) architecture. Which strategy should they adopt?
⚠ Common exam trap
CompTIA often tests the misconception that simply tuning hyperparameters or expanding the replay buffer can fix a model's inability to generalize to unseen distributions, when the real solution requires a change in architecture to handle temporal dependencies.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Modify the DQN to use a recurrent neural network (e.g., DRQN) and train on the expanded dataset
A Deep Recurrent Q-Network (DRQN) can capture temporal dependencies in market data, which is crucial for handling volatile periods that were underrepresented in training. By training on the expanded dataset that includes past crises, the agent can learn from sequential patterns of volatility, making it more robust without requiring a complete retraining from scratch. This approach leverages the existing DQN architecture while adding recurrent layers to better model the dynamic market conditions.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Increase the replay buffer size and continue training on the original dataset
Why it's wrong here
Larger buffer doesn't add new experiences; the agent still misses high-volatility scenarios.
- ✗
Keep the DQN but perform extensive hyperparameter tuning on the original data
Why it's wrong here
Tuning hyperparameters doesn't introduce new data; the agent remains vulnerable to unseen conditions.
- ✓
Modify the DQN to use a recurrent neural network (e.g., DRQN) and train on the expanded dataset
Why this is correct
Recurrent networks capture temporal dynamics better, and training on a more diverse dataset improves robustness.
- ✗
Switch to a policy gradient method with a random exploration strategy
Why it's wrong here
Random exploration may not converge to a profitable policy and wastes compute.
About these practice questions
Courseiva writes every AI0-001 question from scratch — 754 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.