AI0-001 AI Infrastructure and Technologies Practice Question
An MLOps team observes that their production inference API experiences increasing latency as more concurrent requests arrive. They need to scale horizontally while maintaining session state of preprocessing steps. Which deployment strategy should they implement?
⚠ Common exam trap
CompTIA AI exams often test the distinction between stateless and stateful scaling. Candidates may incorrectly choose message queues (Option D) thinking they solve concurrency, but they do not preserve synchronous session state needed for preprocessing steps.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Deploy multiple instances behind a round-robin load balancer with sticky sessions
Sticky sessions (session affinity) ensure that all requests from a given client are routed to the same backend instance, preserving the in-memory session state of preprocessing steps. Combined with a round-robin load balancer, this allows horizontal scaling while maintaining stateful behavior, which is essential for the described latency issue under concurrent load.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Deploy stateless containers without session persistence
Why it's wrong here
Stateless architecture would lose session state between preprocessing steps, causing errors or inconsistent behavior.
- ✗
Use a single larger GPU instance to handle all requests
Why it's wrong here
Vertical scaling has limits and does not solve horizontal scaling requirements; it also lacks fault tolerance.
- ✓
Deploy multiple instances behind a round-robin load balancer with sticky sessions
Why this is correct
Sticky sessions ensure that all requests from a user session are routed to the same instance, preserving session state during horizontal scaling.
- ✗
Implement a message queue (e.g., Kafka) to buffer requests
Why it's wrong here
Message queues help with asynchronous processing but do not inherently maintain session state across multiple requests.
About these practice questions
Courseiva writes every AI0-001 question from scratch — 754 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.