AI0-001 AI Implementation and Operations Practice Question
An e-commerce company deploys a recommendation model that must serve predictions with sub-100 ms latency for millions of users during peak hours. The model is a large neural network. Which architecture is most suitable?
⚠ Common exam trap
CompTIA often tests the misconception that a single powerful server or serverless functions can meet strict latency and throughput requirements, but the trap here is that horizontal scaling with load-balanced replicas is the only viable solution for high-concurrency, low-latency inference with large models.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Use a distributed system with load balancers and model replicas.
Distributing the model across multiple servers with load balancers and replicas allows horizontal scaling to handle millions of concurrent users while maintaining sub-100 ms latency. This architecture provides fault tolerance and can dynamically adjust to peak traffic loads, which is essential for real-time inference with large neural networks.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Batch process predictions every hour.
Why it's wrong here
Batch processing cannot provide real-time sub-100 ms latency.
- ✓
Use a distributed system with load balancers and model replicas.
Why this is correct
This architecture handles high traffic and meets latency requirements efficiently.
- ✗
Deploy the model on a single powerful GPU server.
Why it's wrong here
A single server is a bottleneck and cannot scale to millions of concurrent users.
- ✗
Use serverless functions with auto-scaling.
Why it's wrong here
Serverless functions may have cold start latency exceeding the 100 ms target.
About these practice questions
Courseiva writes every AI0-001 question from scratch — 754 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.