AI0-001 AI Infrastructure and Technologies Practice Question
An ML engineer wants to deploy a model as a REST API that can scale to handle thousands of inference requests per second. Which serving approach is most appropriate?
⚠ Common exam trap
The AI0-001 exam often tests the distinction between serving infrastructure (REST API with containerized server) and data processing pipelines (batch) or communication protocols (gRPC), leading candidates to confuse a transport mechanism or batch method with a scalable serving architecture.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Deploy the model as a REST API endpoint using a containerized inference server
Deploying the model as a REST API endpoint using a containerized inference server (e.g., TensorFlow Serving, TorchServe, or NVIDIA Triton Inference Server) is the most appropriate approach for handling thousands of inference requests per second. These servers are designed for high-throughput, low-latency serving, support horizontal scaling via load balancers, and provide built-in batching and model versioning. REST APIs are stateless and can be easily integrated with existing web infrastructure, making them ideal for production-scale inference.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Export the model to ONNX format and use a batch processing pipeline
Why it's wrong here
ONNX export optimises portability and batch throughput, not per-request REST serving at thousands of requests per second; a batch pipeline processes queued jobs offline rather than synchronous inference calls. It would be the right choice for scheduled bulk scoring where latency is irrelevant.
- ✗
Use gRPC streaming for all inference requests
Why it's wrong here
gRPC streaming is designed for persistent bidirectional or server-push communication, not for stateless request-response patterns; the REST API requirement in the stem demands standard HTTP methods and stateless handling, which gRPC streaming does not natively expose. It is tempting because gRPC offers high throughput and low latency for streaming data pipelines, making it the correct choice when the inference involves continuous data flows, such as real-time video processing or long-running model predictions.
- ✗
Run the model directly on the client device
Why it's wrong here
Client-device execution places inference on the user's hardware, so the server cannot scale capacity or centralise model updates; thousands of concurrent REST requests would depend on each client's own compute. It suits offline or privacy-sensitive on-device inference, not a centrally scaled REST endpoint.
- ✓
Deploy the model as a REST API endpoint using a containerized inference server
Why this is correct
A containerised inference server exposes the model as a REST endpoint and supports horizontal scaling across replicas behind a load balancer, meeting the thousands-of-requests-per-second requirement. Containers also package dependencies consistently, enabling elastic autoscaling of inference capacity.
About these practice questions
One of 962 original AI0-001 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.