AI0-001 AI Infrastructure and Technologies Practice Question
An ML engineer wants to deploy a model as a REST API that can scale to handle thousands of inference requests per second. Which serving approach is most appropriate?
⚠ Common exam trap
The AI0-001 exam often tests the distinction between serving infrastructure (REST API with containerized server) and data processing pipelines (batch) or communication protocols (gRPC), leading candidates to confuse a transport mechanism or batch method with a scalable serving architecture.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Deploy the model as a REST API endpoint using a containerized inference server
Deploying the model as a REST API endpoint using a containerized inference server (e.g., TensorFlow Serving, TorchServe, or NVIDIA Triton Inference Server) is the most appropriate approach for handling thousands of inference requests per second. These servers are designed for high-throughput, low-latency serving, support horizontal scaling via load balancers, and provide built-in batching and model versioning. REST APIs are stateless and can be easily integrated with existing web infrastructure, making them ideal for production-scale inference.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Export the model to ONNX format and use a batch processing pipeline
Why it's wrong here
ONNX is for model interchange, not serving; batch processing is not real-time.
- ✗
Use gRPC streaming for all inference requests
Why it's wrong here
gRPC streaming is designed for persistent bidirectional or server-push communication, not for stateless request-response patterns; the REST API requirement in the stem demands standard HTTP methods and stateless handling, which gRPC streaming does not natively expose. It is tempting because gRPC offers high throughput and low latency for streaming data pipelines, making it the correct choice when the inference involves continuous data flows, such as real-time video processing or long-running model predictions.
- ✗
Run the model directly on the client device
Why it's wrong here
Device deployment may not scale centrally and is not a server-side API solution.
- ✓
Deploy the model as a REST API endpoint using a containerized inference server
Why this is correct
REST APIs are stateless and easily scalable with load balancers and container orchestration.
About these practice questions
One of 754 original AI0-001 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.