AI0-001 AI Infrastructure and Technologies Practice Question
A team is deploying a BERT-based question-answering model using a REST API endpoint with gRPC for internal microservices. They notice high latency for small payloads. Which optimization is MOST likely to reduce latency?
⚠ Common exam trap
The AI0-001 exam often tests the misconception that model optimization (ONNX) or hardware upgrades are the default fix for latency, when the real bottleneck for small payloads is network and serialization overhead, which batching directly mitigates.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Enable batching of multiple queries into a single request
Batching multiple queries into a single request reduces the overhead of repeated gRPC connection setup, serialization, and network round trips for small payloads. This amortizes the fixed cost of each inference call across several queries, directly lowering per-query latency in high-throughput scenarios.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✓
Enable batching of multiple queries into a single request
Why this is correct
Batching increases payload size per request, reducing per-query overhead and improving throughput/latency.
- ✗
Convert the model to ONNX and use ONNX Runtime
Why it's wrong here
ONNX Runtime can speed up inference, but the latency issue is likely due to request overhead, not model compute.
- ✗
Switch from gRPC to REST with HTTP/2
Why it's wrong here
Both support HTTP/2; gRPC is binary and typically faster. The issue is likely overhead from stream establishment.
- ✗
Use a larger instance type with more CPU
Why it's wrong here
Compute power may not be the bottleneck; more CPU adds cost without addressing protocol overhead.
About these practice questions
Courseiva writes every AI0-001 question from scratch — 754 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.