A developer is integrating an AI microservice that accepts image uploads and returns classification labels. The service must handle spikes of up to 1,000 requests per minute but average 100 requests per minute. Which deployment architecture BEST meets these requirements with cost efficiency?
Async queue buffers spikes, workers scale only when needed, reducing cost while handling bursts.
Why this answer
Async processing with a queue allows buffering during spikes, scaling workers as needed. A synchronous always-on service would be over-provisioned for average load. Serverless with auto-scaling offers cost efficiency.