Which THREE measures can help reduce inference latency for a deep learning model deployed on SageMaker real-time endpoints? (Select THREE.)
Neo optimizes models for target hardware, reducing latency.
Why this answer
A is correct because SageMaker Neo compiles the trained model into an optimized binary for the target hardware (e.g., CPU, GPU, or Inferentia), using Apache TVM to fuse operations and prune unused computations. This reduces inference latency by up to 2x without requiring code changes, making it a direct latency-reduction measure for real-time endpoints.
Exam trap
The MLS-C01 exam often tests the misconception that increasing batch size always reduces latency, but for real-time endpoints, larger batches increase per-request processing time, making it a throughput optimization, not a latency reduction technique.