An ML team is deploying a real-time inference endpoint for a computer vision model using Amazon SageMaker. The model requires GPU acceleration for low latency. Which instance type should the team choose to minimize cost while meeting the GPU requirement?
Trap 1: ml.c5.xlarge
Incorrect. ml.c5.xlarge does not have a GPU, so it cannot meet the GPU acceleration requirement.
Trap 2: ml.p3.2xlarge
Incorrect. While ml.p3.2xlarge has a GPU (V100), it is more expensive than ml.g5.xlarge and offers more compute than typically needed for inference, leading to higher cost without benefit.
Trap 3: ml.p4d.24xlarge
Incorrect. ml.p4d.24xlarge is a very large GPU instance with four A100 GPUs, which is excessively expensive and over-provisioned for a single-model inference endpoint.
- A
ml.g5.xlarge
Correct. ml.g5.xlarge provides an NVIDIA A10G GPU at a lower cost than ml.p3.2xlarge, making it ideal for cost-effective, low-latency inference.
- B
ml.c5.xlarge
Why wrong: Incorrect. ml.c5.xlarge does not have a GPU, so it cannot meet the GPU acceleration requirement.
- C
ml.p3.2xlarge
Why wrong: Incorrect. While ml.p3.2xlarge has a GPU (V100), it is more expensive than ml.g5.xlarge and offers more compute than typically needed for inference, leading to higher cost without benefit.
- D
ml.p4d.24xlarge
Why wrong: Incorrect. ml.p4d.24xlarge is a very large GPU instance with four A100 GPUs, which is excessively expensive and over-provisioned for a single-model inference endpoint.