MLA-C01 Deployment and Orchestration of ML Workflows Practice Question
A machine learning engineer needs to deploy a TensorFlow model that requires a custom inference environment with specific system libraries. The model will be used in a real-time application with variable traffic. They want to minimize cold start latency. Which SageMaker hosting option should they choose?
⚠ Common exam trap
Watch out — candidates often confuse 'minimizing cold start latency' with 'scaling to zero' and incorrectly choose Serverless Inference, failing to recognize that Serverless inherently introduces cold starts on first request after idle periods.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
SageMaker real-time endpoint with a custom container
SageMaker real-time endpoints with a custom container are the correct choice because they provide persistent, always-on infrastructure that eliminates cold start latency. By packaging the TensorFlow model with required system libraries in a custom Docker image, the engineer ensures the inference environment is ready immediately, and the endpoint can scale to handle variable traffic with minimal delay.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✓
SageMaker real-time endpoint with a custom container
Why this is correct
Real-time endpoints are always warm (no cold starts) and support custom containers.
- ✗
SageMaker Serverless Inference with a custom container
Why it's wrong here
Serverless has cold start latency, which the team wants to minimize.
- ✗
SageMaker Multi-Model Endpoint with a custom container
Why it's wrong here
Multi-model endpoints also support custom containers but are designed for high model density; they are not specifically optimized for minimizing cold starts per se but are provisioned.
- ✗
SageMaker Asynchronous Inference with a custom container
Why it's wrong here
Asynchronous is not for real-time applications.
Go deeper
Related to this question
About these practice questions
Courseiva writes every MLA-C01 question from scratch — 835 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This MLA-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the MLA-C01 exam.