mediumMultiple SelectObjective-mapped
MLA-C01 Practice Question: A company uses Amazon SageMaker to deploy a model…
A company uses Amazon SageMaker to deploy a model for real-time inference. They want to perform A/B testing between two model versions. Which TWO actions should the company take to set up A/B testing? (Choose TWO.)
⚠ Common exam trap
Candidates often confuse the separate service Amazon CloudWatch Evidently with SageMaker's native traffic splitting, or think that auto scaling or zero-weight strategies are prerequisites for A/B testing.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Create an endpoint configuration with multiple production variants, each with a different model.
In SageMaker, A/B testing between two model versions is achieved by creating an endpoint configuration with multiple production variants, each pointing to a different model. This allows the endpoint to host both models simultaneously and route traffic between them based on assigned weights.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✓
Create an endpoint configuration with multiple production variants, each with a different model.
Why this is correct
Production variants allow multiple models on the same endpoint.
- ✗
Use Amazon CloudWatch Evidently to split traffic between models.
Why it's wrong here
SageMaker endpoints have built-in traffic splitting; Evidently is not used.
- ✓
Set the initial weight of each production variant to the desired traffic split.
Why this is correct
Weights determine the proportion of traffic each variant receives.
- ✗
Enable auto scaling for each production variant individually.
Why it's wrong here
Auto scaling is not necessary for A/B testing setup.
- ✗
Set the second production variant's weight to 0 and update later to 100.
Why it's wrong here
That would send no traffic to the second variant initially, not a proper A/B test.
Go deeper
Related to this question
About these practice questions
One of 835 original MLA-C01 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This MLA-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the MLA-C01 exam.