← MLS-C01·Amazon Web Services

Question 1,666 of 1,755

Machine Learning Implementation and Operations →mediumMultiple ChoiceObjective-mapped

Using SageMaker Multi-Model Endpoints

This MLS-C01 practice question tests your understanding of machine learning implementation and operations. Read the scenario carefully and evaluate each option against the stated constraints before committing to an answer. After answering, compare your reasoning against the explanation and wrong-answer breakdown below. Once you have made your selection, read the full explanation to reinforce the concept and understand why each distractor is designed to mislead on exam day.

A company is deploying a real-time inference endpoint using Amazon SageMaker. The model is a large deep learning model that requires low latency. The team is concerned about cost. Which SageMaker hosting option should the team use?

A
Use a SageMaker batch transform job.
Why wrong: Batch transform is for offline predictions, not real-time.
B
Use a SageMaker Serverless Inference endpoint.
Why wrong: Serverless can have cold start latency.
C
Use a single-instance endpoint with a large instance type.
Why wrong: Single large instance may be underutilized and costly.
D
Use a SageMaker multi-model endpoint.
Multi-model endpoints share resources and reduce cost per model.

Full breakdown with real-world context →

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

✓

Use a SageMaker multi-model endpoint.

Option D is correct because a SageMaker multi-model endpoint allows you to host multiple models on a single endpoint behind the same serving container, sharing resources and reducing costs while still providing low-latency real-time inference. This is ideal for a large deep learning model that needs low latency but must be cost-effective, as it avoids the expense of dedicated instances for each model.

Key principle: Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

✗
Use a SageMaker batch transform job.
Why it's wrong here
Batch transform is for offline predictions, not real-time.
✗
Use a SageMaker Serverless Inference endpoint.
Why it's wrong here
Serverless can have cold start latency.
✗
Use a single-instance endpoint with a large instance type.
Why it's wrong here
Single large instance may be underutilized and costly.
✓
Use a SageMaker multi-model endpoint.
Why this is correct
Multi-model endpoints share resources and reduce cost per model.
Related concept
Read the scenario before looking for a memorised answer.

Common exam traps

Common exam trap: answer the scenario, not the keyword

The trap here is that candidates often confuse 'low latency' with 'dedicated resources' and choose a single-instance endpoint (Option C), overlooking that multi-model endpoints can achieve low latency through caching and shared infrastructure while significantly reducing cost.

Detailed technical explanation

How to think about this question

A SageMaker multi-model endpoint uses a shared serving container that dynamically loads and unloads models from Amazon S3 into memory based on request patterns, leveraging a model cache to minimize latency for frequently accessed models. Under the hood, the endpoint runs on a fleet of instances (e.g., ml.c5 or ml.inf1) that can be scaled horizontally, and the SageMaker invocations endpoint routes requests to the correct model using a target model parameter in the request payload. In a real-world scenario, a company with multiple versions of a large deep learning model (e.g., for different customer segments) can host them all on one endpoint, reducing costs by up to 90% compared to separate endpoints, while maintaining sub-100ms latency for cached models.

KKey Concepts to Remember

Read the scenario before looking for a memorised answer.
Find the constraint that changes the correct option.
Eliminate answers that are true in general but not in this case.

TExam Day Tips

Watch for words such as best, first, most likely and least administrative effort.
Review why wrong options are wrong, not only why the correct option is correct.

Key takeaway

Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.

Real-world example

How this comes up in practice

A startup's cloud architect reviews their monthly bill and notices costs are higher than expected for a long-running batch job. Switching from on-demand instances to Reserved Instances — or using Spot/Preemptible VMs — can reduce compute costs by up to 72 %. Questions like this test whether you understand the tradeoffs between commitment, flexibility, and cost across cloud pricing models.

What to study next

Got this wrong? Here's your next step.

Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.

Related MLS-C01 practice-question pages

Use these pages to review the topic behind this question. This is how one missed question becomes focused revision.

Data Engineering practice questions

Practise MLS-C01 questions linked to Data Engineering.

Machine Learning Implementation and Operations practice questions

Practise MLS-C01 questions linked to Machine Learning Implementation and Operations.

Modeling practice questions

Practise MLS-C01 questions linked to Modeling.

Exploratory Data Analysis practice questions

Practise MLS-C01 questions linked to Exploratory Data Analysis.

MLS-C01 fundamentals practice questions

Practise MLS-C01 questions linked to MLS-C01 fundamentals.

MLS-C01 scenario practice questions

Practise MLS-C01 questions linked to MLS-C01 scenario.

MLS-C01 troubleshooting practice questions

Practise MLS-C01 questions linked to MLS-C01 troubleshooting.

Practice this exam

Start a free MLS-C01 practice session

Short sessions build daily habit. Longer sessions build exam-day stamina. Try a timed session to simulate real conditions.

10 questions 20 questions 30 questions 50 questions Timed 30

MLS-C01 practice-test guide →Study guide →Browse all practice tests

FAQ

Questions learners often ask

What does this MLS-C01 question test?

Machine Learning Implementation and Operations — This question tests Machine Learning Implementation and Operations — Read the scenario before looking for a memorised answer..

What is the correct answer to this question?

The correct answer is: Use a SageMaker multi-model endpoint. — Option D is correct because a SageMaker multi-model endpoint allows you to host multiple models on a single endpoint behind the same serving container, sharing resources and reducing costs while still providing low-latency real-time inference. This is ideal for a large deep learning model that needs low latency but must be cost-effective, as it avoids the expense of dedicated instances for each model.

What should I do if I get this MLS-C01 question wrong?

Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.

What is the key concept behind this question?

Read the scenario before looking for a memorised answer.

About these practice questions

Courseiva creates original exam-style practice questions with explanations and wrong-answer analysis. It does not publish real exam questions, exam dumps, or protected exam content. Learn why practice questions differ from exam dumps →

How Courseiva writes practice questions · Editorial policy

Same concept, more angles

1 more ways this is tested on MLS-C01

These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.

Variation 1. A company is deploying a real-time inference endpoint using Amazon SageMaker. The model is a large deep learning model that requires GPU inference. The company wants to minimize latency and cost. Which instance type and deployment strategy should be used?

medium

A.Use a serverless inference endpoint with a GPU instance.
✓ B.Use a real-time endpoint with a GPU instance and enable multi-model endpoints.
C.Use a batch transform job with a GPU instance.
D.Use an asynchronous inference endpoint with a GPU instance.

Why B: Option B is correct because using a real-time endpoint with a GPU instance and enabling multi-model endpoints allows the company to serve multiple models on a single GPU instance, reducing cost by sharing the GPU resource while maintaining low latency for real-time inference. Multi-model endpoints load and unload models on demand, minimizing idle GPU time and optimizing cost without sacrificing the low-latency requirement.

Keep practising

Question Discussion

Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.

Loading comments…

This MLS-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the MLS-C01 exam.