Best Practices for Hyperparameter Tuning on Amazon SageMaker
Which TWO of the following are best practices for hyperparameter tuning using Amazon SageMaker? (Choose 2)
Quick Answer
The answer is to use automatic model tuning with Bayesian optimization and to enable early stopping. Bayesian optimization is the correct approach because it intelligently explores the hyperparameter space by building a probabilistic model of the objective function, focusing on promising regions to find optimal values with far fewer trials than grid or random search. Early stopping, often implemented via Amazon SageMaker’s managed warm start or the `EarlyStopping` flag, automatically terminates poorly performing training jobs, saving significant compute time and cost without sacrificing model quality. On the AWS Certified Machine Learning Specialty exam, this question tests your understanding of efficient tuning strategies versus brute-force methods; a common trap is assuming that more training data or tuning every possible parameter yields better results, when in fact it wastes resources. Remember the mnemonic “BOES” – Bayesian Optimization and Early Stopping – to recall the two pillars of efficient SageMaker hyperparameter tuning.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Use early stopping to terminate poorly performing training jobs.
Early stopping terminates poorly performing training jobs, saving time and compute resources. Option E is correct because automatic model tuning with Bayesian optimization efficiently searches the hyperparameter space by focusing on promising regions. Option A is incorrect because grid search is exhaustive and computationally expensive, not a best practice. Option C is incorrect because tuning all algorithm hyperparameters can be unnecessary and inefficient; only relevant hyperparameters should be tuned. Option D is incorrect because while a larger dataset may improve model accuracy, it does not directly improve tuning efficiency; hyperparameter tuning optimizes the learning process, not data size.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Use grid search to exhaustively explore all combinations.
Why it's wrong here
Grid search is inefficient for many hyperparameters.
- ✓
Use early stopping to terminate poorly performing training jobs.
Why this is correct
Early stopping avoids wasted resources.
- ✗
Include all algorithm hyperparameters in the tuning job.
Why it's wrong here
May include irrelevant hyperparameters.
- ✗
Use a larger training dataset to improve tuning results.
Why it's wrong here
Dataset size does not directly affect tuning efficiency.
- ✓
Use automatic model tuning with Bayesian optimization.
Why this is correct
Bayesian optimization finds good hyperparameters efficiently.
Go deeper
Related to this question
About these practice questions
One of 1,672 original MLS-C01 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
Same concept, more angles
1 more way this is tested on MLS-C01
These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.
Variation 1. A company is using Amazon SageMaker to tune hyperparameters for a gradient boosting model. The objective is to minimize root mean squared error (RMSE). The data scientist wants to explore the hyperparameter space efficiently. Which THREE hyperparameter tuning strategies should the data scientist consider? (Choose 3.)
hard- ✓ A.Bayesian optimization
- ✓ B.Random search
- C.Grid search
- D.Manual search
- ✓ E.Hyperband
Why A: Bayesian optimization is correct because it builds a probabilistic model of the objective function (RMSE) and uses an acquisition function to select the next hyperparameter combination to evaluate. This approach is sample-efficient, making it ideal for expensive-to-evaluate models like gradient boosting, as it balances exploration and exploitation to find optimal hyperparameters with fewer trials.
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This MLS-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the MLS-C01 exam.