MLS-C01 Modeling Practice Question
A company is using SageMaker Autopilot to automatically build a binary classification model. After the AutoML job completes, the data scientist wants to understand which features are most important for the best candidate model. How can the scientist get feature importance?
⚠ Common exam trap
AWS often tests the misconception that feature importance must be manually extracted via code or logs, when in fact SageMaker Autopilot provides it directly in the UI under the 'Explainability' tab for the best candidate model.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Open the SageMaker Autopilot job details and view the 'Explainability' tab
SageMaker Autopilot automatically generates a 'Explainability' tab within the job details for the best candidate model. This tab uses SHAP (SHapley Additive exPlanations) values to provide feature importance, showing which features most influence the model's predictions. The data scientist can directly access this information without any additional configuration or re-running the model.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✓
Open the SageMaker Autopilot job details and view the 'Explainability' tab
Why this is correct
Autopilot provides feature importance in the explainability tab for the best candidate.
- ✗
Re-run the best model using SageMaker built-in XGBoost with the 'feature_importance' hyperparameter
Why it's wrong here
Autopilot already includes feature importance; no need to re-run.
- ✗
Check the CloudWatch Logs for the training job
Why it's wrong here
CloudWatch logs do not contain a summary of feature importance.
- ✗
Use SageMaker Ground Truth to label a new dataset
Why it's wrong here
Ground Truth is for data labeling, not feature importance.
Go deeper
Related to this question
About these practice questions
Courseiva writes every MLS-C01 question from scratch — 1,672 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This MLS-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the MLS-C01 exam.