MLA-C01 Quick Quiz — 10 Questions

Question 1

A team built a SageMaker Pipeline that includes a training step and a model evaluation step. They want to automatically register a model in SageMaker Model Registry only if the evaluation metric (accuracy) exceeds 0.9. Which pipeline step should be used to implement this conditional logic?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

Condition step. The Condition step in SageMaker Pipelines allows you to add conditional branching logic, such as evaluating a metric and proceeding only if a condition is met. In this scenario, you would use a ConditionStep to check if the accuracy metric from the evaluation step exceeds 0.9, and then conditionally execute a RegisterModel step to register the model in SageMaker Model Registry. A common misconception is that the RegisterModel step itself can conditionally register a model based on metrics, but in SageMaker Pipelines, conditional logic must be implemented explicitly with a ConditionStep.

Answer

RegisterModel step

Answer

Processing step

Answer

Transform step

Question 2

A company uses Amazon SageMaker to train and deploy a machine learning model. After deployment, they notice that the model's accuracy drops significantly over time due to changes in the underlying data distribution. Which monitoring solution should they implement to detect this issue automatically?

Accepted Answer

Set up Amazon SageMaker Model Monitor with data quality monitoring.. Amazon SageMaker Model Monitor with data quality monitoring is the correct solution because it automatically detects deviations in the input data distribution compared to a baseline, which directly addresses the problem of model accuracy degradation due to data drift. It continuously monitors the statistical properties of inference requests and alerts when drift is detected, enabling proactive retraining.

Answer

Configure AWS Config rules to check the model accuracy metric.

Answer

Use AWS CloudTrail to monitor changes to the model's S3 bucket.

Answer

Enable Amazon CloudWatch Logs on the endpoint and set alarms on inference latency.

Question 3

An ML team is preparing time-series data for a demand forecasting model. They want to evaluate model performance over time without leaking future information into past training windows. Which data splitting strategy is MOST appropriate?

Accepted Answer

Walk-forward validation with an expanding window. Walk-forward validation with an expanding window is the most appropriate strategy because it respects the temporal order of the data, ensuring that each training window contains only past observations and each validation window contains only future observations. This prevents data leakage and provides a realistic evaluation of how the model will perform on unseen future time steps, which is critical for demand forecasting.

Answer

Random k-fold cross-validation

Answer

Single hold-out set with random selection

Answer

Stratified sampling based on the target variable

Question 4

A company is training a deep learning model on Amazon SageMaker. The training job started but has been stuck in 'InProgress' state for an unusually long time with low CPU utilization. The data scientist suspects a bottleneck. What should be the first troubleshooting step?

Accepted Answer

Review CloudWatch Logs for the training container to identify errors or warnings.. When a SageMaker training job is stuck in 'InProgress' with low CPU utilization, the most common cause is a bottleneck in data loading or preprocessing within the training container. Reviewing CloudWatch Logs for the training container is the first troubleshooting step because it provides direct visibility into container-level errors, warnings, or stalls (e.g., hanging on a file read, waiting for a dependency, or a misconfigured data channel) that would not be visible from instance-level metrics alone.

Answer

Switch the training job to use Spot instances to reduce cost and potentially improve throughput.

Answer

Increase the number of training instances to parallelize data loading.

Answer

Stop and restart the training job with a different instance type.

Question 5

A retail company has a SageMaker model that predicts customer churn. The model was trained on data that included a 'customer_zipcode' feature. After deployment, the data science team notices that the model's predictions for certain zip codes have become less accurate over time. They suspect that the relationship between zip code and churn has changed due to a recent relocation of a major employer. Which SageMaker monitoring capability should they use to detect this type of drift?

Accepted Answer

SageMaker Model Monitor model quality monitoring. Model quality monitoring is designed to monitor the performance of a model by comparing predictions to actual labels. When the relationship between a feature and the target changes, the model's accuracy drops, and model quality monitoring will detect this drift. Data quality monitoring only looks at input distributions, bias drift focuses on fairness, and feature attribution drift looks at feature importance, none of which directly measure predictive performance.

Answer

SageMaker Model Monitor bias drift monitoring

Answer

SageMaker Model Monitor feature attribution drift monitoring

Answer

SageMaker Model Monitor data quality monitoring

Question 6

A data scientist observes that a linear regression model has many irrelevant features. They want to perform feature selection to improve generalization. Which method combines feature selection with model training using a penalty that can shrink coefficients to zero?

Accepted Answer

Lasso regression. Lasso regression (L1 regularization) adds a penalty equal to the absolute value of the coefficients, which can shrink some coefficients exactly to zero — effectively performing feature selection during training. This makes it the method that combines feature selection with model fitting in a single step.

Answer

Ridge regression

Answer

Recursive Feature Elimination (RFE)

Answer

Principal Component Analysis (PCA)

Question 7

A data engineer needs to prepare a large dataset for machine learning. The data is stored in an Amazon RDS MySQL database and needs to be transformed and moved to an S3 bucket in Parquet format for use with SageMaker. Which AWS service is most suitable for this extraction, transformation, and loading (ETL) task?

Accepted Answer

Use AWS Glue ETL jobs with PySpark to read from RDS, apply transformations, and write to S3 as Parquet.. AWS Glue ETL jobs with PySpark are the most suitable service for this task because Glue is a fully managed, serverless ETL service that can natively connect to Amazon RDS MySQL via JDBC, apply transformations using PySpark, and write the output directly to S3 in Parquet format. This aligns perfectly with the requirement to extract, transform, and load a large dataset into a machine-learning-ready format without managing infrastructure.

Answer

Use Amazon Athena CTAS statements to copy data from RDS to S3.

Answer

Use SageMaker Data Wrangler to connect to RDS and export transformed data to S3.

Answer

Use Amazon EMR with Spark to read from RDS, transform, and write to S3.

Question 8

Refer to the exhibit. The data scientist wants to update the endpoint to use a new model version without downtime. Which approach should they use?

Accepted Answer

Create a new endpoint configuration with a second variant and update the endpoint. It uses SageMaker's blue/green deployment pattern: creating a new endpoint configuration with a second variant (the new model version) and updating the endpoint shifts traffic gradually or instantly without downtime. This approach leverages the endpoint's ability to host multiple variants and route traffic between them, ensuring zero interruption during the update.

Answer

Delete the existing endpoint and create a new one

Answer

Update the endpoint's model name directly

Answer

Use SageMaker Model Monitor to automatically switch

Question 9

A company wants to use SageMaker Autopilot to automatically build a binary classification model. Which output does Autopilot provide to help understand model decisions?

Accepted Answer

An explainability report with feature importance. SageMaker Autopilot automatically generates an explainability report that includes feature importance, which helps users understand which features influenced the model's predictions. This report is produced for the best model and provides insights into model decisions, aligning with the requirement to understand model decisions. Autopilot's explainability report is a built-in feature that leverages SHAP values to compute feature attributions, but it is presented as a report, not just a raw plot.

Answer

A leaderboard of models with only accuracy metrics

Answer

A confusion matrix for each candidate model

Answer

A SHAP values summary plot for each trial

Question 10

A company wants to deploy a foundation model from SageMaker JumpStart with the lowest possible inference cost, given that latency requirements are flexible. They have a mix of traffic volumes. Which approach should they take?

Accepted Answer

Select the smallest instance type that meets throughput requirements and enable automatic scaling. SageMaker JumpStart provides pre-built models; for cost optimization, choosing the smallest suitable instance type and enabling auto-scaling based on demand reduces cost while handling varying traffic.

Answer

Use SageMaker Savings Plans to get a discount on on-demand instances

Answer

Deploy the model on the largest GPU instance to handle peak load

Answer

Deploy the model on a serverless inference endpoint