MLS-C01 Modeling Practice Test 32 — 15 Questions

Question 1

Refer to the exhibit. A data scientist runs the above CLI command to create a SageMaker training job. The job fails with an error 'Unable to read data from s3://bucket/train/'. What is the MOST likely cause?

Choose an answer to begin — your selection is scored in the full session.

Accepted Answer

The IAM role does not have permissions to read from the S3 bucket. The error 'Unable to read data from s3://bucket/train/' indicates that the SageMaker training job cannot access the S3 input data. The most common cause is that the IAM role specified in the command does not have the necessary s3:GetObject permission on the S3 bucket or objects. SageMaker uses the IAM role to assume permissions for reading training data, and without proper S3 read access, the job fails at the data loading stage.

Answer

The training image is not accessible

Answer

The instance type does not support the required memory

Answer

The training job is in a different region than the S3 bucket

Question 2

A data scientist is training a binary classification model on a dataset where the positive class represents only 1% of the data. The model's accuracy is 99%, but the recall for the positive class is 0%. Which metric should the scientist use to evaluate the model's performance effectively?

Accepted Answer

Area under the Precision-Recall curve (PR AUC). In a highly imbalanced dataset where the positive class is only 1%, accuracy is misleading because a model can achieve 99% accuracy by simply predicting the negative class for all samples, resulting in 0% recall for the positive class. The Area under the Precision-Recall curve (PR AUC) is the correct metric because it focuses on the performance of the positive class by evaluating the trade-off between precision and recall, making it sensitive to changes in the minority class. Unlike ROC AUC, which can be overly optimistic in imbalanced settings due to the large number of true negatives, PR AUC provides a more realistic assessment of model performance for rare events.

Answer

Area under the ROC curve (ROC AUC)

Answer

Accuracy

Answer

F1 score

Question 3

A machine learning team is deploying a real-time inference endpoint for a fraud detection model using Amazon SageMaker. The model requires low latency (<100 ms) and the team expects a steady stream of requests with occasional spikes. Which instance type and deployment strategy should they use to minimize cost while meeting latency requirements?

Accepted Answer

Use ml.c5 instances with a single endpoint and auto-scaling with a minimum instance count to handle baseline traffic.. Ml.c5 instances are compute-optimized for low-latency inference, and auto-scaling with a minimum instance count ensures pre-warmed capacity to handle steady traffic with spikes without cold starts, meeting the <100 ms requirement cost-effectively. This combination avoids over-provisioning while ensuring consistent performance.

Answer

Use ml.p3 instances with a multi-model endpoint.

Answer

Use AWS Lambda with a container image for serverless inference.

Answer

Use ml.m5 instances with a production variant and auto-scaling.

Question 4

A data scientist is training a deep learning model on Amazon SageMaker using a PyTorch estimator. The training job runs on a single ml.p3.2xlarge instance but is taking too long. The scientist wants to reduce training time by using distributed data parallelism across multiple GPUs. Which change to the training script and SageMaker estimator is required?

Accepted Answer

Modify the script to use torch.nn.parallel.DistributedDataParallel and set instance_count to 2 in the estimator.. To achieve distributed data parallelism across multiple GPUs on multiple instances with PyTorch, you must modify the training script to use `torch.nn.parallel.DistributedDataParallel` (DDP), which handles gradient synchronization across nodes. Additionally, you must set `instance_count` to 2 (or more) in the SageMaker PyTorch estimator to launch multiple instances, each with its own GPU, enabling true multi-node distributed training.

Answer

Add the SageMaker distributed data parallelism configuration in the estimator and modify the script to use the SageMaker distributed library.

Answer

Change the framework to TensorFlow and use tf.distribute.MirroredStrategy with instance_count=2.

Answer

Modify the script to use torch.nn.DataParallel and keep instance_count as 1.

Question 5

A team is training a linear regression model to predict house prices. After training, they observe that the model has high bias (underfitting). Which action is most likely to reduce bias?

Accepted Answer

Add more relevant features and increase model complexity.. High bias (underfitting) means the model is too simple to capture the underlying patterns in the data. Adding more relevant features and increasing model complexity (e.g., using polynomial features or more interaction terms) gives the linear regression model greater capacity to fit the training data, directly reducing bias. This aligns with the bias-variance tradeoff, where increasing complexity lowers bias at the cost of potentially increasing variance.

Answer

Increase the regularization strength.

Answer

Reduce the amount of training data.

Answer

Decrease the number of model parameters.

Question 6

A machine learning engineer is using Amazon SageMaker to train a model. The training data is stored in an S3 bucket encrypted with AWS KMS. The SageMaker training job fails with an AccessDenied error when trying to read the data. Which IAM policy addition should resolve the issue?

Accepted Answer

Add kms:Decrypt permission for the KMS key.. When an S3 bucket is encrypted with AWS KMS, the SageMaker training job's execution role must have the `kms:Decrypt` permission for the specific KMS key to read the encrypted objects. Without this permission, the job fails with an AccessDenied error, even if `s3:GetObject` is granted, because SageMaker must decrypt the data before reading it.

Answer

Add s3:GetObject permission for the bucket.

Answer

Add kms:GenerateDataKey permission for the key.

Answer

Attach the AmazonSageMakerFullAccess policy.

Question 7

A data scientist is building a recommendation system using matrix factorization. The dataset has 1 million users and 100,000 items, with a sparse user-item interaction matrix. The scientist wants to minimize training time on Amazon SageMaker. Which algorithm would be most appropriate?

Accepted Answer

Factorization Machines. Factorization Machines (B) are specifically designed for sparse, high-dimensional datasets like the user-item interaction matrix in recommendation systems. They extend matrix factorization by modeling pairwise feature interactions, which is ideal for collaborative filtering tasks. On Amazon SageMaker, the built-in Factorization Machines algorithm is optimized for sparse data and can train efficiently on 1 million users and 100,000 items, minimizing training time compared to general-purpose algorithms.

Answer

Linear Learner

Answer

K-Means

Answer

XGBoost

Question 8

A team is training a binary classifier and obtains a confusion matrix with 100 true positives, 10 false positives, 20 false negatives, and 200 true negatives. What is the precision of the model?

Accepted Answer

0.91. Precision is calculated as TP / (TP + FP). With 100 true positives and 10 false positives, precision = 100 / (100 + 10) = 100 / 110 ≈ 0.909, which rounds to 0.91. This metric measures how many of the positive predictions were actually correct.

Answer

0.87

Answer

0.94

Answer

0.83

Question 9

A data scientist is using Amazon SageMaker to train a model with a custom Docker container. The training job fails with an error: 'Container exited with code 137'. What is the most likely cause?

Accepted Answer

The training instance ran out of memory.. Exit code 137 (128+9) indicates the container was killed by the SIGKILL signal, which typically occurs when the Linux Out-Of-Memory (OOM) killer terminates a process that has exceeded its memory allocation. In Amazon SageMaker, training instances have finite memory, and if the training algorithm or data loading exceeds that limit, the OOM killer forcibly stops the container, resulting in exit code 137.

Answer

The training data was corrupted.

Answer

The training job exceeded the maximum runtime.

Answer

The Docker entrypoint script was not found.

Question 10

A machine learning engineer is deploying a model to an Amazon SageMaker endpoint for real-time inference. The model is a large ensemble that requires 4 GB of memory. The engineer wants to minimize cost while ensuring the endpoint can handle up to 100 concurrent requests with a latency under 200 ms. Which instance configuration is most appropriate?

Accepted Answer

One ml.c5.xlarge instance with auto-scaling up to 2 instances.. The ml.c5.xlarge instance provides sufficient compute (4 vCPUs, 8 GB memory) for the 4 GB model, and auto-scaling up to 2 instances allows handling 100 concurrent requests with low latency while minimizing cost during low traffic. The ml.c5 family is optimized for compute-intensive inference, and auto-scaling ensures the endpoint scales out only when needed, avoiding over-provisioning.

Answer

Two ml.t3.medium instances behind a load balancer.

Answer

One ml.m5.2xlarge instance.

Answer

One ml.p3.2xlarge instance.

Question 11

Which TWO of the following are best practices for training deep learning models on Amazon SageMaker? (Select TWO.)

Accepted Answer

Use Pipe input mode to stream data directly from S3 to the algorithm.. SageMaker's Pipe input mode streams training data directly from Amazon S3 to the algorithm without writing it to disk, reducing I/O latency and eliminating the need for large local storage. This is especially beneficial for deep learning models that iterate over large datasets, as it allows training to start faster and avoids the overhead of downloading data to EBS volumes.

Answer

Use SageMaker Processing to perform data augmentation before training.

Answer

Store training data on Amazon EBS volumes attached to the training instance.

Answer

Disable checkpointing to improve training speed.

Question 12

A data scientist is tuning a gradient boosting model using Amazon SageMaker Automatic Model Tuning (AMT). Which THREE hyperparameters should the scientist consider tuning to reduce overfitting? (Select THREE.)

Accepted Answer

Learning rate (eta). Learning rate (eta) controls the contribution of each tree to the ensemble. A lower learning rate forces the model to learn more slowly, requiring more trees but reducing the risk of overfitting by preventing any single tree from having too much influence on the final prediction.

Answer

Subsample ratio

Answer

Maximum depth (max_depth)

Question 13

Which TWO of the following are valid Amazon SageMaker built-in algorithms for regression tasks? (Select TWO.)

Accepted Answer

XGBoost. XGBoost is a valid Amazon SageMaker built-in algorithm for regression tasks because it supports regression objectives such as 'reg:squarederror' and 'reg:logistic'. It is a gradient boosting framework that builds an ensemble of decision trees, making it suitable for both regression and classification problems.

Answer

BlazingText

Answer

Image Classification

Answer

Object Detection

Question 14

Refer to the exhibit. The log shows the end of a successful SageMaker training job. However, the ML engineer cannot find the model artifacts in the specified S3 bucket. What is the most likely cause?

Accepted Answer

The IAM role used by the training job does not have permission to write to the S3 bucket.. The training job completed successfully, meaning the SageMaker training container executed without errors. However, if the model artifacts are not found in the specified S3 bucket, the most likely cause is that the IAM role associated with the training job lacks the necessary s3:PutObject permission for that bucket. SageMaker uses the role's credentials to write the output; without write access, the artifacts are silently dropped or fail to upload, even though the training code itself may have run to completion.

Answer

The S3 bucket does not exist.

Answer

The model artifacts were uploaded to a different S3 path.

Answer

The training job did not have network access to S3.

Question 15

Refer to the exhibit. An IAM policy is attached to a SageMaker notebook instance. A data scientist is trying to invoke the endpoint 'my-endpoint' from the notebook but receives an AccessDenied error. What is the likely cause?

Accepted Answer

The policy is not attached to the IAM role used by the notebook instance.. The error 'AccessDenied' when invoking a SageMaker endpoint from a notebook instance typically indicates that the IAM role attached to the notebook does not have the required permissions. The policy shown in the exhibit grants sagemaker:InvokeEndpoint for the specific endpoint ARN, but if the policy is not attached to the IAM role that the notebook instance is using, the role lacks the permission, resulting in the AccessDenied error. Attaching the policy to the correct IAM role resolves the issue.

Answer

The policy allows InvokeEndpoint only for endpoints with the exact ARN, but the endpoint ARN is different.

Answer

The policy uses a wildcard for CreateEndpoint, which is too permissive.

Answer

The policy does not allow sagemaker:CreateEndpoint for the specific endpoint.