Courseiva
Machine Learning Implementation and OperationsmediumMultiple ChoiceObjective-mapped

MLS-C01 Practice Question: Machine Learning Implementation and Operations

A team uses SageMaker to train a deep learning model. They notice the training job is using only a fraction of the GPU memory. Which configuration change would most improve GPU utilization?

⚠ Common exam trap

Candidates often confuse memory fragmentation (which is a memory allocation issue) with overall utilization, and incorrectly assume reducing batch size will fix fragmentation when the real problem is underutilization due to insufficient computational load.

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

Increase the batch size in the training script

Increasing the batch size allows each training step to process more data samples simultaneously, which increases the computational load per step and better saturates the GPU's parallel processing units. This directly improves GPU memory utilization because larger batches keep more tensors resident in memory and increase the arithmetic intensity of matrix operations, reducing idle time.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

  • Increase the batch size in the training script

    Why this is correct

    Larger batch sizes consume more GPU memory and improve utilization.

  • Decrease the batch size to reduce memory fragmentation

    Why it's wrong here

    Smaller batch sizes reduce utilization.

  • Use a single GPU instead of multiple GPUs

    Why it's wrong here

    Single GPU may have lower throughput.

  • Enable SageMaker Managed Spot Training

    Why it's wrong here

    Spot training does not affect GPU utilization.

About these practice questions

Courseiva writes every MLS-C01 question from scratch — 1,672 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →

How Courseiva writes practice questions · Editorial policy

JA

Written by Johnson Ajibi, MSc IT Security

Senior Network & Security Engineer · founder of Courseiva

This MLS-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the MLS-C01 exam.