Refer to the exhibit. A data scientist received this output after submitting a fine-tuning job. What is the most effective change to resolve the out-of-memory error?
Correct: More nodes mean more total memory, alleviating OOM.
Why this answer
The out-of-memory error during fine-tuning indicates that the model's memory requirements exceed the available resources on the current node. Increasing the number of nodes in the cluster distributes the model parameters, gradients, and optimizer states across multiple GPUs or nodes, effectively increasing the total memory capacity and resolving the OOM error. This is a standard approach in distributed training frameworks like PyTorch DDP or FSDP, which OCI Data Science supports.
Exam trap
Oracle often tests the misconception that reducing epochs or learning rate can fix memory errors, when in fact memory errors are resource constraints that require scaling hardware (more nodes or GPUs) or reducing memory-intensive parameters like batch size or sequence length.
How to eliminate wrong answers
Option A is wrong because increasing the sequence length would increase the memory footprint per sample (due to larger attention matrices), making the OOM error worse, not better. Option B is wrong because reducing the learning rate affects training dynamics and convergence, not memory usage; it does not address the root cause of insufficient memory. Option C is wrong because decreasing the number of fine-tuning epochs reduces total training time but does not change the peak memory consumption per step, so the OOM error would still occur.