Courseiva

NCP-GENL practice exam session

NCP-GENL

Study mode — explanations shown

1

Fine-Tuning

medium

A team is fine-tuning a 13B-parameter Llama model with NVIDIA NeMo on a node of eight A100 80GB GPUs. They want the optimizer state to be partitioned across data-parallel ranks so that per-GPU memory drops, while keeping the model replicas synchronized. Which distributed strategy should they select in the NeMo training configuration?

0 of 10 answered