1Z0-1127-25 LLM Fundamentals Practice Question

Which of the following best describes the difference between pre-training and fine-tuning?

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

✓

Pre-training learns general language representations; fine-tuning adapts to a specific task

Pre-training is the initial phase where a model learns general language patterns from a large corpus. Fine-tuning adapts the pre-trained model to a specific task using a smaller labeled dataset.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

✗
Pre-training uses labeled data; fine-tuning uses unlabeled data
Why it's wrong here
Pre-training typically uses unlabeled data for language modeling; fine-tuning uses labeled data for specific tasks.
✓
Pre-training learns general language representations; fine-tuning adapts to a specific task
Why this is correct
This accurately describes the two stages.
✗
Fine-tuning requires more data than pre-training
Why it's wrong here
Fine-tuning uses orders of magnitude less data than pre-training.
✗
Pre-training is done on a single task; fine-tuning is done on multiple tasks
Why it's wrong here
Pre-training is task-agnostic; fine-tuning is for a specific task.

Go deeper

1Z0-1127-25 LLM Fundamentals Practice Question

Why each option matters

Option-by-option breakdown

Related to this question