1Z0-1127-25 LLM Fundamentals Practice Question
What is the primary difference between pre-training and fine-tuning in the context of large language models?
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Pre-training trains from scratch, fine-tuning updates all weights on a new dataset
Pre-training trains a model on a large, general corpus to learn language representations; fine-tuning adapts the pre-trained model to a specific task or domain using a smaller labeled dataset.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✓
Pre-training trains from scratch, fine-tuning updates all weights on a new dataset
Why this is correct
Pre-training involves training from random initialization on a large corpus; fine-tuning starts from pre-trained weights and updates them on a smaller dataset.
- ✗
Pre-training uses a smaller dataset, fine-tuning uses a larger dataset
Why it's wrong here
Pre-training typically uses massive datasets; fine-tuning uses smaller, task-specific datasets.
- ✗
Pre-training produces embeddings, fine-tuning produces text generation
Why it's wrong here
Both pre-training and fine-tuning can produce either embeddings or generative models depending on architecture.
- ✗
Pre-training is unsupervised, fine-tuning is always supervised
Why it's wrong here
Pre-training is often self-supervised (e.g., masked language modeling), but fine-tuning can be supervised or unsupervised.
Go deeper
Related to this question
About these practice questions
One of 768 original 1Z0-1127-25 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This 1Z0-1127-25 practice question is part of Courseiva's free Oracle certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the 1Z0-1127-25 exam.