What is Fine-Tuning a Language Model?
What is 'fine-tuning' a language model and when should you use it instead of prompt engineering?
Quick Answer
The answer is further training a model on domain-specific data to change its behaviour permanently for a task. Fine-tuning takes a pre-trained language model and continues its training on a specialized dataset, adjusting the model’s weights so it becomes permanently adapted to a particular domain or function, unlike prompt engineering which only guides the model’s output temporarily through input instructions. On the Microsoft Azure AI Fundamentals AI-900 exam, this concept tests your understanding of when to retrain a model versus relying on prompts—a common trap is assuming prompt engineering can handle all specialized tasks, but fine-tuning is required for consistent, high-stakes outputs like classifying medical records or generating legal documents. A helpful memory tip: think of fine-tuning as giving the model a permanent new skill, while prompt engineering is like giving it a temporary reminder.
⚠ Common exam trap
Candidates often confuse fine-tuning with other model customization techniques like prompt engineering or hyperparameter tuning, but the key distinction is that fine-tuning permanently alters the model's weights through additional training, whereas prompt engineering only changes the input instructions.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Further training a model on domain-specific data to change its behaviour permanently for a task
Fine-tuning is the process of taking a pre-trained language model and further training it on a domain-specific dataset to adapt its behavior permanently for a particular task. This is used instead of prompt engineering when the task requires consistent, specialized outputs that cannot be reliably achieved through prompt instructions alone, such as classifying medical records or generating legal documents.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Fine-tuning repairs errors in a model's base training data
Why it's wrong here
Base training data fixes are a pre-training concern — fine-tuning adapts a trained model for new tasks using additional training data.
- ✓
Further training a model on domain-specific data to change its behaviour permanently for a task
Why this is correct
Fine-tuning updates model weights on task-specific data — creating a customised model rather than relying on prompts alone.
- ✗
Adjusting the model's temperature setting to produce more consistent outputs
Why it's wrong here
Temperature is an inference parameter — fine-tuning is a training process that modifies the model's weights.
- ✗
Selecting which pre-trained model from the Azure model catalogue best suits your task
Why it's wrong here
Model selection is a design decision — fine-tuning is the process of adapting a chosen model with additional task-specific training.
Go deeper
Related to this question
Learn chapter
Azure AI Language Service
Key term
Prompt engineering
Prompt engineering is the practice of designing and refining input queries to AI models to get the most accurate, relevant, and useful outputs.
Key term
Model
In IT and AI, a model is a trained mathematical representation that learns patterns from data to make predictions or decisions.
About these practice questions
This AI-900 question is part of Courseiva's 985-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
Same concept, more angles
1 more way this is tested on AI-900
These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.
Variation 1. A marketing team wants to use a generative AI model to produce social media posts that match their brand's specific tone and style. They have a small set of example posts written by their copywriters. Which approach should they use to customize the model's outputs without retraining the entire model?
medium- ✓ A.Prompt engineering with carefully designed instructions
- B.Fine-tuning the model on the example posts
- C.Grounding the model with a knowledge base of brand guidelines
- D.Implementing a content filter to enforce brand rules
Why A: Prompt engineering, especially few-shot prompting, allows the model to match a desired tone and style by providing example posts in the instruction. It does not involve any training or weight updates, satisfying the 'without retraining' requirement. Fine-tuning (B) requires a large dataset and involves further training, which conflicts with the constraint. Grounding (C) adds context but does not effectively customize style, and content filtering (D) is for safety, not style.
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI-900 practice question is part of Courseiva's free Microsoft certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI-900 exam.