A company uses a large language model to generate answers to employee questions about internal HR policies. However, the model sometimes produces answers that are factually incorrect or not based on the official policies. To reduce these inaccuracies, the company wants to provide the model with relevant, up-to-date policy documents as extra context before generating a response. Which technique is being applied?
Grounding, or RAG, retrieves relevant external documents and includes them in the prompt context, which helps the model generate factually accurate answers.
Why this answer
The technique described is Retrieval-Augmented Generation (RAG), which retrieves relevant, up-to-date policy documents from an external knowledge base and provides them as context to the large language model before generating a response. This grounds the model's output in verified data, reducing factual inaccuracies without modifying the model itself. Option C is correct because RAG directly addresses the need to supply extra context from authoritative sources.
Exam trap
The trap here is that candidates may confuse fine-tuning (which modifies the model) with RAG (which augments the prompt with external data), or assume prompt engineering alone can inject new information, when in fact RAG is the specific technique for grounding with external, up-to-date documents.
How to eliminate wrong answers
Option A is wrong because prompt engineering only involves crafting the input prompt to guide the model's behavior, but it does not inject external, up-to-date documents as context; it relies solely on the model's pre-existing knowledge. Option B is wrong because fine-tuning would retrain the model on policy documents, which is a more resource-intensive process that updates the model's parameters, whereas the scenario describes providing extra context at inference time without altering the model. Option D is wrong because a content filter is a post-processing safety mechanism that blocks or flags harmful or inappropriate outputs, not a technique to supply factual context for accuracy.