CCAR-F Context and Reliability Practice Question
You are building a customer support assistant using the Claude API. The assistant must answer questions based solely on a provided knowledge base of 20 product manuals. You want to ensure that when the answer is not in the knowledge base, Claude explicitly states 'I don't know' rather than fabricating an answer. Which technique is most reliable for achieving this?
⚠ Common exam trap
The trap here is assuming that lowering temperature or fine-tuning will eliminate hallucinations, when only explicit instructions can reliably enforce a 'don't know' response.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Include a system prompt instructing Claude to answer only from the provided context and to respond with 'I don't know' if the answer is not present.
The most reliable way to ensure Claude answers only from provided context and admits ignorance is to explicitly instruct it via a system prompt. This leverages the model's instruction-following ability to constrain its responses. Other methods like lowering temperature or fine-tuning do not directly enforce this behavior and may still result in hallucinations when the answer is missing.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Use a larger context window to include all 20 manuals in every request.
Why it's wrong here
Including all manuals increases the chance that the answer is present, but if the answer is truly absent, the model may still fabricate one. A larger context does not enforce a 'don't know' response. It also increases cost and latency. This method addresses availability, not the reliability of admitting ignorance.
- ✗
Fine-tune Claude on a dataset of questions and correct answers from the manuals.
Why it's wrong here
Fine-tuning can improve performance on specific tasks but is not a guarantee against hallucinations, especially for questions outside the training distribution. It also does not inherently teach the model to say 'I don't know' when the answer is not in the provided context. This approach is resource-intensive and less reliable than prompt-based constraints.
- ✗
Set the temperature parameter to 0 to reduce randomness in responses.
Why it's wrong here
Lowering temperature reduces variability but does not prevent the model from generating plausible-sounding but incorrect information when the answer is absent from the context. The model may still hallucinate confidently. Temperature controls randomness, not factual grounding. Thus, this approach fails to ensure the model acknowledges missing information.
- ✓
Include a system prompt instructing Claude to answer only from the provided context and to respond with 'I don't know' if the answer is not present.
Why this is correct
A system prompt sets the model's behavior and constraints. Explicitly instructing Claude to rely only on the given context and to admit ignorance when the answer is absent leverages the model's instruction-following capability. This is a direct and effective method to reduce hallucinations in retrieval-augmented generation scenarios, ensuring responses are grounded.
About these practice questions
One of 271 original CCAR-F practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written and reviewed by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
Last reviewed September 2026 · checked against the official Anthropic exam blueprint
This CCAR-F practice question is part of Courseiva's free Anthropic certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the CCAR-F exam.