Courseiva

RAG for Grounding Chatbot Responses

A company is building a chatbot using Amazon Bedrock to answer customer questions about their product catalog. The chatbot should only use information from the company's internal knowledge base and should not generate answers based on the model's pre-training data. Which feature should be enabled?

Quick Answer

The requirement here is stronger than typical grounding — the chatbot must not just use the internal knowledge base, it must avoid falling back on the model's pre-training knowledge at all, which is exactly what a properly configured RAG setup in Bedrock accomplishes. When a knowledge base is configured, incoming questions trigger a retrieval step that pulls the relevant product catalog documents first, and those retrieved passages are injected into the prompt as the context the model is instructed to answer from, rather than the model reasoning purely from what it learned during training. This retrieval-first structure is what makes it possible to constrain the model to the provided data specifically, since the answer is built around documents supplied at query time rather than facts baked into the model's weights months or years earlier. Without RAG configured, the same underlying model would still answer product questions, but it would be drawing on whatever general knowledge it picked up during pre-training, which could be outdated, generic, or simply wrong for this company's specific catalog. Any scenario insisting that responses come exclusively from a defined internal data source, explicitly ruling out the model's own general knowledge, is describing this knowledge-base-plus-RAG configuration.

⚠ Common exam trap

Many candidates confuse fine-tuning with RAG, assuming fine-tuning alone can restrict the model to a specific knowledge domain, when in fact fine-tuning does not prevent the model from using its pre-training data and can still produce off-topic responses.

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

✓

Configure a knowledge base with Retrieval Augmented Generation (RAG)

Configuring a knowledge base with Retrieval Augmented Generation (RAG) allows the chatbot to retrieve relevant documents from the company's internal knowledge base and use them as context for generating answers. This ensures the model's responses are grounded solely in the provided data, preventing reliance on its pre-training knowledge.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

  • ✗

    Use prompt engineering to instruct the model to only use the knowledge base

    Why it's wrong here

    Prompt engineering only steers the model; it cannot guarantee answers come solely from the knowledge base, since pre-training data remains available. It tempts as a low-effort nudge, and suits shaping tone or format when grounding is not a hard requirement.

  • ✓

    Configure a knowledge base with Retrieval Augmented Generation (RAG)

    Why this is correct

    RAG grounds responses in the supplied knowledge base by retrieving relevant documents and injecting them into the prompt context, so the model answers from company data rather than its pre-training weights. This directly satisfies the constraint that answers must come only from the internal catalogue.

  • ✗

    Enable model invocation logging to review responses

    Why it's wrong here

    Invocation logging records prompts and responses for auditing; it does not constrain generation to the knowledge base, so pre-training answers still appear. It tempts for compliance or debugging, where capturing traffic is the goal rather than controlling which sources the model uses.

  • ✗

    Fine-tune the model on the product catalog data

    Why it's wrong here

    Fine-tuning alters the model's weights, so answers still draw on pre-training data and cannot be restricted to the knowledge base. It tempts when you want the model to absorb domain style or terminology, which suits adapting tone rather than grounding responses in retrieved documents.

About these practice questions

This AIF-C01 question is part of Courseiva's 862-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →

How Courseiva writes practice questions · Editorial policy

Same concept, more angles

1 more way this is tested on AIF-C01

These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.

Variation 1. A developer is using Amazon Bedrock to build a chatbot that answers customer queries. The chatbot must only respond based on the provided company documentation. Which approach best meets this requirement?

easy
  • A.Use prompt engineering to instruct the model to only use documentation.
  • ✓ B.Use a RAG architecture with the company documentation as the knowledge base.
  • C.Fine-tune a foundation model on the company documentation.
  • D.Use a text classification model to filter responses.

Why B: Retrieval-Augmented Generation (RAG) architecture retrieves relevant chunks from the company documentation at query time and injects them into the prompt, ensuring the model's response is grounded solely in the provided documents. This approach prevents the model from relying on its internal training data or generating information outside the documentation, which is critical for a closed-domain chatbot.

JA

Written by Johnson Ajibi, MSc IT Security

Senior Network & Security Engineer · founder of Courseiva

This AIF-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AIF-C01 exam.