AIF-C01 Applications of Foundation Models Practice Question
A company is developing a chatbot using Amazon Bedrock and wants to ensure the model's responses do not include toxic or biased language. The company has a labeled dataset of undesirable responses. Which approach should be used to fine-tune the foundation model to reduce harmful outputs?
⚠ Common exam trap
The AIF-C01 exam often tests the misconception that supervised fine-tuning or prompt engineering alone can reliably eliminate harmful outputs, when in fact RLHF is required to align the model with nuanced human preferences through iterative feedback.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Use reinforcement learning from human feedback (RLHF) with a reward model trained on human preferences.
Reinforcement learning from human feedback (RLHF) is the correct approach because it directly optimizes the model to avoid toxic or biased outputs by training a reward model on human-labeled preferences. The reward model scores the model's responses, and the foundation model is fine-tuned via reinforcement learning to maximize these scores, effectively reducing harmful language. This method is specifically designed to align model behavior with nuanced human values, such as avoiding toxicity, which supervised fine-tuning alone cannot guarantee.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✓
Use reinforcement learning from human feedback (RLHF) with a reward model trained on human preferences.
Why this is correct
RLHF uses human feedback to train a reward model, which then guides the base model to generate safer outputs.
- ✗
Perform supervised fine-tuning on a curated dataset of safe responses.
Why it's wrong here
Supervised fine-tuning alone may not sufficiently reduce toxicity without explicit reward signals.
- ✗
Use prompt engineering to instruct the model to avoid toxic language.
Why it's wrong here
Prompt engineering is a runtime technique, not a training/fine-tuning approach.
- ✗
Implement adversarial validation by testing against toxic inputs.
Why it's wrong here
Adversarial validation is a testing technique, not a training method to adjust model weights.
Go deeper
Related to this question
About these practice questions
This AIF-C01 question is part of Courseiva's 619-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AIF-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AIF-C01 exam.