Techniques to Improve Generative AI Model Output →hardMultiple Choice

Generative AI Leader Practice Question: Techniques to Improve Generative AI Model Output

A healthcare company is using a generative AI model to draft patient education materials. The model sometimes generates content that includes specific medical advice, which could be harmful if inaccurate. The company wants to ensure that the model's outputs are safe and do not provide medical recommendations. Which technique should they implement?

⚠ Common exam trap

The trap here is thinking that technical parameter adjustments like temperature will solve content safety issues, when in fact clear instructions in the prompt are often more effective for controlling what the model says.

Answer choices

Why each option matters

Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.

Correct answer & explanation

✓

Implement prompt engineering with explicit instructions to avoid providing medical advice.

Prompt engineering with explicit instructions is a direct and efficient way to constrain the model's output. By clearly stating that the model should not provide medical advice, the model is guided to generate only general educational content. This approach is flexible and can be updated as needed without retraining, making it suitable for the healthcare company's requirement to ensure safety.

Answer analysis

Option-by-option breakdown

For each option: why learners choose it and why it is or isn't the right answer here.

✗
Apply a safety filter that blocks any output containing medical terminology.
Why it's wrong here
Blocking all medical terminology would be overly broad and would prevent the generation of any medically related content, which is the core purpose of patient education materials. The goal is to avoid specific advice, not all medical terms. A more nuanced approach is needed to distinguish between general information and personalized recommendations.
✗
Reduce the model's temperature to make outputs more deterministic and less likely to include advice.
Why it's wrong here
Lowering temperature makes the model's output more predictable and less random, but it does not specifically prevent the model from including medical advice. The model could still generate advice if it is part of the learned patterns. Temperature adjustment does not address the content constraints needed here.
✓
Implement prompt engineering with explicit instructions to avoid providing medical advice.
Why this is correct
Prompt engineering with clear instructions, such as 'Do not provide medical advice; only provide general information,' can effectively steer the model away from generating harmful recommendations. This is a low-cost, immediate solution that can be refined iteratively. It leverages the model's ability to follow instructions when they are explicit and well-crafted.
✗
Use reinforcement learning from human feedback (RLHF) to fine-tune the model to avoid giving advice.
Why it's wrong here
RLHF can align model behavior, but it requires significant resources, including human feedback and training time. While it could be effective long-term, it is not the most immediate or targeted solution for this scenario. The company needs a quicker, more controllable method to prevent advice in outputs.

Go deeper

Generative AI Leader Practice Question: Techniques to Improve Generative AI Model Output

Why each option matters

Option-by-option breakdown

Related to this question