A hospital deploys an AI diagnostic assistant that analyzes medical images. The system has been in use for six months, and radiologists have reported that the AI is increasingly confident in its predictions, but sometimes misses rare conditions. The AI ethics board is concerned about overreliance and potential harm from false negatives. They want to implement a governance framework that ensures appropriate human oversight. The hospital has a limited IT budget. What is the best approach?
Routing low-confidence and rare-condition predictions to mandatory radiologist review directly counters false negatives and overreliance, satisfying the ethics board's oversight requirement while respecting the limited budget, since it adds a triage workflow rather than expensive new infrastructure.
Why this answer
A human-in-the-loop process that triggers mandatory radiologist review only for low-confidence or rare-condition predictions directly addresses the risk of overreliance and false negatives without overwhelming the limited IT budget. This targeted oversight ensures that the AI's increasing confidence does not lead to missed rare conditions, while still allowing routine high-confidence predictions to proceed efficiently. The approach balances safety and resource constraints by focusing human attention where the AI is most likely to err.
Exam trap
CompTIA AI often tests the distinction between passive warnings (like option B) and active workflow controls (like option A), where candidates mistakenly believe that a simple disclaimer is sufficient for governance when actual process enforcement is required.
How to eliminate wrong answers
Option B is wrong because adding a static warning does not enforce any change in workflow or guarantee that radiologists will actually catch missed rare conditions; it merely shifts liability without reducing the risk of false negatives. Option C is wrong because requiring all AI predictions to be reviewed by a radiologist before final diagnosis would be prohibitively expensive and slow, defeating the purpose of using AI to improve throughput and contradicting the limited IT budget constraint. Option D is wrong because increasing the false positive threshold would reduce false negatives but would also increase false positives, potentially overwhelming radiologists with unnecessary alerts and degrading trust in the system, while not addressing the core issue of overreliance on the AI's confidence.