A healthcare insurer has deployed an AI claims-triage model. Six months after launch, the model's denial rate for one demographic has drifted upward while overall accuracy remains stable. The AI program manager needs to detect and respond to this issue as part of ongoing AI governance. Which control is most appropriate?
This is correct because the harm is invisible in aggregate metrics and only appears when performance is disaggregated by demographic group. Continuous monitoring with pre-set thresholds creates a detection mechanism and a defined response, such as human review, retraining, or rollback. This aligns with AI governance expectations for ongoing fairness and performance oversight after deployment, not just at approval time.
Why this answer
The scenario describes demographic performance drift hidden by stable aggregate accuracy, which only disaggregated, continuous monitoring can detect. Defining thresholds in advance converts detection into action, enabling review, retraining, or rollback. Pre-deployment validation, blanket manual review, and annual revalidation all fail to provide timely, subgroup-level detection and response, which is the core governance requirement for a live high-impact model.
Exam trap
The trap here is trusting stable aggregate accuracy as evidence that the model is behaving fairly, when the harm only appears in disaggregated subgroup metrics.