A hospital deploys an AI system to assist with diagnosing diseases from medical images. A doctor disagrees with the system's diagnosis and overrules it. The hospital wants to document this interaction for legal and audit purposes. Which Microsoft responsible AI principle is most directly relevant?
Accountability is the responsible AI principle that assigns clear human ownership and oversight for system outcomes, requiring role definition, audit trails, and records of decisions, including instances where a clinician overrides an AI recommendation. In healthcare, an override log enables retrospective review, incident analysis, and regulatory compliance by showing that a qualified human retained ultimate responsibility. This principle directly matches the scenario: documenting overrides creates the traceability needed to hold individuals and institutions answerable.
Why this answer
The scenario involves documenting a human override of an AI system's diagnosis for legal and audit purposes, which directly relates to accountability. Accountability in responsible AI ensures that organizations can answer for their AI systems' decisions by maintaining clear records of interactions, including when humans overrule AI outputs. This principle requires traceability and governance mechanisms, such as audit trails, to assign responsibility for outcomes.
Exam trap
Microsoft often tests the distinction between transparency (explaining how the AI works) and accountability (documenting who is responsible for decisions), leading candidates to incorrectly choose transparency when the question emphasizes legal documentation and audit trails.
How to eliminate wrong answers
Option A is wrong because fairness focuses on mitigating bias and ensuring equitable treatment across demographic groups, not on documenting human-AI decision interactions. Option B is wrong because reliability and safety concern the system's consistent performance and robustness against failures, not the legal documentation of overrides. Option C is wrong because transparency involves explaining how the AI system works and its limitations, but the core need here is to document who made the final decision and why, which falls under accountability.