A city council deploys an AI system to analyze surveillance footage and automatically issue traffic violation fines. They want to ensure the system does not disproportionately target one type of vehicle (e.g., bicycles over cars) when issuing fines. Which Microsoft responsible AI principle is most directly relevant?
Trap 1: Inclusiveness
Inclusiveness focuses on empowering a diverse range of people, including users with disabilities, and ensuring that the AI system is accessible and built with input from varied communities. The concern in this scenario is not about who is included in the design process or the system's accessibility, but about whether the system's analysis treats different categories of vehicles equitably. That distinction places it under Fairness rather than Inclusiveness.
Trap 2: Reliability and safety
Reliability and safety address whether the AI system functions consistently, is robust to errors, and avoids causing physical or operational harm in its given environment. The scenario does not describe system crashes, inaccurate detections, or unsafe actions; it describes a pattern of unequal treatment across vehicle classes. A system could be perfectly reliable and safe while still being unfair, so this principle does not address the core issue.
Trap 3: Transparency
Transparency pertains to the visibility and interpretability of an AI system's workings, such as providing explanations for why a particular decision was made or making the model's logic open to review. The problem in the scenario is not that the system's logic is hidden, but that the consequences of its analysis are inequitable across vehicle types. Without a fairness evaluation, explaining the system's decisions would not remedy the underlying bias.
- A
Inclusiveness
Why wrong: Inclusiveness focuses on empowering a diverse range of people, including users with disabilities, and ensuring that the AI system is accessible and built with input from varied communities. The concern in this scenario is not about who is included in the design process or the system's accessibility, but about whether the system's analysis treats different categories of vehicles equitably. That distinction places it under Fairness rather than Inclusiveness.
- B
Fairness
Fairness, as a Microsoft responsible AI principle, requires that the AI system's decisions and predictions do not systematically disadvantage any group, including categories of vehicles such as cars, trucks, or motorcycles. The surveillance system may exhibit bias due to imbalanced training data or feature engineering, leading to different analysis outcomes for different vehicle types. This directly violates the core tenet of Fairness, making it the most relevant principle.
- C
Reliability and safety
Why wrong: Reliability and safety address whether the AI system functions consistently, is robust to errors, and avoids causing physical or operational harm in its given environment. The scenario does not describe system crashes, inaccurate detections, or unsafe actions; it describes a pattern of unequal treatment across vehicle classes. A system could be perfectly reliable and safe while still being unfair, so this principle does not address the core issue.
- D
Transparency
Why wrong: Transparency pertains to the visibility and interpretability of an AI system's workings, such as providing explanations for why a particular decision was made or making the model's logic open to review. The problem in the scenario is not that the system's logic is hidden, but that the consequences of its analysis are inequitable across vehicle types. Without a fairness evaluation, explaining the system's decisions would not remedy the underlying bias.