A healthcare organization uses an AI model to recommend treatment plans. The model was trained on data from a single hospital, and now treats patients from multiple demographics. Which ethical concern is most critical?
The model trained on a single hospital's data may not generalize, leading to unfair treatment recommendations for other demographics.
Why this answer
Training on homogeneous data leads to biased predictions for underrepresented groups, raising fairness concerns. While transparency and explainability are important, fairness is the primary issue due to demographic shift. Privacy and accountability are secondary in this context.