A startup develops an AI recruiting tool that screens resumes. After deployment, they receive a complaint from a candidate who claims the system rejected them due to age discrimination. The startup has no formal AI governance process. They want to quickly assess and remediate the issue. The dataset includes age as a feature. What should they do first?
Analysis identifies whether and where bias exists before taking action.
Why this answer
Option B is correct because the complaint suggests age bias; the first step is to analyze the model's predictions across age groups to verify if there is bias. Option A is wrong because removing age may not eliminate proxies. Option C is wrong because disregarding the complaint is unethical.
Option D is wrong without first understanding the bias source.