The correct first step is to compute and compare performance metrics for different age subgroups in the test set. This is because investigating bias in AI models requires a disaggregated analysis—breaking down overall accuracy into subgroup-specific metrics like precision and recall—to reveal hidden disparities that aggregate scores can mask. On the CompTIA AI+ AI0-001 exam, this concept tests your understanding of bias detection methodology, often appearing in scenario-based questions where a model performs well overall but fails for a specific demographic. A common trap is jumping to retraining or data collection before confirming where the bias actually lies; the exam emphasizes that diagnosis must precede treatment. Remember the mnemonic "D.A.T.A.": Disaggregate, Analyze metrics, Target the subgroup, then Act. This structured approach ensures you identify the root cause of performance drift before attempting any fix.
AI0-001 AI Concepts and Foundations Practice Question
This AI0-001 practice question tests your understanding of ai concepts and foundations. Read the scenario carefully and evaluate each option against the stated constraints before committing to an answer. After answering, compare your reasoning against the explanation and wrong-answer breakdown below. Once you have made your selection, read the full explanation to reinforce the concept and understand why each distractor is designed to mislead on exam day.
A hospital deploys an AI system to detect pneumonia from chest X-rays. The model achieves 95% accuracy on the test set but later is found to be less accurate for patients under 18. The development team suspects bias. Which step should be taken first to investigate?
Clue words in this question
Noticing these words before you look at the options changes how you read each choice.
Clue: "first"
Why it matters: Order matters here. You are being tested on which action comes before the others — not which action is generally useful.
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Compute and compare performance metrics for different age subgroups in the test set.
Option C is correct because the first step in investigating suspected model bias is to perform a disaggregated analysis of performance metrics across relevant subgroups, such as age brackets. This directly identifies whether the model's accuracy, precision, recall, or other metrics differ significantly for pediatric patients versus adults, confirming the presence and nature of the bias before any remediation is attempted.
Key principle: Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
✗
Automatically retrain the model with a balanced dataset including more pediatric cases.
Why it's wrong here
Retraining without confirming the cause may not solve the problem and could introduce other issues.
✗
Expand the test set with more pediatric X-rays and re-evaluate overall accuracy.
Why it's wrong here
Overall accuracy may still hide subgroup disparities; need stratified analysis.
✓
Compute and compare performance metrics for different age subgroups in the test set.
Why this is correct
Subgroup analysis is the standard first step in fairness auditing.
Clue confirmation
The clue word "first" in the question point toward this answer.
Related concept
Read the scenario before looking for a memorised answer.
✗
Add more features to the model to capture age-related anatomical differences.
Why it's wrong here
Feature engineering might help but is not the first diagnostic step.
Common exam traps
Common exam trap: answer the scenario, not the keyword
CompTIA often tests the principle that aggregate metrics like overall accuracy can be misleading, and the trap here is that candidates jump to a solution (retraining or adding features) before performing the necessary diagnostic step of subgroup performance analysis.
Detailed technical explanation
How to think about this question
In machine learning fairness, disaggregated evaluation involves computing confusion-matrix-based metrics (e.g., sensitivity, specificity, positive predictive value) for each predefined subgroup. For a binary classifier like pneumonia detection, a significant drop in recall for pediatric cases might indicate that the model underdiagnoses children, a pattern that overall accuracy (which can be high due to class imbalance) would hide. Real-world examples include models for diabetic retinopathy that performed poorly on darker-skinned patients because training data lacked diversity, a bias only uncovered through subgroup analysis.
KKey Concepts to Remember
Read the scenario before looking for a memorised answer.
Find the constraint that changes the correct option.
Eliminate answers that are true in general but not in this case.
TExam Day Tips
→Watch for words such as best, first, most likely and least administrative effort.
→Review why wrong options are wrong, not only why the correct option is correct.
Key takeaway
Answer the scenario, not the keyword: identify the specific constraint before choosing the most familiar-sounding option.
Real-world example
How this comes up in practice
A small business has 20 workstations on the 192.168.1.0/24 network and one public IP from its ISP. The router uses PAT (NAT overload) so all 20 devices share one public address using different source ports. NAT questions test whether you understand the four address terms and which direction each translation applies.
What to study next
Got this wrong? Here's your next step.
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
AI Concepts and Foundations — This question tests AI Concepts and Foundations — Read the scenario before looking for a memorised answer..
What is the correct answer to this question?
The correct answer is: Compute and compare performance metrics for different age subgroups in the test set. — Option C is correct because the first step in investigating suspected model bias is to perform a disaggregated analysis of performance metrics across relevant subgroups, such as age brackets. This directly identifies whether the model's accuracy, precision, recall, or other metrics differ significantly for pediatric patients versus adults, confirming the presence and nature of the bias before any remediation is attempted.
What should I do if I get this AI0-001 question wrong?
Identify which exam domain this question belongs to, review the core concept, then practise similar questions from the same domain.
Are there clue words in this question I should notice?
Yes — watch for: "first". Order matters here. You are being tested on which action comes before the others — not which action is generally useful.
What is the key concept behind this question?
Read the scenario before looking for a memorised answer.
About these practice questions
Courseiva creates original exam-style practice questions with explanations and wrong-answer analysis. It does not publish real exam questions, exam dumps, or protected exam content. Learn why practice questions differ from exam dumps →
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.
Question Discussion
Share a tip, memory trick, or ask about the reasoning behind this question. Do not post real exam questions, leaked content, braindumps, or copyrighted exam material. Comments are moderated and may be removed without notice.
Sign in to join the discussion.