AI0-001 Machine Learning and Deep Learning Practice Question
A company is deploying a machine learning model to predict customer churn. The dataset is highly imbalanced (95% non-churn, 5% churn). The model achieves 96% accuracy, but the F1-score for the churn class is only 0.2. Which metric should the team prioritize to evaluate model performance for this business problem?
⚠ Common exam trap
CompTIA often tests the misconception that high accuracy is always good, especially in imbalanced datasets, leading candidates to overlook the F1-score as the appropriate metric for minority class performance.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
F1-score
In a highly imbalanced dataset (95% non-churn, 5% churn), accuracy is misleading because a model can achieve 96% accuracy by simply predicting the majority class for all instances. The F1-score, which is the harmonic mean of precision and recall, specifically measures the model's performance on the minority (churn) class. A low F1-score of 0.2 indicates the model fails to correctly identify churners, which is the critical business outcome, making F1-score the correct metric to prioritize.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✓
F1-score
Why this is correct
F1-score balances precision and recall, suitable for imbalanced data.
- ✗
Accuracy
Why it's wrong here
Accuracy is misleading when classes are imbalanced.
- ✗
Log loss
Why it's wrong here
Log loss does not directly reflect performance on the minority class.
- ✗
AUC-ROC
Why it's wrong here
AUC-ROC is useful but less direct for the minority class.
About these practice questions
Courseiva writes every AI0-001 question from scratch — 754 in total, each with an explanation and a wrong-answer breakdown. None are copied from real exams or dumps. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.