A bank uses a machine learning model to predict credit card fraud. The model's output is a probability score. The business wants to minimize the number of false positives (legitimate transactions incorrectly flagged as fraud) because these cause customer dissatisfaction. At the same time, they must also catch most fraudulent transactions. Which metric should the bank optimize to balance these two goals?
F1 score is the harmonic mean of precision and recall, so it provides a single balanced measure of both completeness and trustworthiness of fraud predictions. In credit card fraud modeling, both undetected fraud (false negatives) and blocked legitimate purchases (false positives) are costly, and F1 score specifically rewards models that achieve a strong trade-off between the two. It is the correct metric for this scenario because it avoids the misleading optimism of accuracy on imbalanced data.
Why this answer
The F1 score is the harmonic mean of precision and recall, making it the ideal metric when a balance between minimizing false positives (precision) and catching most fraudulent transactions (recall) is required. In this credit card fraud detection scenario, optimizing F1 ensures the model reduces customer dissatisfaction from false positives while still maintaining high detection of actual fraud.
Exam trap
The trap here is that candidates often choose precision or recall alone, not realizing that the F1 score is specifically designed to balance both metrics when the business requires minimizing false positives while still catching most true positives.
How to eliminate wrong answers
Option A is wrong because accuracy measures overall correct predictions (true positives + true negatives divided by total predictions) and can be misleading in imbalanced datasets like fraud detection, where legitimate transactions vastly outnumber fraudulent ones; a model that always predicts 'not fraud' could achieve high accuracy but fail to catch any fraud. Option B is wrong because precision focuses solely on the proportion of flagged transactions that are actually fraudulent (true positives / (true positives + false positives)), which minimizes false positives but does not account for missed fraudulent transactions (false negatives), potentially allowing many frauds to go undetected. Option C is wrong because recall (sensitivity) measures the proportion of actual fraudulent transactions correctly identified (true positives / (true positives + false negatives)), which prioritizes catching fraud but can lead to a high number of false positives, directly conflicting with the business goal of minimizing customer dissatisfaction.