Classification Threshold Tuning for Recall and Precision
A manufacturing company is using a convolutional neural network (CNN) to detect defects on an assembly line. The model was trained on a balanced dataset of defective and non-defective parts. In production, the model shows high precision (95%) but very low recall (50%). The production line manager wants to minimize missed defects (false negatives). The data scientist has access to the original training data and can retrain the model. Which strategy is most effective for increasing recall while maintaining acceptable precision?
Quick Answer
The answer is to lower the classification threshold for the defective class. This works because a high threshold makes the model overly cautious, only flagging defects when it is very certain, which drives up precision but misses many true defects (false negatives). By lowering the threshold, you classify more samples as defective, directly increasing recall by catching those missed defects, and you can fine-tune this balance without retraining the model. On the CompTIA AI+ AI0-001 exam, this tests your understanding of the precision-recall trade-off and the practical application of threshold tuning as a post-training adjustment. A common trap is assuming retraining or data augmentation is always needed, but threshold tuning is the fastest lever for recall. Memory tip: “Lower the bar to catch more cars”—dropping the threshold lets more positives through, boosting recall at the cost of some precision.
⚠ Common exam trap
CompTIA often tests the misconception that retraining with data augmentation or oversampling is the only way to fix recall issues, when in fact threshold tuning is a simpler and more direct post-training adjustment that does not require model retraining.
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
Lower the classification threshold for the defective class
Lowering the classification threshold for the defective class directly addresses the recall issue by allowing more samples to be classified as defective, which reduces false negatives. This is the most immediate and effective method because it does not require retraining and can be tuned to balance precision and recall based on the manager's priority of minimizing missed defects.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✗
Apply data augmentation to defective images
Why it's wrong here
Augmentation can improve robustness but may not specifically increase recall; it could even reduce precision if not careful.
- ✓
Lower the classification threshold for the defective class
Why this is correct
Lowering the threshold increases sensitivity (recall) as more instances are classified as defective, directly reducing false negatives.
- ✗
Use a bagging ensemble of CNNs
Why it's wrong here
Ensembles can improve overall performance, but the most direct way to increase recall is to adjust the threshold; ensemble might not specifically target recall.
- ✗
Oversample the defective class in training
Why it's wrong here
Oversampling can help, but it may not directly address the low recall if the model is already biased towards non-defective; threshold adjustment is quicker.
About these practice questions
This AI0-001 question is part of Courseiva's 754-question bank — original exam-style content with full explanations and wrong-answer analysis, never real exam questions or exam dumps. Learn why practice questions differ from exam dumps →
Same concept, more angles
1 more way this is tested on AI0-001
These questions test the same concept from different angles. Work through them to make sure you can recognise it however the exam phrases it.
Variation 1. A retail company deploys a machine learning model to predict customer churn. The model outputs a probability between 0 and 1, and churn is predicted if probability > 0.5. After deployment, the model has a high false positive rate (many non-churning customers labeled as churn), which leads to unnecessary retention offers and increased costs. The data science team confirms the model was trained on historical data with a balanced class distribution. The business team wants to reduce false positives while maintaining a reasonable true positive rate. However, they cannot retrain the model because the original training data is no longer available. What is the best course of action to reduce false positives?
hard- A.Retrain the model using only the most recent three months of data.
- ✓ B.Increase the decision threshold to a higher value, such as 0.7.
- C.Collect new labeled data and perform transfer learning from the original model.
- D.Decrease the decision threshold to a lower value, such as 0.3.
Why B: Increasing the decision threshold to a higher value, such as 0.7, reduces false positives because the model will only predict churn when it is more confident. Since the model cannot be retrained, adjusting the threshold is the only way to trade off between precision and recall without modifying the model itself.
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This AI0-001 practice question is part of Courseiva's free CompTIA certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the AI0-001 exam.