MLS-C01 Exploratory Data Analysis Practice Question
A data scientist is working on a binary classification problem with a highly imbalanced dataset (1% positive class). They have applied oversampling using SMOTE and trained a logistic regression model. The model achieves 99% accuracy on the test set, but the recall for the positive class is only 5%. What is the most likely cause?
Answer choices
Why each option matters
Answer the question above first, then reveal the full breakdown to understand why each option is right or wrong.
Correct answer & explanation
✓
SMOTE was applied before splitting the data into training and test sets
Applying SMOTE before splitting the data causes data leakage. SMOTE generates synthetic samples based on the entire dataset, including the test set, so synthetic versions of test samples can appear in the training set. This inflates training accuracy artificially but does not improve the model's ability to generalize to unseen data, leading to poor recall on the true test set. Option B is incorrect because while overfitting due to lack of regularization can cause poor generalization, the specific pattern of high accuracy but very low recall is characteristic of data leakage from preprocessing before splitting. Option C is incorrect because accuracy is indeed a poor metric for imbalanced data, but the low recall (5%) indicates a fundamental issue with the model's ability to detect positives, which goes beyond metric choice. Option D is incorrect because logistic regression can be effective for imbalanced datasets when properly handled (e.g., with class weights or resampling); the problem here stems from the improper application of SMOTE, not the algorithm itself.
Answer analysis
Option-by-option breakdown
For each option: why learners choose it and why it is or isn't the right answer here.
- ✓
SMOTE was applied before splitting the data into training and test sets
Why this is correct
Applying SMOTE before splitting the data causes data leakage, artificially inflating training accuracy but not improving generalization, leading to poor recall.
- ✗
The model is overfitting due to lack of regularization
Why it's wrong here
While lack of regularization can cause overfitting, the specific pattern of high accuracy and low recall is characteristic of data leakage from improper preprocessing.
- ✗
Accuracy is not a suitable metric for imbalanced data
Why it's wrong here
Accuracy is indeed a poor metric for imbalanced data, but the low recall indicates a fundamental issue beyond metric choice.
- ✗
Logistic regression is inappropriate for imbalanced datasets
Why it's wrong here
Logistic regression can be effective for imbalanced datasets with proper handling; the problem stems from improper SMOTE application, not the algorithm.
Visual reference
Go deeper
Related to this question
About these practice questions
One of 1,672 original MLS-C01 practice questions on Courseiva, each with a full explanation and wrong-answer analysis — not exam dumps or protected exam content. Learn why practice questions differ from exam dumps →
JA
Written by Johnson Ajibi, MSc IT Security
Senior Network & Security Engineer · founder of Courseiva
This MLS-C01 practice question is part of Courseiva's free Amazon Web Services certification practice question bank. Courseiva provides original exam-style practice questions with explanations, topic-based practice, mock exams, readiness tracking, and study analytics to help learners prepare for the MLS-C01 exam.