A data scientist is performing EDA on a dataset that contains customer demographics and purchase history. The dataset has a column 'age' with some values that are negative or unreasonably high (e.g., 200). The scientist wants to identify and handle these outliers. The scientist is using a SageMaker notebook with pandas. Which approach should the scientist take to effectively handle these outliers?
Domain knowledge provides logical bounds to handle outliers appropriately.
Why this answer
The most appropriate approach is to define reasonable bounds based on domain knowledge (e.g., 0-120) and filter out or cap the outliers. Option A is incorrect because standard scaling does not handle outliers; it will still be influenced by extreme values. Option B is incorrect because imputing with the mean can distort the distribution when outliers are present.
Option D is incorrect because removing the entire column discards valuable information.