A machine learning engineer at a retail company is monitoring a production model that predicts inventory demand. The model's prediction accuracy has dropped significantly over the past week. The engineer checks the model's input data and notices a new product category was introduced with a different distribution. Which concept is most likely causing the performance degradation?
Trap 1: Concept drift
Concept drift refers to changes in the underlying relationship between features and target, not input distribution.
Trap 2: Data leakage
Data leakage involves the model seeing information it shouldn't, not input distribution change.
Trap 3: Model decay
Model decay is a general term for performance degradation, not the specific cause here.
- A
Concept drift
Why wrong: Concept drift refers to changes in the underlying relationship between features and target, not input distribution.
- B
Covariate shift
Covariate shift occurs when the distribution of input features changes over time.
- C
Data leakage
Why wrong: Data leakage involves the model seeing information it shouldn't, not input distribution change.
- D
Model decay
Why wrong: Model decay is a general term for performance degradation, not the specific cause here.