Detection of data drift and outliers affecting machine learning model performance over time

“The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information”

George. Miller · 1956

Earlier work this paper cites.

“Adaptive Information Filtering: Learning in the Presence of Concept Drifts”

Ralf Klinkenberg and Ingrid Renz · 1998

Earlier work this paper cites.

“Information Filtering in Changing Domains”

Carsten Lanquillon · 1999

Earlier work this paper cites.

“The MNIST Handwritten Digit Database”, 1999

Yann LeCun, Corinna Cortez and Christopher.J. Burges · 1999

Earlier work this paper cites.

“Sequential Drift Detection in Deep Learning Classifiers”

Original

Samuel Ackerman, Eitan Farchi and Parijat Dube · 2007

Earlier work this paper cites.

“Drift Detection Using Uncertainty Distribution Divergence”

Patrick Lindstrom, Brian Namee and Sara Delaney · 2011

Cited alongside, same era.

“Exponentially Weighted Moving Average Charts for Detecting Concept Drift”

Gordon J.Ross, Niall. Adams, Dimitris. Tasoulis and David. Hand · 2012

Cited alongside, same era.

“A Unifying View on Dataset Shift in Classification”

Jose. Moreno-Torres et al · 2012

Cited alongside, same era.

“Nonparametric Control Charts for Detecting Arbitrary Distribution Changes”

Gordon. Ross and Niall. Adams · 2012

Cited alongside, same era.

“Local Significant Differences from Non-Parametric Two-Sample Tests”

Tarn Duong · 2013

Cited alongside, same era.

“cpm: Sequential and Batch Change Detection Using Parametric and Nonparametric Methods”

Gordon. Ross · 2015

Later among the works it cites.

“On the Reliable Detection of Concept Drift from Streaming Unlabeled Data”

Tegjyot Sethi and Mehmed Kantardzic · 2017

Later among the works it cites.

“ks: Kernel Smoothing”

Tarn Duong, Matt Wand, Jose Chacon and Artur Gramacki · 2018

Later among the works it cites.

“Automatically detecting data drift in machine learning classifiers”

Samuel Ackerman et al · 2019

Later among the works it cites.