Fetching the paper…
Reading the bibliography…
Some machine learning applications require continual learning - where data comes in a sequence of datasets, each is used for training and then permanently discarded.
Connectionist models of recognition memory: Constraints imposed by learning and forgetting functions
Roger Ratcliff · 1990
Earlier work this paper cites.
A Practical Bayesian Framework for Backpropagation Networks
David J. C. MacKay · 1992
Earlier work this paper cites.
Keeping the neural networks simple by minimizing the description length of the weights
Geoffrey E. Hinton and Drew van Camp · 1993
Earlier work this paper cites.
Bayesian learning for neural networks
Radford M. Neal · 1995
Earlier work this paper cites.
Catastrophic Forgetting, Rehearsal and Pseudorehearsal
Anthony Robins · 1995
Earlier work this paper cites.
Introduction to variational methods for graphical models
Michael I. Jordan, Zoubin Ghahramani, Tommi S. Jaakkola, and Lawrence K. Saul · 1999
Earlier work this paper cites.
Practical Variational Inference for Neural Networks
Alex Graves · 2011
Cited alongside, same era.
Continual Learning Through Synaptic Intelligence
Friedemann Zenke, Ben Poole, and Surya Ganguli · 2011
Cited alongside, same era.
An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks
Ian J. Goodfellow, Mehdi Mirza, Da Xiao, Aaron Courville, and Yoshua Bengio · 2013
Cited alongside, same era.
Variational Dropout and the Local Reparameterization Trick
Diederik P. Kingma, Tim Salimans, and Max Welling · 2015
Cited alongside, same era.
Overcoming catastrophic forgetting in neural networks
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A. Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, Demis Hassabis, Claudia Clopath, Dharshan Kumaran, and Raia Hadsell · 2017
Cited alongside, same era.
Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence
Arslan Chaudhry, Puneet K. Dokania, Thalaiyasingam Ajanthan, and Philip H. S. Torr · 2018
Later among the works it cites.
Towards Robust Evaluations of Continual Learning
Sebastian Farquhar and Yarin Gal · 2018
Later among the works it cites.
Variational Continual Learning
Cuong V. Nguyen, Yingzhen Li, Thang D. Bui, and Richard E. Turner · 2018
Later among the works it cites.
Continual Lifelong Learning with Neural Networks: A Review
German I. Parisi, Ronald Kemker, Jose L. Part, Christopher Kanan, and Stefan Wermter · 2018
Later among the works it cites.
Online Structured Laplace Approximations For Overcoming Catastrophic Forgetting
Hippolyt Ritter, Aleksandar Botev, and David Barber · 2018
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Continual Learning with Deep Generative Replay
Hanul Shin, Jung Kwon Lee, Jaehong Kim, and Jiwon Kim · 2017
Cited alongside, same era.