Fetching the paper…
Reading the bibliography…
Experiments used in current continual learning research do not faithfully assess fundamental challenges of learning continually.
A Practical Bayesian Framework for Backpropagation Networks
David J. C. MacKay · 1992
Earlier work this paper cites.
Bayesian learning for neural networks
Radford M. Neal · 1995
Earlier work this paper cites.
Catastrophic Forgetting, Rehearsal and Pseudorehearsal
Anthony Robins · 1995
Earlier work this paper cites.
Gradient-based learning applied to document recognition
Yann LeCun, Leon Bottou, Yoshua Bengio, and Patrick Haffner · 1998
Earlier work this paper cites.
Learning Multiple Layers of Features from Tiny Images
Alex Krizhevsky · 2009
Earlier work this paper cites.
notMNIST dataset, 2011
Yaroslav Bulatov · 2011
Earlier work this paper cites.
Practical Variational Inference for Neural Networks
Alex Graves · 2011
Earlier work this paper cites.
Reading Digits in Natural Images with Unsupervised Feature Learning
Yuval Netzer, Tao Wang, Adam Coates, Alessandro Bissacco, Bo Wu, and Andrew Y. Ng · 2011
Earlier work this paper cites.
Compete to Compute
Rupesh Kumar Srivastava, Jonathan Masci, Sohrob Kazerounian, Faustino Gomez, and Jürgen Schmidhuber · 2013
Earlier work this paper cites.
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Jeff Donahue, Yangqing Jia, Oriol Vinyals, Judy Hoffman, Ning Zhang, Eric Tzeng, and Trevor Darrell · 2014
Earlier work this paper cites.
CNN features off-the-shelf: An astounding baseline for recognition
Ali Sharif Razavian, Hossein Azizpour, Josephine Sullivan, and Stefan Carlsson · 2014
Earlier work this paper cites.
How transferable are features in deep neural networks?
Jason Yosinski, Jeff Clune, Yoshua Bengio, and Hod Lipson · 2014
Earlier work this paper cites.
Weight Uncertainty in Neural Networks
Charles Blundell, Julien Cornebise, Koray Kavukcuoglu, and Daan Wierstra · 2015
Cited alongside, same era.
Variational Dropout and the Local Reparameterization Trick
Diederik P. Kingma, Tim Salimans, and Max Welling · 2015
Cited alongside, same era.
Uncertainty in Deep Learning
Yarin Gal · 2016
Cited alongside, same era.
Less-forgetting Learning in Deep Neural Networks
Heechul Jung, Jeongwoo Ju, Minju Jung, and Junmo Kim · 2016
Cited alongside, same era.
Progressive Neural Networks
Andrei A. Rusu, Neil C. Rabinowitz, Guillaume Desjardins, Hubert Soyer, James Kirkpatrick, Koray Kavukcuoglu, Razvan Pascanu, and Raia Hadsell · 2016
Cited alongside, same era.
PathNet: Evolution Channels Gradient Descent in Super Neural Networks
Chrisantha Fernando, Dylan Banarse, Charles Blundell, Yori Zwols, David Ha, Andrei A. Rusu, Alexander Pritzel, and Daan Wierstra · 2017
Cited alongside, same era.
Continual Learning with Deep Generative Replay
Hanul Shin, Jung Kwon Lee, Jaehong Kim, and Jiwon Kim · 2017
Later among the works it cites.
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
Han Xiao, Kashif Rasul, and Roland Vollgraf · 2017
Later among the works it cites.
Continual Learning Through Synaptic Intelligence
Friedemann Zenke, Ben Poole, and Surya Ganguli · 2017
Later among the works it cites.
Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence
Arslan Chaudhry, Puneet K. Dokania, Thalaiyasingam Ajanthan, and Philip H. S. Torr · 2018
Closest in time.
Don’t forget, there is more than forgetting: new metrics for Continual Learning
Natalia Diaz-Rodriguez, Vincenzo Lomonaco, David Filliat, and Davide Maltoni · 2018
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Overcoming catastrophic forgetting in neural networks
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A. Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, Demis Hassabis, Claudia Clopath, Dharshan Kumaran, and Raia Hadsell · 2017
Cited alongside, same era.
Overcoming Catastrophic Forgetting by Incremental Moment Matching
Sang-woo Lee, Jin-hwa Kim, Jaehyun Jun, Jung-woo Ha, and Byoung-tak Zhang · 2017
Cited alongside, same era.
Learning without Forgetting
Zhizhong Li and Derek Hoiem · 2017
Cited alongside, same era.
Core50: a new dataset and benchmark for continuous object recognition
Vincenzo Lomonaco and Davide Maltoni · 2017
Cited alongside, same era.
Gradient Episodic Memory for Continual Learning
David Lopez-paz and Marc’Aurelio Aurelio Ranzato · 2017
Cited alongside, same era.
Differentially Private Continual Learning
Sebastian Farquhar and Yarin Gal
Cited in the paper.
Note on the quadratic penalties in elastic weight consolidation
Ferenc Huszar · 2018
Closest in time.
Variational Continual Learning
Cuong V. Nguyen, Yingzhen Li, Thang D. Bui, and Richard E. Turner · 2018
Closest in time.
A comprehensive, application-oriented study of catastrophic forgetting in DNNs
B. Pfulb and A. Gepperth · 2018
Closest in time.
Online Structured Laplace Approximations For Overcoming Catastrophic Forgetting
Hippolyt Ritter, Aleksandar Botev, and David Barber · 2018
Closest in time.
Efficient Lifelong Learning with A-GEM
Arslan Chaudhry, Marc’Aurelio Ranzato, Marcus Rohrbach, and Mohamed Elhoseiny · 2019
Closest in time.
Overcoming Catastrophic Forgetting via Model Adaptation
Wenpeng Hu, Zhou Lin, Bing Liu, Chongyang Tao, Zhengwei Tao, Jinwen Ma, Dongyan Zhao, and Rui Yan · 2019
Closest in time.