Fetching the paper…
Reading the bibliography…
It was recently shown that architectural, regularization and rehearsal strategies can be used to train deep models sequentially on a number of disjoint tasks without forgetting previously acquired knowledge.
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
Michael McCloskey and Neal J. Cohen · 1989
Earlier work this paper cites.
Connectionist models of recognition memory: constraints imposed by learning and forgetting functions
R Ratcliff · 1990
Earlier work this paper cites.
Catastrophic forgetting in connectionist networks
Robert M. French · 1999
Earlier work this paper cites.
Learning Multiple Layers of Features from Tiny Images
Alex Krizhevsky · 2009
Earlier work this paper cites.
Lecture 6d: a separate, adaptive learning rate for each connection. Slides of Lecture Neural Networks for Machine Learning
Geoffrey Hinton · 2012
Earlier work this paper cites.
An Empirical Investigation of Catastrophic Forgeting in Gradient-Based Neural Networks
Ian J Goodfellow, Mehdi Mirza, Da Xiao, Aaron Courville, and Yoshua Bengio · 2013
Earlier work this paper cites.
Adaptive Resonance Theory: How a brain learns to consciously attend, learn, and recognize a changing world
Stephen Grossberg · 2013
Earlier work this paper cites.
Caffe: Convolutional Architecture for Fast Feature Embedding
Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell · 2014
Earlier work this paper cites.
Adam: A Method for Stochastic Optimization
Diederik P. Kingma and Jimmy Ba · 2014
Earlier work this paper cites.
Network In Network
Min Lin, Qiang Chen, and Shuicheng Yan · 2014
Earlier work this paper cites.
Distilling the Knowledge in a Neural Network
Geoffrey Hinton, Oriol Vinyals, and Jeff Dean · 2015
Earlier work this paper cites.
Going deeper with convolutions
C Szegedy, W Liu, Y Jia, and P Sermanet · 2015
Cited alongside, same era.
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Cited alongside, same era.
Learning without forgetting
Zhizhong Li and Derek Hoiem · 2016
Cited alongside, same era.
Semi-supervised Tuning from Temporal Coherence
Davide Maltoni and Vincenzo Lomonaco · 2016
Cited alongside, same era.
Andrei A Rusu, Neil C Rabinowitz, Guillaume Desjardins, Hubert Soyer, James Kirkpatrick, Koray Kavukcuoglu, Razvan Pascanu, and Raia Hadsell · 2016
Cited alongside, same era.
Notes on Backpropagation, 2016
Peter Sadowski · 2016
Cited alongside, same era.
iCaRL: Incremental Classifier and Representation Learning
Sylvestre-alvise Rebuffi, Alexander Kolesnikov, Georg Sperl, and Christoph H Lampert · 2017
Later among the works it cites.
Growing a Brain : Fine-Tuning by Increasing Model Capacity
Yu-Xiong Wang, Deva Ramanan, and Martial Hebert · 2017
Later among the works it cites.
Continual Learning Through Synaptic Intelligence
Friedemann Zenke, Ben Poole, and Surya Ganguli · 2017
Later among the works it cites.
Memory Efficient Experience Replay for Streaming Learning
Tyler L. Hayes, Nathan D. Cahill, and Christopher Kanan · 2018
Closest in time.
Note on the quadratic penalties in elastic weight consolidation
Ferenc Huszár · 2018
Closest in time.
FearNet: Brain-Inspired Model For Incremental Learning
Ronald Kemker and Christopher Kanan · 2018
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Rahaf Aljundi, Francesca Babiloni, Mohamed Elhoseiny, Marcus Rohrbach, and Tinne Tuytelaars · 2017
Cited alongside, same era.
Overcoming catastrophic forgetting in neural networks
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-barwinska, Demis Hassabis, Claudia Clopath, Dharshan Kumaran, and Raia Hadsell · 2017
Cited alongside, same era.
CORe50: a New Dataset and Benchmark for Continuous Object Recognition
Vincenzo Lomonaco and Davide Maltoni · 2017
Cited alongside, same era.
CORe50: a New Dataset and Benchmark for Continuous Object Recognition
Vincenzo Lomonaco and Davide Maltoni · 2017
Cited alongside, same era.
Gradient Episodic Memory for Continuum Learning
David Lopez-paz and Marc’Aurelio Ranzato · 2017
Cited alongside, same era.
Closest in time.
Measuring Catastrophic Forgetting in Neural Networks
Ronald Kemker, Marc McClure, Angelina Abitino, Tyler Hayes, and Christopher Kanan · 2018
Closest in time.
Reply to Huszár: The elastic weight consolidation penalty is empirically valid
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A. Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, Demis Hassabis, Claudia Clopath, Dharshan Kumaran, and Raia Hadsell · 2018
Closest in time.
ResNet Tensoflow Reimplementation, 2018
Xin Pan · 2018
Closest in time.
Continual Lifelong Learning with Neural Networks: A Review
German I. Parisi, Ronald Kemker, Jose L. Part, Christopher Kanan, and Stefan Wermter · 2018
Closest in time.
Lifelong Learning of Spatiotemporal Representations with Dual-Memory Recurrent Self-Organization
German I. Parisi, Jun Tani, Cornelius Weber, and Stefan Wermter · 2018
Closest in time.