Fetching the paper…
Reading the bibliography…
In continual learning, the learner faces a stream of data whose distribution changes over time.
Functional Regularisation for Continual Learning using Gaussian Processes
Titsias, M. K.; Schwarz, J.; Matthews, A. G. d. G.; Pascanu, R.; and Teh, Y. W. 2019 · 1901
Earlier work this paper cites.
Continual Learning with Tiny Episodic Memories
Chaudhry, A.; Rohrbach, M.; Elhoseiny, M.; Ajanthan, T.; Dokania, P. K.; Torr, P. H.; and Ranzato, M. 2019b · 1902
Earlier work this paper cites.
Online continual learning with no task boundaries
Aljundi, R.; Lin, M.; Goujaud, B.; and Bengio, Y. 2019b · 1903
Earlier work this paper cites.
Catastrophic interference in connectionist networks: The sequential learning problem
McCloskey, M.; and Cohen, N. J. 1989 · 1989
Earlier work this paper cites.
Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory
McClelland, J. L.; McNaughton, B. L.; and O’Reilly, R. C. 1995 · 1995
Earlier work this paper cites.
Multitask learning
Caruana, R. 1997 · 1997
Earlier work this paper cites.
CHILD: A first step towards continual learning
Ring, M. B. 1997 · 1997
Earlier work this paper cites.
The MNIST database of handwritten digits
LeCun, Y. 1998 · 1998
Earlier work this paper cites.
Lifelong learning algorithms
Thrun, S. 1998 · 1998
Earlier work this paper cites.
A Hilbert space embedding for distributions
Smola, A.; Gretton, A.; Song, L.; and Schölkopf, B. 2007 · 2007
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Krizhevsky, A.; and Hinton, G. 2009 · 2009
Earlier work this paper cites.
An empirical investigation of catastrophic forgetting in gradient-based neural networks
Goodfellow, I. J.; Mirza, M.; Xiao, D.; Courville, A.; and Bengio, Y. 2013 · 2013
Earlier work this paper cites.
Distilling the knowledge in a neural network
Hinton, G.; Vinyals, O.; and Dean, J. 2014 · 2014
Earlier work this paper cites.
Deep inside convolutional networks: Visualising image classification models and saliency maps
Simonyan, K.; Vedaldi, A.; and Zisserman, A. 2014 · 2014
Earlier work this paper cites.
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O.; Deng, J.; Su, H.; Krause, J.; Satheesh, S.; Ma, S.; Huang, Z.; Karpathy, A.; Khosla, A.; Bernstein, M.; Berg, A. C.; and Fei-Fei, L. 2015 · 2015
Cited alongside, same era.
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J.; Pascanu, R.; Rabinowitz, N. C.; Veness, J.; Desjardins, G.; Rusu, A. A.; Milan, K.; Quan, J.; Ramalho, T.; Grabska-Barwinska, A.; Hassabis, D.; Clopath, C.; Kumaran, D.; and Hadsell, R. 2016 · 2016
Cited alongside, same era.
Learning without forgetting
Li, Z.; and Hoiem, D. 2016 · 2016
Cited alongside, same era.
Rusu, A. A.; Rabinowitz, N. C.; Desjardins, G.; Soyer, H.; Kirkpatrick, J.; Kavukcuoglu, K.; Pascanu, R.; and Hadsell, R. 2016 · 2016
Cited alongside, same era.
Matching networks for one shot learning
Vinyals, O.; Blundell, C.; Lillicrap, T.; Wierstra, D.; et al. 2016 · 2016
Cited alongside, same era.
Automatically Composing Representation Transformations as a Means for Generalization
Chang, M.; Gupta, A.; Levine, S.; and Griffiths, T. L. 2018 · 2018
Later among the works it cites.
Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence
Chaudhry, A.; Dokania, P. K.; Ajanthan, T.; and Torr, P. H. 2018 · 2018
Later among the works it cites.
Ferran Alet, Tomas Lozano-Perez, L. P. K. 2018 · 2018
Later among the works it cites.
Memory Efficient Experience Replay for Streaming Learning
Hayes, T. L.; Cahill, N. D.; and Kanan, C. 2018 · 2018
Later among the works it cites.
Selective Experience Replay for Lifelong Learning
Isele, D.; and Cosgun, A. 2018 · 2018
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Expert Gate: Lifelong Learning with a Network of Experts
Aljundi, R.; Chakravarty, P.; and Tuytelaars, T. 2017 · 2017
Cited alongside, same era.
Pathnet: Evolution channels gradient descent in super neural networks
Fernando, C.; Banarse, D.; Blundell, C.; Zwols, Y.; Ha, D.; Rusu, A. A.; Pritzel, A.; and Wierstra, D. 2017 · 2017
Cited alongside, same era.
Model-agnostic meta-learning for fast adaptation of deep networks
Finn, C.; Abbeel, P.; and Levine, S. 2017 · 2017
Cited alongside, same era.
Lifelong Learning with Dynamically Expandable Networks
Lee, J.; Yun, J.; Hwang, S.; and Yang, E. 2017 · 2017
Cited alongside, same era.
Gradient Episodic Memory for Continuum Learning
Lopez-Paz, D.; and Ranzato, M. 2017 · 2017
Cited alongside, same era.
iCaRL: Incremental Classifier and Representation Learning
Rebuffi, S.-V.; Kolesnikov, A.; and Lampert, C. H. 2017 · 2017
Cited alongside, same era.
Continual Learning Through Synaptic Intelligence
Zenke, F.; Poole, B.; and Ganguli, S. 2017 · 2017
Cited alongside, same era.
Variational continual learning
Nguyen, C. V.; Li, Y.; Bui, T. D.; and Turner, R. E. 2018 · 2018
Later among the works it cites.
Reptile: a scalable metalearning algorithm
Nichol, A.; and Schulman, J. 2018 · 2018
Later among the works it cites.
Experience Replay for Continual Learning
Rolnick, D.; Ahuja, A.; Schwarz, J.; Lillicrap, T. P.; and Wayne, G. 2018 · 2018
Later among the works it cites.
Routing Networks: Adaptive Selection of Non-Linear Functions for Multi-Task Learning
Rosenbaum, C.; Klinger, T.; and Riemer, M. 2018 · 2018
Later among the works it cites.
Wang, T.; Zhu, J.-Y.; Torralba, A.; and Efros, A. A. 2018 · 2018
Later among the works it cites.
Xu, J.; and Zhu, Z. 2018 · 2018
Later among the works it cites.
Task-free continual learning
Aljundi, R.; Kelchtermans, K.; and Tuytelaars, T. 2019 · 2019
Later among the works it cites.
Learning to Learn without Forgetting By Maximizing Transfer and Minimizing Interference
Riemer, M.; Cases, I.; Ajemian, R.; Liu, M.; Rish, I.; Tu, Y.; and Tesauro, G. 2019 · 2019
Later among the works it cites.