Fetching the paper…
Reading the bibliography…
Despite huge success, deep networks are unable to learn effectively in sequential multitask learning settings as they forget the past learned tasks after learning new tasks.
Handwritten digit recognition with a back-propagation network
Yann LeCun, Bernhard E Boser, John S Denker, Donnie Henderson, Richard E Howard, Wayne E Hubbard, and Lawrence D Jackel · 1990
Earlier work this paper cites.
Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory
James L McClelland, Bruce L McNaughton, and Randall C O’reilly · 1995
Earlier work this paper cites.
Catastrophic forgetting, rehearsal and pseudorehearsal
Anthony Robins · 1995
Earlier work this paper cites.
Catastrophic forgetting in connectionist networks
Robert M French · 1999
Earlier work this paper cites.
Structural plasticity and memory
Raphael Lamprecht and Joseph LeDoux · 2004
Earlier work this paper cites.
The memory function of sleep
S. Diekelmann and J. Born · 2010
Earlier work this paper cites.
Wasserstein regularization of imaging problem
Julien Rabin and Gabriel Peyré · 2011
Earlier work this paper cites.
Using a gaussian mixture neural network for incremental learning and robotics
Milton Roberto Heinen, Paulo Martins Engel, and Rafael C Pinto · 2012
Earlier work this paper cites.
Imagenet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton · 2012
Earlier work this paper cites.
Unidimensional and evolution methods for optimal transportation
Nicolas Bonnotte · 2013
Cited alongside, same era.
About sleep’s role in memory
B. Rasch and J. Born · 2013
Cited alongside, same era.
Generative adversarial nets
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio · 2014
Cited alongside, same era.
Properties of artificial networks evolved to contend with natural spectra
Yaniv Morgenstern, Mohammad Rostami, and Dale Purves · 2014
Cited alongside, same era.
Understanding machine learning: From theory to algorithms
Shai Shalev-Shwartz and Shai Ben-David · 2014
Cited alongside, same era.
Lifelong machine learning
Zhiyuan Chen and Bing Liu · 2016
Cited alongside, same era.
Stabilizing training of generative adversarial networks through regularization
Kevin Roth, Aurelien Lucchi, Sebastian Nowozin, and Thomas Hofmann · 2017
Later among the works it cites.
Continual learning with deep generative replay
Hanul Shin, Jung Kwon Lee, Jaehong Kim, and Jiwon Kim · 2017
Later among the works it cites.
Veegan: Reducing mode collapse in gans using implicit variational learning
Akash Srivastava, Lazar Valkov, Chris Russell, Michael U Gutmann, and Charles Sutton · 2017
Later among the works it cites.
Continual learning through synaptic intelligence
Friedemann Zenke, Ben Poole, and Surya Ganguli · 2017
Later among the works it cites.
Memory aware synapses: Learning what (not) to forget
Rahaf Aljundi, Francesca Babiloni, Mohamed Elhoseiny, Marcus Rohrbach, and Tinne Tuytelaars · 2018
Later among the works it cites.
Ewc pytorch, 2018
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Tom Schaul, John Quan, Ioannis Antonoglou, and David Silver · 2016
Cited alongside, same era.
Overcoming catastrophic forgetting in neural networks
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, et al · 2017
Cited alongside, same era.
Theoretical analysis of domain adaptation with optimal transport
Ievgen Redko, Amaury Habrard, and Marc Sebban · 2017
Cited alongside, same era.
Ryuichiro Hataya · 2018
Later among the works it cites.
Selective experience replay for lifelong learning
David Isele and Akansel Cosgun · 2018
Later among the works it cites.
Sliced wasserstein distance for learning gaussian mixture models
Soheil Kolouri, Gustavo K Rohde, and Heiko Hoffmann · 2018
Later among the works it cites.
Umap: Uniform manifold approximation and projection for dimension reduction
Leland McInnes, John Healy, and James Melville · 2018
Later among the works it cites.