Fetching the paper…
Reading the bibliography…
Lack of performance when it comes to continual learning over non-stationary distributions of data remains a major challenge in scaling neural network learning to more human realistic settings.
Random sampling with a reservoir
Jeffrey S Vitter · 1985
Earlier work this paper cites.
A massively parallel architecture for a self-organizing neural pattern recognition machine
Gail A Carpenter and Stephen Grossberg · 1987
Earlier work this paper cites.
Using fast weights to deblur old memories
Geoffrey E Hinton and David C Plaut · 1987
Earlier work this paper cites.
Evolutionary principles in self-referential learning, or on learning how to learn: the meta-meta-… hook
Jürgen Schmidhuber · 1987
Earlier work this paper cites.
Catastrophic interference in connectionist networks: The sequential learning problem
Michael McCloskey and Neal J Cohen · 1989
Earlier work this paper cites.
Using semi-distributed representations to overcome catastrophic forgetting in connectionist networks
Robert M. French · 1991
Earlier work this paper cites.
Adaptive mixtures of local experts
Robert A Jacobs, Michael I Jordan, Steven J Nowlan, and Geoffrey E Hinton · 1991
Earlier work this paper cites.
Self-improving reactive agents based on reinforcement learning, planning and teaching
Long-Ji Lin · 1992
Earlier work this paper cites.
Learning and categorization in modular neural networks
Jacob MJ Murre · 1992
Earlier work this paper cites.
Continual learning in reinforcement environments
Mark Bishop Ring · 1994
Earlier work this paper cites.
Lifelong learning perspective for mobile robot control
Sebastian Thrun · 1994
Earlier work this paper cites.
Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory
James L McClelland, Bruce L McNaughton, and Randall C O’reilly · 1995
Earlier work this paper cites.
Catastrophic forgetting, rehearsal and pseudorehearsal
Anthony Robins · 1995
Earlier work this paper cites.
Is learning the n-th thing any easier than learning the first?
Sebastian Thrun · 1996
Earlier work this paper cites.
Avoiding catastrophic forgetting by coupling two reverberating neural networks
Bernard Ans and Stéphane Rousset · 1997
Earlier work this paper cites.
Multitask learning
Rich Caruana · 1997
Earlier work this paper cites.
Catastrophic forgetting in connectionist networks
Robert M French · 1999
Earlier work this paper cites.
Optimal ordered problem solver
Jürgen Schmidhuber · 2004
Earlier work this paper cites.
Cascade models of synaptically stored memories
Stefano Fusi, Patrick J Drew, and Larry F Abbott · 2005
Earlier work this paper cites.
One shot learning of simple visual concepts
Brenden Lake, Ruslan Salakhutdinov, Jason Gross, and Joshua Tenenbaum · 2011
Cited alongside, same era.
Neural networks for machine learning lecture 6a overview of mini-batch gradient descent
Geoffrey Hinton, Nitish Srivastava, and Kevin Swersky · 2012
Cited alongside, same era.
A theory for how sensorimotor skills are learned and retained in noisy and nonstationary neural circuits
Robert Ajemian, Alessandro D’Ausilio, Helene Moorman, and Emilio Bizzi · 2013
Cited alongside, same era.
A memory frontier for complex synapses
Subhaneil Lahiri and Surya Ganguli · 2013
Cited alongside, same era.
Powerplay: Training an increasingly general problem solver by continually searching for the simplest still unsolvable problem
Jürgen Schmidhuber · 2013
Cited alongside, same era.
Chelsea Finn and Sergey Levine · 2017
Later among the works it cites.
Model-agnostic meta-learning for fast adaptation of deep networks
Chelsea Finn, Pieter Abbeel, and Sergey Levine · 2017
Later among the works it cites.
Overcoming catastrophic forgetting in neural networks
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, et al · 2017
Later among the works it cites.
Overcoming catastrophic forgetting by incremental moment matching
Sang-Woo Lee, Jin-Hwa Kim, Jaehyun Jun, Jung-Woo Ha, and Byoung-Tak Zhang · 2017
Later among the works it cites.
Gradient episodic memory for continuum learning
David Lopez-Paz and Marc’Aurelio Ranzato · 2017
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Diederik P Kingma and Jimmy Ba · 2014
Cited alongside, same era.
Conditional computation in neural networks for faster models
Emmanuel Bengio, Pierre-Luc Bacon, Joelle Pineau, and Doina Precup · 2015
Cited alongside, same era.
Neuron clustering for mitigating catastrophic forgetting in supervised and reinforcement learning
Benjamin Frederick Goodrich · 2015
Cited alongside, same era.
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski, et al · 2015
Cited alongside, same era.
A deep learning and knowledge transfer based architecture for social media user characteristic determination
Matthew Riemer, Sophia Krasikov, and Harini Srinivasan · 2015
Cited alongside, same era.
Learning without forgetting
Zhizhong Li and Derek Hoiem · 2016
Cited alongside, same era.
Cross-stitch networks for multi-task learning
Ishan Misra, Abhinav Shrivastava, Abhinav Gupta, and Martial Hebert · 2016
Cited alongside, same era.
icarl: Incremental classifier and representation learning
Sylvestre-Alvise Rebuffi, Alexander Kolesnikov, and Christoph H Lampert · 2017
Later among the works it cites.
Generative knowledge distillation for general purpose function compression
Matthew Riemer, Michele Franceschini, Djallel Bouneffouf, and Tim Klinger · 2017
Later among the works it cites.
Outrageously large neural networks: The sparsely-gated mixture-of-experts layer
Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc Le, Geoffrey Hinton, and Jeff Dean · 2017
Later among the works it cites.
Deep multi-task representation learning: A tensor factorisation approach
Yongxin Yang and Timothy Hospedales · 2017
Later among the works it cites.
Continual learning through synaptic intelligence
Friedemann Zenke, Ben Poole, and Surya Ganguli · 2017
Later among the works it cites.
A deeper look at experience replay
Shangtong Zhang and Richard S Sutton · 2017
Later among the works it cites.
Continuous adaptation via meta-learning in nonstationary and competitive environments
Maruan Al-Shedivat, Trapit Bansal, Yuri Burda, Ilya Sutskever, Igor Mordatch, and Pieter Abbeel · 2018
Closest in time.
Riemannian walk for incremental learning: Understanding forgetting and intransigence
Arslan Chaudhry, Puneet K Dokania, Thalaiyasingam Ajanthan, and Philip HS Torr · 2018
Closest in time.
Lifelong learning with dynamically expandable networks
Jeongtae Lee, Jaehong Yun, Sungju Hwang, and Eunho Yang · 2018
Closest in time.
Daniel J Mankowitz, Timothy A Mann, Pierre-Luc Bacon, Doina Precup, and Shie Mannor · 2018
Closest in time.
Reptile: a scalable metalearning algorithm
Alex Nichol and John Schulman · 2018
Closest in time.
Learning abstract options
Matthew Riemer, Miao Liu, and Gerald Tesauro · 2018
Closest in time.
Routing networks: Adaptive selection of non-linear functions for multi-task learning
Clemens Rosenbaum, Tim Klinger, and Matthew Riemer · 2018
Closest in time.
Overcoming catastrophic forgetting with hard attention to the task
Joan Serrà, Dídac Surís, Marius Miron, and Alexandros Karatzoglou · 2018
Closest in time.