Fetching the paper…
Reading the bibliography…
We study continual learning in the large scale setting where tasks in the input sequence are not limited to classification, and the outputs can be of high dimension.
Catastrophic forgetting, rehearsal and pseudorehearsal
Anthony Robins · 1995
Earlier work this paper cites.
A kernel method for the two-sample-problem
Arthur Gretton, Karsten Borgwardt, Malte Rasch, Bernhard Schölkopf, and Alex J Smola · 2007
Earlier work this paper cites.
Visualizing data using t-SNE
Laurens van der Maaten and Geoffrey Hinton · 2008
Earlier work this paper cites.
The stability-plasticity dilemma: Investigating the continuum from catastrophic forgetting to age-limited learning effects
Martial Mermillod, Aurélia Bugaiska, and Patrick Bonin · 2013
Earlier work this paper cites.
Playing atari with deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin Riedmiller · 2013
Earlier work this paper cites.
Tom Schaul, John Quan, Ioannis Antonoglou, and David Silver · 2015
Earlier work this paper cites.
Andrei A Rusu, Neil C Rabinowitz, Guillaume Desjardins, Hubert Soyer, James Kirkpatrick, Koray Kavukcuoglu, Razvan Pascanu, and Raia Hadsell · 2016
Earlier work this paper cites.
Overcoming catastrophic forgetting in neural networks
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A. Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, and et al · 2017
Earlier work this paper cites.
Learning without forgetting
Zhizhong Li and Derek Hoiem · 2017
Earlier work this paper cites.
CORe50: a new dataset and benchmark for continuous object recognition
Vincenzo Lomonaco and Davide Maltoni · 2017
Earlier work this paper cites.
Gradient episodic memory for continual learning
David Lopez-Paz and Marc’Aurelio Ranzato · 2017
Earlier work this paper cites.
Variational continual learning
Cuong V Nguyen, Yingzhen Li, Thang D Bui, and Richard E Turner · 2017
Earlier work this paper cites.
iCaRL: Incremental classifier and representation learning
Sylvestre-Alvise Rebuffi, Alexander Kolesnikov, Georg Sperl, and Christoph H. Lampert · 2017
Earlier work this paper cites.
Continual learning with deep generative replay
Hanul Shin, Jung Kwon Lee, Jaehong Kim, and Jiwon Kim · 2017
Cited alongside, same era.
Continual learning through synaptic intelligence
Friedemann Zenke, Ben Poole, and Surya Ganguli · 2017
Cited alongside, same era.
Efficient lifelong learning with A-GEM
Arslan Chaudhry, Marc’Aurelio Ranzato, Marcus Rohrbach, and Mohamed Elhoseiny · 2018
Cited alongside, same era.
Selective experience replay for lifelong learning
David Isele and Akansel Cosgun · 2018
Cited alongside, same era.
Learning to learn without forgetting by maximizing transfer and minimizing interference
Matthew Riemer, Ignacio Cases, Robert Ajemian, Miao Liu, Irina Rish, Yuhai Tu, and Gerald Tesauro · 2018
Cited alongside, same era.
Three scenarios for continual learning
Gido M van de Ven and Andreas S Tolias · 2019
Later among the works it cites.
Continual learning with adaptive weights (claw)
Tameem Adel, Han Zhao, and R. Turner · 2020
Closest in time.
Coresets via bilevel optimization for continual learning and streaming
Zalán Borsos, Mojmír Mutnỳ, and Andreas Krause · 2020
Closest in time.
Using hindsight to anchor past knowledge in continual learning
Arslan Chaudhry, Albert Gordo, Puneet K Dokania, Philip Torr, and David Lopez-Paz · 2020
Closest in time.
Online continual learning from imbalanced data
Aristotelis Chrysakis and Marie-Francine Moens · 2020
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Online structured Laplace approximations for overcoming catastrophic forgetting
Hippolyt Ritter, Aleksandar Botev, and David Barber · 2018
Cited alongside, same era.
Lifelong learning with dynamically expandable networks
Jaehong Yoon, Eunho Yang, Jungtae Lee, and Sung Ju Hwang · 2018
Cited alongside, same era.
Taskonomy: Disentangling task transfer learning
Amir R Zamir, Alexander Sax, William Shen, Leonidas J Guibas, Jitendra Malik, and Silvio Savarese · 2018
Cited alongside, same era.
Gradient based sample selection for online continual learning
Rahaf Aljundi, Min Lin, Baptiste Goujaud, and Yoshua Bengio · 2019
Cited alongside, same era.
On tiny episodic memories in continual learning
Arslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny, Thalaiyasingam Ajanthan, Puneet K Dokania, Philip HS Torr, and Marc’Aurelio Ranzato · 2019
Cited alongside, same era.
Memory efficient experience replay for streaming learning
Tyler L. Hayes, Nathan D. Cahill, and Christopher Kanan · 2019
Cited alongside, same era.
Learn to grow: A continual structure learning framework for overcoming catastrophic forgetting
Xilai Li, Yingbo Zhou, Tianfu Wu, Richard Socher, and Caiming Xiong · 2019
Cited alongside, same era.
Closest in time.
Orthogonal gradient descent for continual learning
Mehrdad Farajtabar, Navid Azizan, Alex Mott, and Ang Li · 2020
Closest in time.
Optimal continual learning has perfect memory and is NP-hard
Jeremias Knoblauch, Hisham Husain, and Tom Diethe · 2020
Closest in time.
Dropout as an implicit gating mechanism for continual learning
Seyed-Iman Mirzadeh, Mehrdad Farajtabar, and Hassan Ghasemzadeh · 2020
Closest in time.
Understanding the role of training regimes in continual learning
Seyed Iman Mirzadeh, Mehrdad Farajtabar, Razvan Pascanu, and Hassan Ghasemzadeh · 2020
Closest in time.
Efficient continual learning in neural networks with embedding regularization
Jary Pomponi, Simone Scardapane, Vincenzo Lomonaco, and Aurelio Uncini · 2020
Closest in time.
Brain-inspired replay for continual learning with artificial neural networks
Gido M van de Ven, Hava T Siegelmann, and Andreas S Tolias · 2020
Closest in time.
SOLA: Continual learning with second-order loss approximation
Dong Yin, Mehrdad Farajtabar, and Ang Li · 2020
Closest in time.
Side-Tuning: Network adaptation via additive side networks
Jeffrey O. Zhang, Alexander Sax, Amir Zamir, Leonidas J. Guibas, and Jitendra Malik · 2020
Closest in time.