Fetching the paper…
Reading the bibliography…
Learning multiple tasks sequentially without forgetting previous knowledge, called Continual Learning(CL), remains a long-standing challenge for neural networks.
Scalable and Order-robust Continual Learning with Additive Parameter Decomposition
Jaehong Yoon, Saehoon Kim, Eunho Yang, and Sung Ju Hwang · 1902
Earlier work this paper cites.
Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgetting
Xilai Li, Yingbo Zhou, Tianfu Wu, Richard Socher, and Caiming Xiong · 1904
Earlier work this paper cites.
Navid Azizan, Sahin Lale, and Babak Hassibi · 1906
Earlier work this paper cites.
Continual learning with hypernetworks
Johannes von Oswald, Christian Henning, João Sacramento, and Benjamin F. Grewe · 1906
Earlier work this paper cites.
Orthogonal Gradient Descent for Continual Learning
Mehrdad Farajtabar, Navid Azizan, Alex Mott, and Ang Li · 1910
Earlier work this paper cites.
Natural gradient works efficiently in learning
Shun-Ichi Amari · 1998
Earlier work this paper cites.
The mnist database of handwritten digits
Yann LeCun · 1998
Earlier work this paper cites.
Adaptive Filter Theory
Simon Haykin · 2002
Earlier work this paper cites.
An introduction to mathematical statistics
Richard J Larsen and Morris L Marx · 2005
Earlier work this paper cites.
Continual Learning in Low-rank Orthogonal Subspaces
Arslan Chaudhry, Naeemullah Khan, Puneet K. Dokania, and Philip H. S. Torr · 2010
Earlier work this paper cites.
Continual learning with direction-constrained optimization
Yunfei Teng, Anna Choromanska, and Murray Campbell · 2011
Earlier work this paper cites.
Matrix analysis
Roger A Horn and Charles R Johnson · 2012
Earlier work this paper cites.
An empirical investigation of catastrophic forgetting in gradient-based neural networks
Ian J. Goodfellow, Mehdi Mirza, Da Xiao, Aaron Courville, and Yoshua Bengio · 2014
Earlier work this paper cites.
ImageNet Large Scale Visual Recognition Challenge
Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, and Li Fei-Fei · 2015
Cited alongside, same era.
Very deep convolutional networks for large-scale image recognition
Karen Simonyan and Andrew Zisserman · 2015
Cited alongside, same era.
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Cited alongside, same era.
Andrei A. Rusu, Neil C. Rabinowitz, Guillaume Desjardins, Hubert Soyer, James Kirkpatrick, Koray Kavukcuoglu, Razvan Pascanu, and Raia Hadsell · 2016
Cited alongside, same era.
Expert gate: Lifelong learning with a network of experts
Rahaf Aljundi, Punarjay Chakravarty, and Tinne Tuytelaars · 2017
Cited alongside, same era.
Online structured laplace approximations for overcoming catastrophic forgetting
Hippolyt Ritter, Aleksandar Botev, and David Barber · 2018
Later among the works it cites.
Routing networks: Adaptive selection of non-linear functions for multi-task learning
Clemens Rosenbaum, Tim Klinger, and Matthew Riemer · 2018
Later among the works it cites.
Overcoming Catastrophic forgetting with hard attention to the task
Joan Serra, Dídac Suris, Marius Mirón, and Alexandras Karatzoglou · 2018
Later among the works it cites.
Natural Variational Continual Learning
Hanna Tseran, Mohammad Emtiyaz Khan, Tatsuya Harada, and Thang Bui · 2018
Later among the works it cites.
Lifelong learning with dynamically expandable networks
Jaehong Yoon, Eunho Yang, Jeongtae Lee, and Sung Ju Hwang · 2018
Later among the works it cites.
Automatically composing representation transformations as a means for generalization
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Chrisantha Fernando, Dylan Banarse, Charles Blundell, Yori Zwols, David Ha, Andrei A. Rusu, Alexander Pritzel, and Daan Wierstra · 2017
Cited alongside, same era.
Overcoming catastrophic forgetting in neural networks
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A. Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, Demis Hassabis, Claudia Clopath, Dharshan Kumaran, and Raia Hadsell · 2017
Cited alongside, same era.
Gradient episodic memory for continual learning
David Lopez-Paz and Marc’Aurelio Ranzato · 2017
Cited alongside, same era.
Continual learning with deep generative replay
Hanul Shin, Jung Kwon Lee, Jaehong Kim, and Jiwon Kim · 2017
Cited alongside, same era.
Continual learning through synaptic intelligence
Friedemann Zenke, Ben Poole, and Surya Ganguli · 2017
Cited alongside, same era.
Ferran Alet, Tomás Lozano-Pérez, and Leslie P. Kaelbling · 2018
Cited alongside, same era.
Variational continual learning
Cuong V. Nguyen, Yingzhen Li, Thang D. Bui, and Richard E. Turner · 2018
Cited alongside, same era.
Michael B. Chang, Sergey Levine, Abhishek Gupta, and Thomas L. Griffiths · 2019
Later among the works it cites.
Efficient lifelong learning with A-GEM
Arslan Chaudhry, Ranzato Marc’Aurelio, Marcus Rohrbach, and Mohamed Elhoseiny · 2019
Later among the works it cites.
Continual learning of context-dependent processing in neural networks
Guanxiong Zeng, Yang Chen, Bo Cui, and Shan Yu · 2019
Later among the works it cites.
Generative Feature Replay with Orthogonal Weight Modification for Continual Learning
Gehui Shen, Song Zhang, Xiang Chen, and Zhi Hong Deng · 2020
Later among the works it cites.
SOLA: Continual learning with second-order loss approximation
Dong Yin, Mehrdad Farajtabar, and Ang Li · 2020
Later among the works it cites.
Prakhar Kaushik, Alex Gain, Adam Kortylewski, and Alan Yuille · 2021
Later among the works it cites.
Gradient Projection Memory for Continual Learning
Gobinda Saha, Isha Garg, and Kaushik Roy · 2021
Later among the works it cites.