Fetching the paper…
Reading the bibliography…
Continual learning (CL) aims to learn a sequence of tasks without forgetting prior knowledge, but gradient updates for a new task often overwrite the weights learned earlier, causing catastrophic forgetting (CF).
Catastrophic interference in connectionist networks: The sequential learning problem
Michael McCloskey and Neal J. Cohen · 1989
Earlier work this paper cites.
Catastrophic forgetting in connectionist networks
Robert M. French · 1999
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Alex Krizhevsky, Geoffrey Hinton, et al · 2009
Earlier work this paper cites.
Imagenet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton · 2012
Earlier work this paper cites.
Hypernetworks
David Ha, Andrew Dai, and Quoc Le · 2016
Earlier work this paper cites.
icarl: Incremental classifier and representation learning
Sylvestre-Alvise Rebuffi, Alexander Kolesnikov, and Christoph Lampert · 2016
Earlier work this paper cites.
Progressive neural networks
Andrei Rusu, Neil Rabinowitz, Guillaume Desjardins, Hubert Soyer, James Kirkpatrick, Koray Kavukcuoglu, Razvan Pascanu, and Raia Hadsell · 2016
Earlier work this paper cites.
Overcoming catastrophic forgetting in neural networks
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A. Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, Demis Hassabis, Claudia Clopath, Dharshan Kumaran, and Raia Hadsell · 2017
Earlier work this paper cites.
Learning without forgetting
Zhizhong Li and Derek Hoiem · 2017
Earlier work this paper cites.
Prototypical networks for few-shot learning
Jake Snell, Kevin Swersky, and Richard Zemel · 2017
Cited alongside, same era.
Continual learning through synaptic intelligence
Friedemann Zenke, Ben Poole, and Surya Ganguli · 2017
Cited alongside, same era.
Selective experience replay for lifelong learning
David Isele and Akansel Cosgun · 2018
Cited alongside, same era.
Continual learning with hypernetworks
Johannes von Oswald, Christian Henning, and João Sacramento · 2019
Cited alongside, same era.
Dark experience for general continual learning: a strong, simple baseline
Pietro Buzzega, Matteo Boschini, Angelo Porrello, Davide Abati, and SIMONE CALDERARA · 2020
Cited alongside, same era.
Anatomy of catastrophic forgetting: Hidden representations and task semantics, 2020
Vinay V. Ramasesh, Ethan Dyer, and Maithra Raghu · 2020
Cited alongside, same era.
Probing representation forgetting in supervised and unsupervised continual learning
MohammadReza Davari, Nader Asadi, Sudhir Mudur, Rahaf Aljundi, and Eugene Belilovsky · 2022
Later among the works it cites.
Representational continuity for unsupervised continual learning
Divyam Madaan, Jaehong Yoon, Yuanchun Li, Yunxin Liu, and Sung Ju Hwang · 2022
Later among the works it cites.
Gcr: Gradient coreset based replay buffer selection for continual learning
Rishabh Tiwari, Krishnateja Killamsetty, Rishabh Iyer, and Pradeep Shenoy · 2022
Later among the works it cites.
Partial hypernetworks for continual learning
Hamed Hemati, Vincenzo Lomonaco, Davide Bacciu, and Damian Borth · 2023
Later among the works it cites.
Continual learning: Applications and the road forward
Eli Verwimp, Rahaf Aljundi, Shai Ben-David, Matthias Bethge, Andrea Cossu, Alexander Gepperth, Tyler L Hayes, Eyke Hüllermeier, Christopher Kanan, Dhireesha Kudithipudi, et al · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Semantic drift compensation for class-incremental learning
Lu Yu, Bartlomiej Twardowski, Xialei Liu, Luis Herranz, Kai Wang, Yongmei Cheng, Shangling Jui, and Joost van de Weijer · 2020
Cited alongside, same era.
Prototype augmentation and self-supervision for incremental learning
Fei Zhu, Xu-Yao Zhang, Chuang Wang, Fei Yin, and Cheng-Lin Liu · 2021
Cited alongside, same era.
Riemannian walk for incremental learning: Understanding forgetting and intransigence
Arslan Chaudhry, Puneet K Dokania, Thalaiyasingam Ajanthan, and Philip HS Torr
Cited in the paper.
Efficient lifelong learning with a-gem, 2018b
Arslan Chaudhry, Marc’Aurelio Ranzato, Marcus Rohrbach, and Mohamed Elhoseiny
Cited in the paper.
Elastic feature consolidation for cold start exemplar-free incremental learning
Simone Magistri, Tomaso Trinci, Albin Soutif, Joost van de Weijer, and Andrew D Bagdanov
Cited in the paper.
Resurrecting old classes with new data for exemplar-free continual learning
Dipam Goswami, Albin Soutif-Cormerais, Yuyang Liu, Sandesh Kamath, Bart Twardowski, Joost van de Weijer, et al · 2024
Later among the works it cites.
Lifelong learning gets better with mixup and unsupervised continual representation
Prashant Kumar and Durga Toshniwal · 2024
Later among the works it cites.
Contrastive continual learning with importance sampling and prototype-instance relation distillation
Jiyong Li, Dilshod Azizov, LI Yang, and Shangsong Liang · 2024
Later among the works it cites.