PEARL: Input-Agnostic Prompt Enhancement with Negative Feedback Regulation for Class-Incremental Learning

A large-scale study of representation learning with the visual task adaptation benchmark

Original

Zhai, X.; Puigcerver, J.; Kolesnikov, A.; Ruyssen, P.; Riquelme, C.; Lucic, M.; Djolonga, J.; Pinto, A. S.; Neumann, M.; Dosovitskiy, A.; et al. 2019 · 1910

Earlier work this paper cites.

Catastrophic interference in connectionist networks: The sequential learning problem

McCloskey, M.; and Cohen, N. J. 1989 · 1989

Earlier work this paper cites.

Learning multiple layers of features from tiny images

Krizhevsky, A.; Hinton, G.; et al. 2009 · 2009

Earlier work this paper cites.

An image is worth 16x16 words: Transformers for image recognition at scale

Original

Dosovitskiy, A.; Beyer, L.; Kolesnikov, A.; Weissenborn, D.; Zhai, X.; Unterthiner, T.; Dehghani, M.; Minderer, M.; Heigold, G.; Gelly, S.; et al. 2020 · 2010

Earlier work this paper cites.

iCaRL: Incremental classifier and representation learning

Rebuffi, S.-A.; Kolesnikov, A.; Sperl, G.; and Lampert, C. H. 2017a · 2010

Earlier work this paper cites.

icarl: Incremental classifier and representation learning

Rebuffi, S.-A.; Kolesnikov, A.; Sperl, G.; and Lampert, C. H. 2017b · 2010

Earlier work this paper cites.

The caltech-ucsd birds-200-2011 dataset

Wah, C.; Branson, S.; Welinder, P.; Perona, P.; and Belongie, S. 2011 · 2011

Earlier work this paper cites.

Distilling the knowledge in a neural network

Original

Hinton, G.; Vinyals, O.; and Dean, J. 2015 · 2015

Earlier work this paper cites.

Less-forgetting learning in deep neural networks

Original

Jung, H.; Ju, J.; Jung, M.; and Kim, J. 2016 · 2016

Earlier work this paper cites.

Overcoming catastrophic forgetting in neural networks

Kirkpatrick, J.; Pascanu, R.; Rabinowitz, N.; Veness, J.; Desjardins, G.; Rusu, A. A.; Milan, K.; Quan, J.; Ramalho, T.; Grabska-Barwinska, A.; et al. 2017 · 2017

Earlier work this paper cites.

Learning without forgetting

Li, Z.; and Hoiem, D. 2017 · 2017

Earlier work this paper cites.

Continual learning with deep generative replay

Shin, H.; Lee, J. K.; Kim, J.; and Kim, J. 2017 · 2017

Earlier work this paper cites.

Attention is all you need

Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A. N.; Kaiser, Ł.; and Polosukhin, I. 2017 · 2017

Earlier work this paper cites.

Memory aware synapses: Learning what (not) to forget

Aljundi, R.; Babiloni, F.; Elhoseiny, M.; Rohrbach, M.; and Tuytelaars, T. 2018 · 2018

Cited alongside, same era.

Riemannian walk for incremental learning: Understanding forgetting and intransigence

Chaudhry, A.; Dokania, P. K.; Ajanthan, T.; and Torr, P. H. 2018 · 2018

Cited alongside, same era.

Learning to remember: A synaptic plasticity driven framework for continual learning

Ostapenko, O.; Puscas, M.; Klein, T.; Jahnichen, P.; and Nabi, M. 2019 · 2019

Cited alongside, same era.

Pytorch: An imperative style, high-performance deep learning library

Paszke, A.; Gross, S.; Massa, F.; Lerer, A.; Bradbury, J.; Chanan, G.; Killeen, T.; Lin, Z.; Gimelshein, N.; Antiga, L.; et al. 2019 · 2019

Cited alongside, same era.

Large scale incremental learning

Wu, Y.; Chen, Y.; Wang, L.; Ye, Y.; Liu, Z.; Guo, Y.; and Fu, Y. 2019 · 2019

Cited alongside, same era.

Incremental learning using conditional adversarial networks

S-prompts learning with pre-trained transformers: An occam’s razor for domain incremental learning

Wang, Y.; Huang, Z.; and Hong, X. 2022 · 2022

Later among the works it cites.

Benchmarking omni-vision representation through the lens of visual realms

Zhang, Y.; Yin, Z.; Shao, J.; and Liu, Z. 2022 · 2022

Later among the works it cites.

Coda-prompt: Continual decomposed attention-based prompting for rehearsal-free continual learning

Smith, J. S.; Karlinsky, L.; Gutta, V.; Cascante-Bonilla, P.; Kim, D.; Arbelle, A.; Panda, R.; Feris, R.; and Kira, Z. 2023 · 2023

Later among the works it cites.

PILOT: A Pre-Trained Model-Based Continual Learning Toolbox

Original

Sun, H.-L.; Zhou, D.-W.; Ye, H.-J.; and Zhan, D.-C. 2023 · 2023

Later among the works it cites.

Isolation and impartial aggregation: A paradigm of incremental learning without interference

Wang, Y.; Ma, Z.; Huang, Z.; Wang, Y.; Su, Z.; and Hong, X. 2023 · 2023

Later among the works it cites.