Fetching the paper…
Reading the bibliography…
We revisit continual learning~(CL), which enables pre-trained vision transformers (ViTs) to sequentially fine-tune on new downstream tasks over time.
Orthogonal gradient descent for continual learning
Mehrdad Farajtabar, Navid Azizan, Alex Mott, and Ang Li · 2020
Earlier work this paper cites.
Generalized variational continual learning
Noel Loo, Siddharth Swaroop, and Richard E Turner · 2020
Earlier work this paper cites.
Co2l: Contrastive continual learning
Hyuntak Cha, Jaeho Lee, and Jinwoo Shin · 2021
Earlier work this paper cites.
Flattening sharpness for dynamic gradient projection memory benefits continual learning
Danruo Deng, Guangyong Chen, Jianye Hao, Qiong Wang, and Pheng-Ann Heng · 2021
Earlier work this paper cites.
The many faces of robustness: A critical analysis of out-of-distribution generalization
Dan Hendrycks, Steven Basart, Norman Mu, Saurav Kadavath, Frank Wang, Evan Dorundo, Rahul Desai, Tyler Zhu, Samyak Parajuli, Mike Guo, et al · 2021
Earlier work this paper cites.
Lora: Low-rank adaptation of large language models
Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen · 2021
Earlier work this paper cites.
The power of scale for parameter-efficient prompt tuning
Brian Lester, Rami Al-Rfou, and Noah Constant · 2021
Earlier work this paper cites.
Gradient projection memory for continual learning
Gobinda Saha, Isha Garg, and Kaushik Roy · 2021
Earlier work this paper cites.
Training networks in null space of feature covariance for continual learning
Shipeng Wang, Xiaorong Li, Jian Sun, and Zongben Xu · 2021
Earlier work this paper cites.
Balancing stability and plasticity through advanced null space in continual learning
Yajing Kong, Liu Liu, Zhen Wang, and Dacheng Tao · 2022
Earlier work this paper cites.
Trgp: Trust region gradient projection for continual learning
Sen Lin, Li Yang, Deliang Fan, and Junshan Zhang · 2022
Cited alongside, same era.
A unified continual learning framework with general parameter-efficient tuning
Qiankun Gao, Chen Zhao, Yifan Sun, Teng Xi, Gang Zhang, Bernard Ghanem, and Jian Zhang · 2023
Cited alongside, same era.
Segment anything
Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C Berg, Wan-Yen Lo, et al · 2023
Cited alongside, same era.
Adaptive plasticity improvement for continual learning
Yan-Shuo Liang and Wu-Jun Li · 2023
Cited alongside, same era.
Ranpac: Random projections and pre-trained models for continual learning
Mark D McDonnell, Dong Gong, Amin Parvaneh, Ehsan Abbasnejad, and Anton Van den Hengel · 2023
Cited alongside, same era.
Inflora: Interference-free low-rank adaptation for continual learning
Yan-Shuo Liang and Wu-Jun Li · 2024
Closest in time.
Visual prompt tuning in null space for continual learning
Yue Lu, Shizhou Zhang, De Cheng, Yinghui Xing, Nannan Wang, Peng Wang, and Yanning Zhang · 2024
Closest in time.
A comprehensive survey of continual learning: Theory, method and application
Liyuan Wang, Xingxing Zhang, Hang Su, and Jun Zhu · 2024
Closest in time.
Expandable subspace ensemble for pre-trained model-based class-incremental learning
Da-Wei Zhou, Hai-Long Sun, and et al · 2024
Closest in time.
Task-agnostic federated continual learning via replay-free gradient projection
Seohyeon Cha, Huancheng Chen, and Haris Vikalo · 2025
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Jingyang Qiao, Xin Tan, Chengwei Chen, Yanyun Qu, Yong Peng, Yuan Xie, et al · 2023
Cited alongside, same era.
Continual learning with scaled gradient projection
Gobinda Saha and Kaushik Roy · 2023
Cited alongside, same era.
Coda-prompt: Continual decomposed attention-based prompting for rehearsal-free continual learning
James Seale Smith, Leonid Karlinsky, Vyshnavi Gutta, Paola Cascante-Bonilla, Donghyun Kim, Assaf Arbelle, Rameswar Panda, Rogerio Feris, and Zsolt Kira · 2023
Cited alongside, same era.
Rethinking gradient projection continual learning: Stability/plasticity feature space decoupling
Zhen Zhao, Zhizhong Zhang, Xin Tan, Jun Liu, Yanyun Qu, Yuan Xie, and Lizhuang Ma · 2023
Cited alongside, same era.
Beyond prompt learning: Continual adapter for efficient rehearsal-free continual learning
Xinyuan Gao, Songlin Dong, Yuhang He, Qiang Wang, and Yihong Gong · 2024
Cited alongside, same era.
S-prompts learning with pre-trained transformers: An occam’s razor for domain incremental learning
Yabin Wang, Zhiwu Huang, and Xiaopeng Hong
Cited in the paper.
Dualprompt: Complementary prompting for rehearsal-free continual learning
Zifeng Wang, Zizhao Zhang, Sayna Ebrahimi, Ruoxi Sun, Han Zhang, Chen-Yu Lee, Xiaoqi Ren, Guolong Su, Vincent Perot, Jennifer Dy, et al
Cited in the paper.
Cl-lora: Continual low-rank adaptation for rehearsal-free class-incremental learning
Jiangpeng He, Zhihao Duan, and Fengqing Zhu · 2025
Closest in time.
Splitlora: Balancing stability and plasticity in continual learning through gradient space splitting
Haomiao Qiu, Miao Zhang, Ziyue Qiao, Weili Guan, Min Zhang, and Liqiang Nie · 2025
Closest in time.
Sd-lora: Scalable decoupled low-rank adaptation for class incremental learning
Yichen Wu, Hongming Piao, Long-Kai Huang, Renzhen Wang, Wanhua Li, Hanspeter Pfister, Deyu Meng, Kede Ma, and Ying Wei · 2025
Closest in time.
Bilora: almost-orthogonal parameter spaces for continual learning
Hao Zhu, Yifei Zhang, Junhao Dong, and Piotr Koniusz · 2025
Closest in time.
Keeplora: Continual learning with residual gradient adaptation
Mao-Lin Luo, Zi-Hao Zhou, Yi-Lin Zhang, Yuanyu Wan, Tong Wei, and Min-Ling Zhang · 2026
Closest in time.