Fetching the paper…
Reading the bibliography…
Low-Rank Adaptation (LoRA) is an efficient fine-tuning method that has been extensively applied in areas such as natural language processing and computer vision.
M. McCloskey and N. J. Cohen, “Catastrophic interference in connectionist networks: The sequential learning problem,” in Psychology of learning and motivation . Elsevier, 1989, vol. 24, pp. 109–165
1989
Earlier work this paper cites.
R. A. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton, “Adaptive mixtures of local experts,” Neural computation , vol. 3, no. 1, pp. 79–87, 1991
1991
Earlier work this paper cites.
J. L. McClelland, B. L. McNaughton, and R. C. O’Reilly, “Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory.” Psychological review , vol. 102, no. 3, p. 419, 1995
1995
Earlier work this paper cites.
A. Robins, “Catastrophic forgetting, rehearsal and pseudorehearsal,” Connection Science , vol. 7, no. 2, pp. 123–146, 1995
1995
Earlier work this paper cites.
R. M. French, “Catastrophic forgetting in connectionist networks,” Trends in cognitive sciences , vol. 3, no. 4, pp. 128–135, 1999
1999
Earlier work this paper cites.
A. Krizhevsky, G. Hinton et al. , “Learning multiple layers of features from tiny images.(2009),” 2009
2009
Earlier work this paper cites.
S.-A. Rebuffi, A. Kolesnikov, G. Sperl, and C. H. Lampert, “icarl: Incremental classifier and representation learning,” in Proceedings of the IEEE conference on Computer Vision and Pattern Recognition , 2017, pp. 2001–2010
2010
Earlier work this paper cites.
C. Wah, S. Branson, P. Welinder, P. Perona, and S. Belongie, “The caltech-ucsd birds-200-2011 dataset,” 2011
2011
Earlier work this paper cites.
J. Krause, M. Stark, J. Deng, and L. Fei-Fei, “3d object representations for fine-grained categorization,” in Proceedings of the IEEE international conference on computer vision workshops , 2013, pp. 554–561
2013
Earlier work this paper cites.
R. Aljundi, P. Chakravarty, and T. Tuytelaars, “Expert gate: Lifelong learning with a network of experts,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2017, pp. 3366–3375
2017
Earlier work this paper cites.
Z. Li and D. Hoiem, “Learning without forgetting,” IEEE transactions on pattern analysis and machine intelligence , vol. 40, no. 12, pp. 2935–2947, 2017
2017
Earlier work this paper cites.
F. Zenke, B. Poole, and S. Ganguli, “Continual learning through synaptic intelligence,” in International conference on machine learning . PMLR, 2017, pp. 3987–3995
2017
Earlier work this paper cites.
2017
Earlier work this paper cites.
J. Kirkpatrick, R. Pascanu, N. Rabinowitz, J. Veness, G. Desjardins, A. A. Rusu, K. Milan, J. Quan, T. Ramalho, A. Grabska-Barwinska et al. , “Overcoming catastrophic forgetting in neural networks,” Proceedings of the national academy of sciences , vol. 114, no. 13, pp. 3521–3526, 2017
2017
Earlier work this paper cites.
R. Aljundi, F. Babiloni, M. Elhoseiny, M. Rohrbach, and T. Tuytelaars, “Memory aware synapses: Learning what (not) to forget,” in Proceedings of the European conference on computer vision (ECCV) , 2018, pp. 139–154
2018
Earlier work this paper cites.
G. I. Parisi, R. Kemker, J. L. Part, C. Kanan, and S. Wermter, “Continual lifelong learning with neural networks: A review,” Neural networks , vol. 113, pp. 54–71, 2019
2019
Earlier work this paper cites.
Y. Wu, Y. Chen, L. Wang, Y. Ye, Z. Liu, Y. Guo, and Y. Fu, “Large scale incremental learning,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2019, pp. 374–382
2019
Earlier work this paper cites.
P. Dhar, R. V. Singh, K.-C. Peng, Z. Wu, and R. Chellappa, “Learning without memorizing,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2019, pp. 5138–5146
2019
Earlier work this paper cites.
P. Buzzega, M. Boschini, A. Porrello, D. Abati, and S. Calderara, “Dark experience for general continual learning: a strong, simple baseline,” Advances in neural information processing systems , vol. 33, pp. 15 920–15 930, 2020
2020
Earlier work this paper cites.
A. Douillard, M. Cord, C. Ollion, T. Robert, and E. Valle, “Podnet: Pooled outputs distillation for small-tasks incremental learning,” in Computer vision–ECCV 2020: 16th European conference, Glasgow, UK, August 23–28, 2020, proceedings, part XX 16 . Springer, 2020, pp. 86–102
2020
Cited alongside, same era.
X. Tao, X. Chang, X. Hong, X. Wei, and Y. Gong, “Topology-preserving class-incremental learning,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XIX 16 . Springer, 2020, pp. 254–270
2020
Cited alongside, same era.
B. Zhao, X. Xiao, G. Gan, B. Zhang, and S.-T. Xia, “Maintaining discrimination and fairness in class incremental learning,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2020, pp. 13 208–13 217
2020
Cited alongside, same era.
D. Alexey, “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv: 2010.11929 , 2020
2020
M. Ayoub Kamal, M. M. Alam, A. A. B. Sajak, and M. Mohd Su’ud, “Requirements, deployments, and challenges of lora technology: A survey,” Computational Intelligence and Neuroscience , vol. 2023, no. 1, p. 5183062, 2023
2023
Later among the works it cites.
Z. Hu, Y. Li, J. Lyu, D. Gao, and N. Vasconcelos, “Dense network expansion for class incremental learning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2023, pp. 11 858–11 867
2023
Later among the works it cites.
J. Dong, D. Zhang, Y. Cong, W. Cong, H. Ding, and D. Dai, “Federated incremental semantic segmentation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2023, pp. 3934–3943
2023
Later among the works it cites.
Z. Luo, Y. Liu, B. Schiele, and Q. Sun, “Class-incremental exemplar compression for class-incremental learning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2023, pp. 11 371–11 380
2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
2021
Cited alongside, same era.
H. Zhao, Y. Fu, M. Kang, Q. Tian, F. Wu, and X. Li, “Mgsvf: Multi-grained slow versus fast framework for few-shot class-incremental learning,” IEEE Transactions on Pattern Analysis and Machine Intelligence , vol. 46, no. 3, pp. 1576–1588, 2021
2021
Cited alongside, same era.
Y. Liu, B. Schiele, and Q. Sun, “Rmm: Reinforced memory management for class-incremental learning,” Advances in Neural Information Processing Systems , vol. 34, pp. 3478–3490, 2021
2021
Cited alongside, same era.
L. Wang, B. Lei, Q. Li, H. Su, J. Zhu, and Y. Zhong, “Triple-memory networks: A brain-inspired method for continual learning,” IEEE Transactions on Neural Networks and Learning Systems , vol. 33, no. 5, pp. 1925–1934, 2021
2021
Cited alongside, same era.
C. Simon, P. Koniusz, and M. Harandi, “On learning the geodesic path for incremental learning,” in Proceedings of the IEEE/CVF conference on Computer Vision and Pattern Recognition , 2021, pp. 1591–1600
2021
Cited alongside, same era.
D. Hendrycks, K. Zhao, S. Basart, J. Steinhardt, and D. Song, “Natural adversarial examples,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2021, pp. 15 262–15 271
2021
Cited alongside, same era.
J. Dong, L. Wang, Z. Fang, G. Sun, S. Xu, X. Wang, and Q. Zhu, “Federated class-incremental learning,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2022, pp. 10 164–10 173
2022
Cited alongside, same era.
Q. Gao, C. Zhao, B. Ghanem, and J. Zhang, “R-dfcil: Relation-guided representation learning for data-free class incremental learning,” in European Conference on Computer Vision . Springer, 2022, pp. 423–439
2022
Cited alongside, same era.
Later among the works it cites.
L. Wang, X. Zhang, Q. Li, M. Zhang, H. Su, J. Zhu, and Y. Zhong, “Incorporating neuro-inspired adaptability for continual learning in artificial intelligence,” Nature Machine Intelligence , vol. 5, no. 12, pp. 1356–1368, 2023
2023
Later among the works it cites.
Q. Zhou, X. Xiang, and J. Ma, “Hierarchical task-incremental learning with feature-space initialization inspired by neural collapse,” Neural Processing Letters , vol. 55, no. 8, pp. 10 811–10 827, 2023
2023
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
G. Zhang, L. Wang, G. Kang, L. Chen, and Y. Wei, “Slca: Slow learner with classifier alignment for continual learning on a pre-trained model,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2023, pp. 19 148–19 158
2023
Later among the works it cites.
Q. Gao, C. Zhao, Y. Sun, T. Xi, G. Zhang, B. Ghanem, and J. Zhang, “A unified continual learning framework with general parameter-efficient tuning,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2023, pp. 11 483–11 493
2023
Later among the works it cites.
2023
Later among the works it cites.
J. Yu, Y. Zhuge, L. Zhang, P. Hu, D. Wang, H. Lu, and Y. He, “Boosting continual learning of vision-language models via mixture-of-experts adapters,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 23 219–23 230
2024
Later among the works it cites.
D.-W. Zhou, H.-L. Sun, H.-J. Ye, and D.-C. Zhan, “Expandable subspace ensemble for pre-trained model-based class-incremental learning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 23 554–23 564
2024
Later among the works it cites.
D. Goswami, Y. Liu, B. Twardowski, and J. van de Weijer, “Fecam: Exploiting the heterogeneity of class distributions in exemplar-free continual learning,” Advances in Neural Information Processing Systems , vol. 36, 2024
2024
Later among the works it cites.
2024
Later among the works it cites.
2024
Later among the works it cites.
Y.-S. Liang and W.-J. Li, “Inflora: Interference-free low-rank adaptation for continual learning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 23 638–23 647
2024
Later among the works it cites.
M. D. McDonnell, D. Gong, A. Parvaneh, E. Abbasnejad, and A. van den Hengel, “Ranpac: Random projections and pre-trained models for continual learning,” Advances in Neural Information Processing Systems , vol. 36, 2024
2024
Later among the works it cites.
Y. Tan, Q. Zhou, X. Xiang, K. Wang, Y. Wu, and Y. Li, “Semantically-shifted incremental adapter-tuning is a continual vitransformer,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 23 252–23 262
2024
Later among the works it cites.