Fetching the paper…
Reading the bibliography…
Lifelong learning or continual learning is the problem of training an AI agent continuously while also preventing it from forgetting its previously acquired knowledge.
J. S. Vitter, “Random sampling with a reservoir,”
1985
Earlier work this paper cites.
M. McCloskey and N. J. Cohen, “Catastrophic interference in connectionist networks: The sequential learning problem,” in
1989
Earlier work this paper cites.
R. F. Thompson and D. J. Krupa, “Organization of memory traces in the mammalian brain,”
1994
Earlier work this paper cites.
D. J. Linden, “Long-term synaptic depression in the mammalian brain,”
1994
Earlier work this paper cites.
S. Thrun, “Lifelong learning algorithms,” in
1998
Earlier work this paper cites.
A. Holtmaat and K. Svoboda, “Experience-dependent structural synaptic plasticity in the mammalian brain,”
2009
Earlier work this paper cites.
J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, “Imagenet: A large-scale hierarchical image database,” in
2009
Earlier work this paper cites.
S.-A. Rebuffi, A. Kolesnikov, G. Sperl, and C. H. Lampert, “icarl: Incremental classifier and representation learning,” in
2010
Earlier work this paper cites.
2013
Earlier work this paper cites.
S. Fanello, C. Ciliberto, M. Santoro, L. Natale, G. Metta, L. Rosasco, and F. Odone, “icub world: Friendly robots help building good vision data-sets,” in
2013
Earlier work this paper cites.
G. Hinton, O. Vinyals, and J. Dean, “Distilling the knowledge in a neural network,”
2015
Earlier work this paper cites.
O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein,
2015
Earlier work this paper cites.
G. Pasquale, C. Ciliberto, F. Odone, L. Rosasco, and L. Natale, “Teaching icub to recognize objects using deep convolutional neural networks,” in
2015
Earlier work this paper cites.
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in
2016
Earlier work this paper cites.
J. Kirkpatrick, R. Pascanu, N. Rabinowitz, J. Veness, G. Desjardins, A. A. Rusu, K. Milan, J. Quan, T. Ramalho, A. Grabska-Barwinska,
2017
Earlier work this paper cites.
Z. Li and D. Hoiem, “Learning without forgetting,”
2017
Earlier work this paper cites.
R. Kemker and C. Kanan, “Fearnet: Brain-inspired model for incremental learning,”
2017
Earlier work this paper cites.
F. Zenke, B. Poole, and S. Ganguli, “Continual learning through synaptic intelligence,” in
2017
Earlier work this paper cites.
C. V. Nguyen, Y. Li, T. D. Bui, and R. E. Turner, “Variational continual learning,”
2017
Earlier work this paper cites.
D. Lopez-Paz and M. Ranzato, “Gradient episodic memory for continual learning,” in
2017
Earlier work this paper cites.
2017
Cited alongside, same era.
V. Lomonaco and D. Maltoni, “Core50: a new dataset and benchmark for continuous object recognition,” in
2017
Cited alongside, same era.
A. Tarvainen and H. Valpola, “Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results,”
2017
Cited alongside, same era.
R. Aljundi, P. Chakravarty, and T. Tuytelaars, “Expert gate: Lifelong learning with a network of experts,” in
2017
Cited alongside, same era.
H. Shin, J. K. Lee, J. Kim, and J. Kim, “Continual learning with deep generative replay,” in
2017
Cited alongside, same era.
E. Belouadah and A. Popescu, “Il2m: Class incremental learning with dual memory,” in
2019
Later among the works it cites.
S. Hou, X. Pan, C. C. Loy, Z. Wang, and D. Lin, “Learning a unified classifier incrementally via rebalancing,” in
2019
Later among the works it cites.
R. Aljundi, M. Lin, B. Goujaud, and Y. Bengio, “Gradient based sample selection for online continual learning,” in
2019
Later among the works it cites.
2019
Later among the works it cites.
A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein, L. Antiga,
2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
J. Yoon, E. Yang, J. Lee, and S. J. Hwang, “Lifelong learning with dynamically expandable networks,”
2017
Cited alongside, same era.
C. Finn, P. Abbeel, and S. Levine, “Model-agnostic meta-learning for fast adaptation of deep networks,” in
2017
Cited alongside, same era.
R. Aljundi, F. Babiloni, M. Elhoseiny, M. Rohrbach, and T. Tuytelaars, “Memory aware synapses: Learning what (not) to forget,” in
2018
Cited alongside, same era.
C. Wu, L. Herranz, X. Liu, J. van de Weijer, B. Raducanu,
2018
Cited alongside, same era.
A. Chaudhry, P. K. Dokania, T. Ajanthan, and P. H. Torr, “Riemannian walk for incremental learning: Understanding forgetting and intransigence,” in
2018
Cited alongside, same era.
A. Chaudhry, M. Ranzato, M. Rohrbach, and M. Elhoseiny, “Efficient lifelong learning with a-gem,”
2018
Cited alongside, same era.
C. Zhang, M. Ren, and R. Urtasun, “Graph hypernetworks for neural architecture search,”
2018
Cited alongside, same era.
A. Prabhu, P. H. Torr, and P. K. Dokania, “Gdumb: A simple approach that questions our progress in continual learning,” in
2020
Later among the works it cites.
2020
Later among the works it cites.
L. Yang, Y. Han, X. Chen, S. Song, J. Dai, and G. Huang, “Resolution adaptive networks for efficient inference,” in
2020
Later among the works it cites.
Z. Chen, L. Zhu, L. Wan, S. Wang, W. Feng, and P.-A. Heng, “A multi-task mean teacher for semi-supervised shadow detection,” in
2020
Later among the works it cites.
X. Tao, X. Chang, X. Hong, X. Wei, and Y. Gong, “Topology-preserving class-incremental learning,” in
2020
Later among the works it cites.
2020
Later among the works it cites.
H. Mobahi, M. Farajtabar, and P. Bartlett, “Self-distillation amplifies regularization in hilbert space,”
2020
Later among the works it cites.
G. Gupta, K. Yadav, and L. Paull, “Look-ahead meta learning for continual learning,”
2020
Later among the works it cites.
A. Ruiz and J. Verbeek, “Anytime inference with distilled hierarchical neural ensembles,” in
2021
Later among the works it cites.
2021
Later among the works it cites.
J. Deng, W. Li, Y. Chen, and L. Duan, “Unbiased mean teacher for cross-domain object detection,” in
2021
Later among the works it cites.
V. K. Verma, K. J. Liang, N. Mehta, P. Rai, and L. Carin, “Efficient feature transformations for discriminative and generative continual learning,” in
2021
Later among the works it cites.
L. Zhang, C. Bao, and K. Ma, “Self-distillation: Towards efficient and compact neural networks,”
2021
Later among the works it cites.
2022
Later among the works it cites.