Fetching the paper…
Reading the bibliography…
In Continual Learning, a Neural Network is trained on a stream of data whose distribution shifts over time.
J. S. Vitter, “Random sampling with a reservoir,” ACM Transactions on Mathematical Software (TOMS) , 1985
1985
Earlier work this paper cites.
M. McCloskey and N. J. Cohen, “Catastrophic interference in connectionist networks: The sequential learning problem,” in Psychology of learning and motivation , 1989
1989
Earlier work this paper cites.
R. Ratcliff, “Connectionist models of recognition memory: constraints imposed by learning and forgetting functions.” Psychological review , 1990
1990
Earlier work this paper cites.
A. Robins, “Catastrophic forgetting, rehearsal and pseudorehearsal,” Connection Science , 1995
1995
Earlier work this paper cites.
Y. LeCun, L. Bottou, Y. Bengio, P. Haffner et al. , “Gradient-based learning applied to document recognition,” Proceedings of the IEEE , 1998
1998
Earlier work this paper cites.
A. Krizhevsky et al. , “Learning multiple layers of features from tiny images,” Citeseer, Tech. Rep., 2009
2009
Earlier work this paper cites.
2013
Earlier work this paper cites.
2016
Earlier work this paper cites.
S. C. Wong, A. Gatt, V. Stamatescu, and M. D. McDonnell, “Understanding data augmentation for classification: when to warp?” in 2016 international conference on digital image computing: techniques and applications (DICTA) , 2016
2016
Earlier work this paper cites.
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on Computer Vision and Pattern Recognition , 2016
2016
Earlier work this paper cites.
S.-A. Rebuffi, A. Kolesnikov, G. Sperl, and C. H. Lampert, “icarl: Incremental classifier and representation learning,” in Proceedings of the IEEE conference on Computer Vision and Pattern Recognition , 2017
2017
Earlier work this paper cites.
J. Kirkpatrick, R. Pascanu, N. Rabinowitz, J. Veness, G. Desjardins, A. A. Rusu, K. Milan, J. Quan, T. Ramalho, A. Grabska-Barwinska et al. , “Overcoming catastrophic forgetting in neural networks,” Proceedings of the National Academy of Sciences , 2017
2017
Earlier work this paper cites.
F. Zenke, B. Poole, and S. Ganguli, “Continual learning through synaptic intelligence,” in International Conference on Machine Learning , 2017
2017
Earlier work this paper cites.
D. Lopez-Paz and M. Ranzato, “Gradient episodic memory for continual learning,” in Advances in Neural Information Processing Systems , 2017
2017
Earlier work this paper cites.
2017
Cited alongside, same era.
Z. Li and D. Hoiem, “Learning without forgetting,” IEEE Transactions on Pattern Analysis and Machine Intelligence , 2017
2017
Cited alongside, same era.
H. Shin, J. K. Lee, J. Kim, and J. Kim, “Continual learning with deep generative replay,” in Advances in Neural Information Processing Systems , 2017
2017
Cited alongside, same era.
W. An, H. Wang, Y. Zhang, and Q. Dai, “Exponential decay sine wave learning rate for fast deep neural network training,” in 2017 IEEE Visual Communications and Image Processing (VCIP) , 2017
2017
Cited alongside, same era.
M. Riemer, I. Cases, R. Ajemian, M. Liu, I. Rish, Y. Tu, and G. Tesauro, “Learning to learn without forgetting by maximizing transfer and minimizing interference,” in International Conference on Learning Representations , 2019
2019
Later among the works it cites.
R. Aljundi, M. Lin, B. Goujaud, and Y. Bengio, “Gradient based sample selection for online continual learning,” in Advances in Neural Information Processing Systems , 2019
2019
Later among the works it cites.
R. Aljundi, E. Belilovsky, T. Tuytelaars, L. Charlin, M. Caccia, M. Lin, and L. Page-Caccia, “Online continual learning with maximal interfered retrieval,” in Advances in Neural Information Processing Systems , 2019
2019
Later among the works it cites.
Y. Wu, Y. Chen, L. Wang, Y. Ye, Z. Liu, Y. Guo, and Y. Fu, “Large scale incremental learning,” in Proceedings of the IEEE conference on Computer Vision and Pattern Recognition , 2019
2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
2017
Cited alongside, same era.
Y.-C. Hsu, Y.-C. Liu, A. Ramasamy, and Z. Kira, “Re-evaluating continual learning scenarios: A categorization and case for strong baselines,” in NeurIPS Continual learning Workshop , 2018
2018
Cited alongside, same era.
G. M. van de Ven and A. S. Tolias, “Three continual learning scenarios,” NeurIPS Continual Learning Workshop , 2018
2018
Cited alongside, same era.
2018
Cited alongside, same era.
A. Chaudhry, P. K. Dokania, T. Ajanthan, and P. H. Torr, “Riemannian walk for incremental learning: Understanding forgetting and intransigence,” in Proceedings of the European Conference on Computer Vision , 2018
2018
Cited alongside, same era.
A. Mallya and S. Lazebnik, “Packnet: Adding multiple tasks to a single network by iterative pruning,” in Proceedings of the IEEE conference on Computer Vision and Pattern Recognition , 2018
2018
Cited alongside, same era.
J. Serra, D. Suris, M. Miron, and A. Karatzoglou, “Overcoming catastrophic forgetting with hard attention to the task,” in International Conference on Machine Learning , 2018
2018
Cited alongside, same era.
2018
Cited alongside, same era.
S. Hou, X. Pan, C. C. Loy, Z. Wang, and D. Lin, “Learning a unified classifier incrementally via rebalancing,” in Proceedings of the IEEE conference on Computer Vision and Pattern Recognition , 2019
2019
Later among the works it cites.
2019
Later among the works it cites.
A. Chaudhry, M. Ranzato, M. Rohrbach, and M. Elhoseiny, “Efficient lifelong learning with a-gem,” in International Conference on Learning Representations , 2019
2019
Later among the works it cites.
M. Riemer, T. Klinger, D. Bouneffouf, and M. Franceschini, “Scalable recollections for continual lifelong learning,” in Proceedings of the AAAI Conference on Artificial Intelligence , 2019
2019
Later among the works it cites.
2019
Later among the works it cites.
2019
Later among the works it cites.
D. Maltoni and V. Lomonaco, “Continuous learning in single-incremental-task scenarios,” Neural Networks , 2019
2019
Later among the works it cites.
2020
Closest in time.
P. Buzzega, M. Boschini, A. Porrello, D. Abati, and S. Calderara, “Dark experience for general continual learning: a strong, simple baseline,” in Advances in Neural Information Processing Systems , 2020
2020
Closest in time.