Memory-Efficient Semi-Supervised Continual Learning: The World is its Own Replay Buffer

A. Robins, “Catastrophic forgetting, rehearsal and pseudorehearsal,” Connection Science

1995

Earlier work this paper cites.

A. Krizhevsky, G. Hinton, et al

2009

Earlier work this paper cites.

D.-H. Lee, “Pseudo-label : The simple and efficient semi-supervised learning method for deep neural networks,” ICML 2013 Workshop : Challenges in Representation Learning (WREPL)

2013

Earlier work this paper cites.

D. P. Kingma, D. J. Rezende, S. Mohamed, and M. Welling, “Semi-supervised learning with deep generative models,” in Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 2

2014

Earlier work this paper cites.

J. T. Springenberg, “Unsupervised and semi-supervised learning with categorical generative adversarial networks,” arXiv preprint arXiv:1511.06390

Original

2015

Earlier work this paper cites.

Y. Le and X. Yang, “Tiny imagenet visual recognition challenge,” CS 231N

2015

Earlier work this paper cites.

K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition

2016

Earlier work this paper cites.

A. A. Rusu, N. C. Rabinowitz, G. Desjardins, H. Soyer, J. Kirkpatrick, K. Kavukcuoglu, R. Pascanu, and R. Hadsell, “Progressive neural networks,” arXiv preprint arXiv:1606.04671

Original

2016

Earlier work this paper cites.

X. Zhu and M. Bain, “B-cnn: branch convolutional neural network for hierarchical classification,” arXiv preprint arXiv:1709.09890

Original

2017

Earlier work this paper cites.

Z. Li and D. Hoiem, “Learning without forgetting,” IEEE transactions on pattern analysis and machine intelligence

2017

Earlier work this paper cites.

S. Rebuffi, A. Kolesnikov, G. Sperl, and C. H. Lampert, “icarl: Incremental classifier and representation learning,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition

2017

Earlier work this paper cites.

S. Liang, Y. Li, and R. Srikant, “Enhancing the reliability of out-of-distribution image detection in neural networks,” arXiv preprint arXiv:1706.02690

Original

2017

Earlier work this paper cites.

A. Tarvainen and H. Valpola, “Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results,” in Advances in Neural Information Processing Systems 30

2017

Earlier work this paper cites.

D. Lopez-Paz and M. Ranzato, “Gradient episodic memory for continual learning,” in Proceedings of the 31st International Conference on Neural Information Processing Systems

2017

Earlier work this paper cites.

A. Gepperth and C. Karaoguz, “Incremental learning with self-organizing maps,” 2017 12th International Workshop on Self-Organizing Maps and Learning Vector Quantization, Clustering and Data Visualization (WSOM)

2017

Earlier work this paper cites.

N. Kamra, U. Gupta, and Y. Liu, “Deep generative dual memory network for continual learning,” arXiv preprint arXiv:1710.10368

Original

2017

Earlier work this paper cites.

H. Shin, J. K. Lee, J. Kim, and J. Kim, “Continual learning with deep generative replay,” in Advances in Neural Information Processing Systems 30

2017

Earlier work this paper cites.

V. Lomonaco and D. Maltoni, “Core50: a new dataset and benchmark for continuous object recognition,” arXiv preprint arXiv:1705.03550

Original

2017

Earlier work this paper cites.

J. Kirkpatrick, R. Pascanu, N. Rabinowitz, J. Veness, G. Desjardins, A. A. Rusu, K. Milan, J. Quan, T. Ramalho, A. Grabska-Barwinska, et al

2017

Earlier work this paper cites.

F. Zenke, B. Poole, and S. Ganguli, “Continual learning through synaptic intelligence,” in International Conference on Machine Learning

2017

Earlier work this paper cites.

Y.-C. Hsu, Y.-C. Liu, A. Ramasamy, and Z. Kira, “Re-evaluating continual learning scenarios: A categorization and case for strong baselines,” arXiv preprint arXiv:1810.12488

Original

2018

Cited alongside, same era.

A. Oliver, A. Odena, C. A. Raffel, E. D. Cubuk, and I. Goodfellow, “Realistic evaluation of deep semi-supervised learning algorithms,” in Advances in Neural Information Processing Systems

2018

Cited alongside, same era.

F. M. Castro, M. J. Marín-Jiménez, N. Guil, C. Schmid, and K. Alahari, “End-to-end incremental learning,” in Proceedings of the European Conference on Computer Vision (ECCV)

2018

Cited alongside, same era.

S. Hou, X. Pan, C. Change Loy, Z. Wang, and D. Lin, “Lifelong learning via progressive distillation and retrospection,” in Proceedings of the European Conference on Computer Vision (ECCV)

2018

Cited alongside, same era.

T. L. Hayes, N. D. Cahill, and C. Kanan, “Memory efficient experience replay for streaming learning,” in 2019 International Conference on Robotics and Automation (ICRA)

2019

Later among the works it cites.

D. Rolnick, A. Ahuja, J. Schwarz, T. Lillicrap, and G. Wayne, “Experience replay for continual learning,” in Advances in Neural Information Processing Systems

2019

Later among the works it cites.

J. von Oswald, C. Henning, J. Sacramento, and B. F. Grewe, “Continual learning with hypernetworks,” arXiv preprint arXiv:1906.00695

Original

2019

Later among the works it cites.

D. Maltoni and V. Lomonaco, “Continuous learning in single-incremental-task scenarios,” Neural Networks

2019

Later among the works it cites.

J. Smith, S. Baer, C. Taylor, and C. Dovrolis, “Unsupervised progressive learning and the stam architecture,” arXiv preprint arXiv:1904.02021