Fetching the paper…
Reading the bibliography…
Neural networks are prone to catastrophic forgetting when trained incrementally on different tasks.
M. McCloskey and N. J. Cohen, “Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem,” in Psychology of Learning and Motivation , 1989, vol. 24, pp. 109–165
1989
Earlier work this paper cites.
Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” Proceedings of the IEEE , vol. 86, no. 11, pp. 2278–2324, 1998
1998
Earlier work this paper cites.
A. Krizhevsky, “Learning Multiple Layers of Features from Tiny Images,” Tech. Rep., 2009
2009
Earlier work this paper cites.
S. J. Pan and Q. Yang, “A survey on transfer learning,” IEEE Trans. Knowl. Dat. Eng. , vol. 22, no. 10, pp. 1345–1359, 2010
2010
Earlier work this paper cites.
S.-A. Rebuffi, A. Kolesnikov, G. Sperl, and C. H. Lampert, “iCaRL: Incremental Classifier and Representation Learning,” in IEEE Conf. Comput. Vis. Pattern Recog. , 2017, pp. 2001–2010
2010
Earlier work this paper cites.
C. Wah, S. Branson, P. Welinder, P. Perona, and S. Belongie, “The Caltech-UCSD Birds-200-2011 Dataset,” California Institute of Technology, Tech. Rep., 2011
2011
Earlier work this paper cites.
I. J. Goodfellow, M. Mirza, D. Xiao, A. Courville, and Y. Bengio, “An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks,” arXiv preprint:1312.6211 , 2013
2013
Earlier work this paper cites.
D. P. Kingma and M. Welling, “Auto-Encoding Variational Bayes,” arXiv preprint:1312.6114 , 2013
2013
Earlier work this paper cites.
I. J. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, “Generative Adversarial Nets,” in Adv. Neural Inform. Process. Syst. , vol. 27, 2014, pp. 2672–2680
2014
Earlier work this paper cites.
M. Mirza and S. Osindero, “Conditional Generative Adversarial Nets,” arXiv preprint:1411.1784 , 2014
2014
Earlier work this paper cites.
O. Russakovsky et al. , “ImageNet Large Scale Visual Recognition Challenge,” Int. J. Comput. Vis. , vol. 115, no. 3, pp. 211–252, 2015
2015
Earlier work this paper cites.
G. Hinton, O. Vinyals, and J. Dean, “Distilling the Knowledge in a Neural Network,” arXiv preprint:1503.02531 , 2015
2015
Earlier work this paper cites.
K. He, X. Zhang, S. Ren, and J. Sun, “Deep Residual Learning for Image Recognition,” IEEE Conf. Comput. Vis. Pattern Recog. , pp. 770–778, 2016
2016
Earlier work this paper cites.
H. Shin, J. K. Lee, J. Kim, and J. Kim, “Continual Learning with Deep Generative Replay,” in Adv. Neural Inform. Process. Syst. , vol. 30, 2017
2017
Earlier work this paper cites.
2017
Earlier work this paper cites.
J. Kirkpatrick, R. Pascanu, N. Rabinowitz, J. Veness, G. Desjardins, A. A. Rusu, M. Kieran, J. Quan, T. Ramalho, A. Grabska-Barwinska, D. Hassabis, C. Clopath, D. Kumaran, and R. Hadsell, “Overcoming catastrophic forgetting in neural networks,” Proc. Nat. Acad. Sci. , vol. 114, no. 13, pp. 3521–3526, 2017
2017
Earlier work this paper cites.
F. Zenke, B. Poole, and S. Ganguli, “Continual Learning Through Synaptic Intelligence,” in Int. Conf. Mach. Learn. , 2017, pp. 3987–3995
2017
Earlier work this paper cites.
S. Farquhar and Y. Gal, “Towards Robust Evaluations of Continual Learning,” arXiv preprint:1805.09733 , 2018
2018
Earlier work this paper cites.
F. M. Castro, M. J. Marín-Jiménez, N. Guil, C. Schmid, and K. Alahari, “End-to-End Incremental Learning,” in Eur. Conf. Comput. Vis. , 2018, pp. 233–248
2018
Earlier work this paper cites.
C. Wu, L. Herranz, X. Liu, Y. Wang, J. Van De Weijer, and B. Raducanu, “Memory Replay GANs: learning to generate images from new categories without forgetting,” in Adv. Neural Inform. Process. Syst. , vol. 31, 2018
2018
Earlier work this paper cites.
R. Kemker and C. Kanan, “FearNet: Brain-Inspired Model for Incremental Learning,” in Int. Conf. Learn. Represent. , 2018
2018
Cited alongside, same era.
C. V. Nguyen, Y. Li, T. D. Bui, and R. E. Turner, “Variational Continual Learning,” in Int. Conf. Learn. Represent. , 2018
2018
Cited alongside, same era.
A. Mallya, D. Davis, and S. Lazebnik, “Piggyback: Adapting a Single Network to Multiple Tasks by Learning to Mask Weights,” in Eur. Conf. Comput. Vis. , 2018, pp. 67–82
2018
Cited alongside, same era.
J. Serrà, D. Surís, M. Miron, and A. Karatzoglou, “Overcoming catastrophic forgetting with hard attention to the task,” in Int. Conf. Mach. Learn. , vol. 80, 2018, pp. 4548–4557
2018
Cited alongside, same era.
T. Miyato and M. Koyama, “cGANs with Projection Discriminator,” arXiv preprint:1802.05637 , 2018
2018
Cited alongside, same era.
Y. Cong, M. Zhao, J. Li, S. Wang, and L. Carin, “GAN Memory with No Forgetting,” in Adv. Neural Inform. Process. Syst. , vol. 33, 2020, pp. 16 481–16 494
2020
Later among the works it cites.
G. M. van de Ven, H. T. Siegelmann, and A. S. Tolias, “Brain-inspired replay for continual learning with artificial neural networks,” Nat. Commun. , vol. 11, no. 1, pp. 1–14, 2020
2020
Later among the works it cites.
X. Liu, C. Wu, M. Menta, L. Herranz, B. Raducanu, A. D. Bagdanov, S. Jui, and J. van de Weijer, “Generative Feature Replay For Class-Incremental Learning,” in IEEE Conf. Comput. Vis. Pattern Recog. Worksh. , 2020, pp. 226–227
2020
Later among the works it cites.
M. Wortsman, V. Ramanujan, R. Liu, A. Kembhavi, M. Rastegari, J. Yosinski, and A. Farhadi, “Supermasks in Superposition,” in Adv. Neural Inform. Process. Syst. , vol. 33, 2020, pp. 15 173–15 184
2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
L. Mescheder, A. Geiger, and S. Nowozin, “Which Training Methods for GANs do actually Converge?” in Int. Conf. Mach. Learn. , vol. 80, 2018, pp. 3481–3490
2018
Cited alongside, same era.
T. Karras, T. Aila, S. Laine, and J. Lehtinen, “Progressive growing of gans for improved quality, stability, and variation,” in Int. Conf. Learn. Represent. , 2018
2018
Cited alongside, same era.
G. I. Parisi, R. Kemker, J. L. Part, C. Kanan, and S. Wermter, “Continual Lifelong Learning with Neural Networks: A Review,” Neural Networks , vol. 113, pp. 54–71, 2019
2019
Cited alongside, same era.
G. M. van de Ven and A. S. Tolias, “Three scenarios for continual learning,” arXiv preprint:1904.07734 , 2019
2019
Cited alongside, same era.
S. Hou, X. Pan, C. C. Loy, Z. Wang, and D. Lin, “Learning a Unified Classifier Incrementally via Rebalancing,” in IEEE Conf. Comput. Vis. Pattern Recog. , 2019, pp. 831–839
2019
Cited alongside, same era.
Y. Wu, Y. Chen, L. Wang, Y. Ye, Z. Liu, Y. Guo, and Y. Fu, “Large Scale Incremental Learning,” in IEEE Conf. Comput. Vis. Pattern Recog. , 2019, pp. 374–382
2019
Cited alongside, same era.
O. Ostapenko, M. Puscas, T. Klein, P. Jähnichen, and M. Nabi, “Learning to Remember: A Synaptic Plasticity Driven Framework for Continual Learning,” in IEEE Conf. Comput. Vis. Pattern Recog. , 2019, pp. 11 321–11 329
2019
Cited alongside, same era.
T. Lesort, “Continual Learning: Tackling Catastrophic Forgetting in Deep Neural Networks with Replay Processes,” arXiv preprint:2007.00487 , 2020
2020
Later among the works it cites.
T. Karras, M. Aittala, J. Hellsten, S. Laine, J. Lehtinen, and T. Aila, “Training Generative Adversarial Networks with Limited Data,” in Adv. Neural Inform. Process. Syst. , vol. 33, 2020, pp. 12 104–12 114. [Online]. Available: https://github.com/NVlabs/stylegan2-ada
2020
Later among the works it cites.
Z. Zhao, Z. Zhang, T. Chen, S. Singh, and H. Zhang, “Image Augmentations for GAN Training,” arXiv preprint:2006.02595 , 2020
2020
Later among the works it cites.
L. Liu, G. Tech, P. He, W. Chen, X. Liu, J. Gao, and J. Han, “On the Variance of the Adaptive Learning Rate and Beyond,” in Int. Conf. Learn. Represent. , 2020. [Online]. Available: https://github.com/LiyuanLucasLiu/RAdam
2020
Later among the works it cites.
T. Karras, S. Laine, M. Aittala, J. Hellsten, J. Lehtinen, and T. Aila, “Analyzing and Improving the Image Quality of StyleGAN,” in IEEE Conf. Comput. Vis. Pattern Recog. , 2020, pp. 8110–8119
2020
Later among the works it cites.
E. Belouadah, A. Popescu, and I. Kanellos, “A Comprehensive Study of Class Incremental Learning Algorithms for Visual Tasks,” Neural Networks , vol. 135, pp. 38–54, 2021
2021
Closest in time.
F. Zhu, X.-Y. Zhang, C. Wang, F. Yin, and C.-L. Liu, “Prototype augmentation and self-supervision for incremental learning,” in IEEE Conf. Comput. Vis. Pattern Recog. , 2021, pp. 5871–5880
2021
Closest in time.
J. Smith, Y.-C. Hsu, J. Balloch, Y. Shen, H. Jin, and Z. Kira, “Always be dreaming: A new approach for data-free class-incremental learning,” in Int. Conf. Comput. Vis. , 2021, pp. 9374–9384
2021
Closest in time.
G. Shen, S. Zhang, X. Chen, and Z.-H. Deng, “Generative feature replay with orthogonal weight modification for continual learning,” in Int. Joint Conf. Neur. Net. , 2021, pp. 1–8
2021
Closest in time.
B. Cui, G. Hu, and S. Yu, “Deepcollaboration: Collaborative generative and discriminative models for class incremental learning,” AAAI Conf. Art. Intell. , vol. 35, no. 2, pp. 1175–1183, 2021
2021
Closest in time.
N.-T. Tran, V.-H. Tran, N.-B. Nguyen, T.-K. Nguyen, and N.-M. Cheung, “On Data Augmentation for GAN Training,” IEEE Trans. Image Process. , vol. 30, pp. 1882–1897, 2021
2021
Closest in time.
V. K. Verma, K. J. Liang, N. Mehta, P. Rai, and L. Carin, “Efficient feature transformations for discriminative and generative continual learning,” in IEEE Conf. Comput. Vis. Pattern Recog. , 2021, pp. 13 865–13 875
2021
Closest in time.
M. De Lange, R. Aljundi, M. Masana, S. Parisot, X. Jia, A. Leonardis, G. Slabaugh, and T. Tuytelaars, “A continual learning survey: Defying forgetting in classification tasks,” IEEE Trans. Pattern Anal. Mach. Intell. , vol. 44, no. 7, pp. 3366–3385, 2022
2022
Closest in time.
M. Masana, X. Liu, B. Twardowski, M. Menta, A. D. Bagdanov, and J. van de Weijer, “Class-incremental learning: survey and performance evaluation on image classification,” IEEE Trans. Pattern Anal. Mach. Intell. , pp. 1–20, 2022. [Online]. Available: https://github.com/mmasana/FACIL
2022
Closest in time.
M. Toldo and M. Ozay, “Bring evanescent representations to life in lifelong class incremental learning,” in IEEE Conf. Comput. Vis. Pattern Recog. , 2022, pp. 16 732–16 741
2022
Closest in time.