Fetching the paper…
Reading the bibliography…
Artificial neural networks (ANNs) suffer from catastrophic forgetting when trained on a sequence of tasks.
“Catastrophic interference in connectionist networks: The sequential learning problem,”
Michael McCloskey and Neal J Cohen, · 1989
Earlier work this paper cites.
“Connectionist models of recognition memory: constraints imposed by learning and forgetting functions.,”
Roger Ratcliff, · 1990
Earlier work this paper cites.
“Catastrophic interference is eliminated in pretrained networks,”
McRae K Hetherington, · 1993
Earlier work this paper cites.
“Consolidation in neural networks and in the sleeping brain,”
Anthony Robins, · 1996
Earlier work this paper cites.
“Catastrophic forgetting in connectionist networks,”
Robert M French, · 1999
Earlier work this paper cites.
“Reassessment of catastrophic interference,”
Makoto Yamaguchi, · 2004
Earlier work this paper cites.
“MNIST handwritten digit database,”
Yann LeCun and Corinna Cortes, · 2010
Cited alongside, same era.
“An empirical investigation of catastrophic forgetting in gradient-based neural networks,”
Ian J Goodfellow, Mehdi Mirza, Da Xiao, Aaron Courville, and Yoshua Bengio, · 2013
Cited alongside, same era.
“A survey of transfer learning,”
Karl Weiss, Taghi M Khoshgoftaar, and DingDing Wang, · 2016
Cited alongside, same era.
“Overcoming catastrophic forgetting in neural networks,”
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, et al., · 2017
Cited alongside, same era.
“Continual learning through synaptic intelligence,”
Friedemann Zenke, Ben Poole, and Surya Ganguli, · 2017
Cited alongside, same era.
“Continual learning with deep generative replay,”
“Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms,” 2017
Han Xiao, Kashif Rasul, and Roland Vollgraf, · 2017
Later among the works it cites.
“Variational continual learning,”
Cuong V. Nguyen, Yingzhen Li, Thang D. Bui, and Richard E. Turner, · 2018
Later among the works it cites.
“Re-evaluating continual learning scenarios: A categorization and case for strong baselines,”
Yen-Chang Hsu, Yen-Cheng Liu, and Zsolt Kira, · 2018
Later among the works it cites.
“Generative replay with feedback connections as a general strategy for continual learning,”
Michiel van der Ven and Andreas S. Tolias, · 2018
Later among the works it cites.
“Towards robust evaluations of continual learning,”
Sebastian Farquhar and Yarin Gal, · 2018
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Hanul Shin, Jung Kwon Lee, Jaehong Kim, and Jiwon Kim, · 2017
Cited alongside, same era.