Fetching the paper…
Reading the bibliography…
Continual lifelong learning requires an agent or model to learn many sequentially ordered tasks, building on previous knowledge without catastrophically forgetting it.
Henry B Mann and Donald R Whitney, ‘On a test of whether one of two random variables is stochastically larger than the other’, The annals of mathematical statistics
1947
Earlier work this paper cites.
Evelyn Fix and Joseph L Hodges Jr, ‘Discriminatory analysis-nonparametric discrimination: consistency properties’, Technical report, California Univ Berkeley, (1951)
1951
Earlier work this paper cites.
Mark F Bear and Wolf Singer, ‘Modulation of visual cortical plasticity by acetylcholine and noradrenaline’, Nature
1986
Earlier work this paper cites.
Robert M French, ‘Using semi-distributed representations to overcome catastrophic forgetting in connectionist networks’, in Proceedings of the 13th annual cognitive science society conference
1991
Earlier work this paper cites.
Michael E Hasselmo and Edi Barkai, ‘Cholinergic modulation of activity-dependent synaptic plasticity in the piriform cortex and associative memory function in a network biophysical simulation’, Journal of Neuroscience
1995
Earlier work this paper cites.
Yann LeCun, Léon Bottou, Yoshua Bengio, Patrick Haffner, et al., ‘Gradient-based learning applied to document recognition’, Proceedings of the IEEE
1998
Earlier work this paper cites.
Robert M French, ‘Catastrophic forgetting in connectionist networks’, Trends in cognitive sciences
1999
Earlier work this paper cites.
Sepp Hochreiter, A Steven Younger, and Peter R Conwell, ‘Learning to learn using gradient descent’, in International Conference on Artificial Neural Networks
2001
Earlier work this paper cites.
Akio Ishiguro, Akinobu Fujii, and Peter Eggenberger Hotz, ‘Neuromodulated control of bipedal locomotion using a polymorphic cpg circuit’, Adaptive Behavior
2003
Earlier work this paper cites.
Laurens van der Maaten and Geoffrey Hinton, ‘Visualizing data using t-sne’, Journal of machine learning research
2008
Earlier work this paper cites.
Andrea Soltoggio, John A Bullinaria, Claudio Mattiussi, Peter Dürr, and Dario Floreano, ‘Evolutionary advantages of neuromodulated plasticity in dynamic, reward-based scenarios’, in Proceedings of the 11th international conference on artificial life (Alife XI)
2008
Earlier work this paper cites.
Kenneth O Stanley, David B D’Ambrosio, and Jason Gauci, ‘A hypercube-based encoding for evolving large-scale neural networks’, Artificial life
2009
Earlier work this paper cites.
Dan Ciregan, Ueli Meier, and Jürgen Schmidhuber, ‘Multi-column deep neural networks for image classification’, in 2012 IEEE conference on computer vision and pattern recognition
2012
Earlier work this paper cites.
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton, ‘Imagenet classification with deep convolutional neural networks’, in Advances in neural information processing systems
2012
Earlier work this paper cites.
Yoshua Bengio, ‘Deep learning of representations: Looking forward’, in International Conference on Statistical Language and Speech Processing
2013
Earlier work this paper cites.
2014
Earlier work this paper cites.
Jason Yosinski, Jeff Clune, Yoshua Bengio, and Hod Lipson, ‘How transferable are features in deep neural networks?’, in Advances in neural information processing systems
2014
Cited alongside, same era.
2015
Cited alongside, same era.
Kai Olav Ellefsen, Jean-Baptiste Mouret, and Jeff Clune, ‘Neural modularity helps organisms evolve to learn new skills without forgetting old skills’, PLoS computational biology
2015
Cited alongside, same era.
2015
Cited alongside, same era.
2017
Later among the works it cites.
Roby Velez and Jeff Clune, ‘Diffusion-based neuromodulation can eliminate catastrophic forgetting in simple neural networks’, PloS one
2017
Later among the works it cites.
Friedemann Zenke, Ben Poole, and Surya Ganguli, ‘Continual learning through synaptic intelligence’, in Proceedings of the 34th International Conference on Machine Learning-Volume 70
2017
Later among the works it cites.
2018
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Brenden M Lake, Ruslan Salakhutdinov, and Joshua B Tenenbaum, ‘Human-level concept learning through probabilistic program induction’, Science
2015
Cited alongside, same era.
Dougal Maclaurin, David Duvenaud, and Ryan Adams, ‘Gradient-based hyperparameter optimization through reversible learning’, in International Conference on Machine Learning
2015
Cited alongside, same era.
2015
Cited alongside, same era.
2016
Cited alongside, same era.
2016
Cited alongside, same era.
2016
Cited alongside, same era.
2016
Cited alongside, same era.
2017
Cited alongside, same era.
Xialei Liu, Marc Masana, Luis Herranz, Joost Van de Weijer, Antonio M Lopez, and Andrew D Bagdanov, ‘Rotate your networks: Better weight consolidation and less catastrophic forgetting’, in 2018 24th International Conference on Pattern Recognition (ICPR)
2018
Later among the works it cites.
Nicolas Y. Masse, Gregory D. Grant, and David J. Freedman, ‘Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilization’, Proceedings of the National Academy of Sciences
2018
Later among the works it cites.
2018
Later among the works it cites.
Thomas Miconi, Aditya Rawal, Jeff Clune, and Kenneth O Stanley, ‘Backpropamine: training self-modifying neural networks with differentiable neuromodulated plasticity’, (2018)
2018
Later among the works it cites.
2018
Later among the works it cites.
Andrea Soltoggio, Kenneth O Stanley, and Sebastian Risi, ‘Born to learn: the inspiration, progress, and future of evolved plastic artificial neural networks’, Neural Networks
2018
Later among the works it cites.
Jianming Zhang, Sarah Adel Bargal, Zhe Lin, Jonathan Brandt, Xiaohui Shen, and Stan Sclaroff, ‘Top-down neural attention by excitation backprop’, International Journal of Computer Vision
2018
Later among the works it cites.
2019
Later among the works it cites.
Khurram Javed and Martha White, ‘Meta-learning representations for continual learning’, Neural Information Processing Systems
2019
Later among the works it cites.
Soheil Kolouri, Nicholas Ketz, Xinyun Zou, Jeffrey Krichmar, and Praveen Pilly, ‘Attention-based selective plasticity’, (2019)
2019
Later among the works it cites.
Davide Maltoni and Vincenzo Lomonaco, ‘Continuous learning in single-incremental-task scenarios’, Neural Networks
2019
Later among the works it cites.