Fetching the paper…
Reading the bibliography…
A human brain is capable of continual learning by nature; however the current mainstream deep neural networks suffer from a phenomenon named catastrophic forgetting (i.e., learning a new set of patterns suddenly and completely would result in fully forgetting what has already been learned).
A. R. Luria, “The functional organization of the brain,” Scientific American
1970
Earlier work this paper cites.
E. Tulving et al
1972
Earlier work this paper cites.
E. Tulving and D. M. Thomson, “Encoding specificity and retrieval processes in episodic memory.,” Psychological review
1973
Earlier work this paper cites.
M. McCloskey and N. J. Cohen, “Catastrophic interference in connectionist networks: The sequential learning problem,” in Psychology of learning and motivation
1989
Earlier work this paper cites.
M. S. Gazzaniga, “Organization of the human brain,” Science
1989
Earlier work this paper cites.
R. Ratcliff, “Connectionist models of recognition memory: constraints imposed by learning and forgetting functions.,” Psychological review
1990
Earlier work this paper cites.
S. Zeki, J. Watson, C. Lueck, K. J. Friston, C. Kennard, and R. Frackowiak, “A direct demonstration of functional specialization in human visual cortex,” Journal of neuroscience
1991
Earlier work this paper cites.
C. J. Watkins and P. Dayan, “Q-learning,” Machine learning
1992
Earlier work this paper cites.
M. Bar and S. Ullman, “Spatial context in recognition,” Perception
1996
Earlier work this paper cites.
S.-I. Amari, “Natural gradient works efficiently in learning,” Neural computation
1998
Earlier work this paper cites.
MIT press Cambridge, 1998
R. S. Sutton and A. G. Barto, Introduction to reinforcement learning · 1998
Earlier work this paper cites.
Princeton University Press, 1999
N. E. Steenrod, The topology of fibre bundles · 1999
Earlier work this paper cites.
D. M. SNODDERLY, I. Kagan, and M. Gur, “Selective activation of visual cortex neurons by fixational eye movements: implications for neural coding,” Visual neuroscience
2001
Earlier work this paper cites.
M. H. Johnson, “Functional brain development in humans,” Nature Reviews Neuroscience
2001
Cited alongside, same era.
M. Bar, “Visual objects in context,” Nature Reviews Neuroscience
2004
Cited alongside, same era.
M. Bar, “The proactive brain: using analogies and associations to generate predictions,” Trends in cognitive sciences
2007
Cited alongside, same era.
S. J. Pan, Q. Yang, et al
2010
Cited alongside, same era.
F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay, “Scikit-learn: Machine learning in Python,” Journal of Machine Learning Research
2011
Cited alongside, same era.
2015
Later among the works it cites.
A. Santoro, S. Bartunov, M. Botvinick, D. Wierstra, and T. Lillicrap, “Meta-learning with memory-augmented neural networks,” in International conference on machine learning
2016
Later among the works it cites.
A. Holtmaat and P. Caroni, “Functional and structural underpinnings of neuronal assembly formation in learning,” Nature Neuroscience
2016
Later among the works it cites.
T. Rowland, “Fiber bundle,” From MathWorld—A Wolfram Web Resource. URL http://mathworld. wolfram. com/FiberBundle. html. Last visited on
2016
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
M. Mermillod, A. Bugaiska, and P. Bonin, “The stability-plasticity dilemma: Investigating the continuum from catastrophic forgetting to age-limited learning effects,” Frontiers in psychology
2013
Cited alongside, same era.
2013
Cited alongside, same era.
D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980
2014
Cited alongside, same era.
A. Hayashi-Takagi, S. Yagishita, M. Nakamura, F. Shirai, Y. I. Wu, A. L. Loshbaugh, B. Kuhlman, K. M. Hahn, and H. Kasai, “Labelling and optical erasure of synaptic memory traces in the motor cortex,” Nature
2015
Cited alongside, same era.
J. Cichon and W.-B. Gan, “Branch-specific dendritic ca2+ spikes cause persistent synaptic plasticity,” Nature
2015
Cited alongside, same era.
V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, M. Riedmiller, A. K. Fidjeland, G. Ostrovski, et al
2015
Cited alongside, same era.
I. Diez, P. Bonifazi, I. Escudero, B. Mateos, M. A. Muñoz, S. Stramaglia, and J. M. Cortes, “A novel brain partition highlights the modular skeleton shared by structure and function,” Scientific reports
2015
Cited alongside, same era.
2016
Later among the works it cites.
J. L. Ba, J. R. Kiros, and G. E. Hinton, “Layer normalization,” arXiv preprint arXiv:1607.06450
2016
Later among the works it cites.
H. Shin, J. K. Lee, J. Kim, and J. Kim, “Continual learning with deep generative replay,” in Advances in Neural Information Processing Systems
2017
Later among the works it cites.
J. Kirkpatrick, R. Pascanu, N. Rabinowitz, J. Veness, G. Desjardins, A. A. Rusu, K. Milan, J. Quan, T. Ramalho, A. Grabska-Barwinska, et al
2017
Later among the works it cites.
J. Snell, K. Swersky, and R. Zemel, “Prototypical networks for few-shot learning,” in Advances in Neural Information Processing Systems
2017
Later among the works it cites.
2017
Later among the works it cites.
A. Paszke, S. Gross, S. Chintala, G. Chanan, E. Yang, Z. DeVito, Z. Lin, A. Desmaison, L. Antiga, and A. Lerer, “Automatic differentiation in pytorch,” 2017
2017
Later among the works it cites.
2018
Later among the works it cites.
C. F. Starmer, “About education: Fundamental concepts of forgetting and learning,” URL https://itlab.us/forgetting Last visited on 2019-2-16
2019
Closest in time.