Fetching the paper…
Reading the bibliography…
In continual learning, catastrophic forgetting is affected by multiple aspects of the tasks.
Invariance hypothesis and higher correlations of hamiltonian matrix elements
Nazakat Ullah · 1964
Earlier work this paper cites.
Random-matrix physics: spectrum and strength fluctuations
Tómas A Brody, Jorge Flores, J Bruce French, PA Mello, A Pandey, and Samuel SM Wong · 1981
Earlier work this paper cites.
Continuous univariate distributions, volume 2 , volume 289
Norman L Johnson, Samuel Kotz, and Narayanaswamy Balakrishnan · 1995
Earlier work this paper cites.
The mnist database of handwritten digits
Yann LeCun · 1998
Earlier work this paper cites.
Integrals of monomials over the orthogonal group
Thomas Gorin · 2002
Earlier work this paper cites.
An empirical investigation of catastrophic forgetting in gradient-based neural networks
Ian J Goodfellow, Mehdi Mirza, Da Xiao, Aaron Courville, and Yoshua Bengio · 2013
Earlier work this paper cites.
Paved with good intentions: analysis of a randomized block kaczmarz method
Deanna Needell and Joel A Tropp · 2014
Earlier work this paper cites.
Emnist: Extending mnist to handwritten letters
Gregory Cohen, Saeed Afshar, Jonathan Tapson, and Andre Van Schaik · 2017
Earlier work this paper cites.
Overcoming catastrophic forgetting in neural networks
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, et al · 2017
Earlier work this paper cites.
Continual learning through synaptic intelligence
Friedemann Zenke, Ben Poole, and Surya Ganguli · 2017
Earlier work this paper cites.
Towards Robust Evaluations of Continual Learning
Sebastian Farquhar and Yarin Gal · 2018
Earlier work this paper cites.
Characterizing implicit bias in terms of optimization geometry
Suriya Gunasekar, Jason Lee, Daniel Soudry, and Nathan Srebro · 2018
Cited alongside, same era.
Neural tangent kernel: Convergence and generalization in neural networks
Arthur Jacot, Franck Gabriel, and Clément Hongler · 2018
Cited alongside, same era.
High-dimensional probability: An introduction with applications in data science , volume 47
Roman Vershynin · 2018
Cited alongside, same era.
Learn to grow: A continual structure learning framework for overcoming catastrophic forgetting
Xilai Li, Yingbo Zhou, Tianfu Wu, Richard Socher, and Caiming Xiong · 2019
Cited alongside, same era.
A comprehensive, application-oriented study of catastrophic forgetting in dnns
Benedikt Pfülb and Alexander Gepperth · 2019
Cited alongside, same era.
Surprises in high-dimensional ridgeless least squares interpolation
Trevor Hastie, Andrea Montanari, Saharon Rosset, and Ryan J Tibshirani · 2022
Later among the works it cites.
Provable continual learning via sketched jacobian approximations
Reinhard Heckel · 2022
Later among the works it cites.
A theoretical study on solving continual learning
Gyuhak Kim, Changnan Xiao, Tatsuya Konishi, Zixuan Ke, and Bing Liu · 2022
Later among the works it cites.
Wide neural networks forget less catastrophically
Seyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin, Huiyi Hu, Razvan Pascanu, Dilan Gorur, and Mehrdad Farajtabar · 2022
Later among the works it cites.
Continual learning in linear classification on separable data
Itay Evron, Edward Moroshko, Gon Buzaglo, Maroun Khriesh, Badea Marjieh, Nathan Srebro, and Daniel Soudry · 2023
Later among the works it cites.
Analysis of catastrophic forgetting for random orthogonal transformation tasks in the overparameterized regime
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Mehdi Abbana Bennani, Thang Doan, and Masashi Sugiyama · 2020
Cited alongside, same era.
Anatomy of catastrophic forgetting: Hidden representations and task semantics
Vinay V Ramasesh, Ethan Dyer, and Maithra Raghu · 2020
Cited alongside, same era.
A continual learning survey: Defying forgetting in classification tasks
Matthias De Lange, Rahaf Aljundi, Marc Masana, Sarah Parisot, Xu Jia, Aleš Leonardis, Gregory Slabaugh, and Tinne Tuytelaars · 2021
Cited alongside, same era.
A theoretical analysis of catastrophic forgetting through the ntk overlap matrix
Thang Doan, Mehdi Abbana Bennani, Bogdan Mazoure, Guillaume Rabusseau, and Pierre Alquier · 2021
Cited alongside, same era.
Continual learning in the teacher-student setup: Impact of task similarity
Sebastian Lee, Sebastian Goldt, and Andrew Saxe · 2021
Cited alongside, same era.
How catastrophic can catastrophic forgetting be in linear regression?
Itay Evron, Edward Moroshko, Rachel Ward, Nathan Srebro, and Daniel Soudry · 2022
Cited alongside, same era.
Daniel Goldfarb and Paul Hand · 2023
Later among the works it cites.
Nearly optimal bounds for cyclic forgetting
Mark Kong, William Swartworth, Halyun Jeong, Deanna Needell, and Rachel Ward · 2023
Later among the works it cites.
Fixed design analysis of regularization-based continual learning
Haoran Li, Jingfeng Wu, and Vladimir Braverman · 2023
Later among the works it cites.
Theory on forgetting and generalization of continual learning
Sen Lin, Peizhong Ju, Yingbin Liang, and Ness Shroff · 2023
Later among the works it cites.
On the disconnect between theory and practice of overparametrized neural networks
Jonathan Wenger, Felix Dangel, and Agustinus Kristiadi · 2023
Later among the works it cites.