Fetching the paper…
Reading the bibliography…
Neural networks are universal function approximators which are known to generalize well despite being dramatically overparameterized.
Multilayer feedforward networks are universal approximators
Kurt Hornik, Maxwell Stinchcombe, and Halbert White · 1989
Earlier work this paper cites.
Eigenvalues, invariant factors, highest weights, and schubert calculus
William Fulton · 2000
Earlier work this paper cites.
The finite element method for elliptic problems
Philippe G Ciarlet · 2002
Earlier work this paper cites.
Eigenvalues of several tridiagonal matrices
Wen-Chyuan Yueh · 2005
Earlier work this paper cites.
Model selection in kernel methods based on a spectral analysis of label information
Mikio L Braun, Tilman Lange, and Joachim M Buhmann · 2006
Earlier work this paper cites.
Kernel methods in machine learning
Thomas Hofmann, Bernhard Schölkopf, and Alexander J Smola · 2008
Earlier work this paper cites.
Rectified linear units improve restricted boltzmann machines
Vinod Nair and Geoffrey E Hinton · 2010
Earlier work this paper cites.
Reproducing kernel Hilbert spaces in probability and statistics
Alain Berlinet and Christine Thomas-Agnan · 2011
Earlier work this paper cites.
Positive definite kernels: past, present and future
Gregory E Fasshauer · 2011
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P Kingma and Jimmy Ba · 2014
Earlier work this paper cites.
Multistability and instability of competitive neural networks with mexican-hat-type activation functions
Xiaobing Nie, Jinde Cao, and Shumin Fei · 2014
Earlier work this paper cites.
A closer look at memorization in deep networks
Devansh Arpit, Stanislaw Jastrzebski, Nicolas Ballas, David Krueger, Emmanuel Bengio, Maxinder S Kanwal, Tegan Maharaj, Asja Fischer, Aaron Courville, Yoshua Bengio, et al · 2017
Earlier work this paper cites.
Solving high-dimensional partial differential equations using deep learning
Jiequn Han, Arnulf Jentzen, and Weinan E · 2018
Earlier work this paper cites.
Neural tangent kernel: Convergence and generalization in neural networks
Arthur Jacot, Franck Gabriel, and Clément Hongler · 2018
Earlier work this paper cites.
Theory of deep learning iii: the non-overfitting puzzle
Tomaso Poggio, Kenji Kawaguchi, Qianli Liao, Brando Miranda, Lorenzo Rosasco, Xavier Boix, Jack Hidary, and Hrushikesh Mhaskar · 2018
Cited alongside, same era.
The implicit bias of gradient descent on separable data
Daniel Soudry, Elad Hoffer, Mor Shpigel Nacson, Suriya Gunasekar, and Nathan Srebro · 2018
Cited alongside, same era.
Understanding training and generalization in deep learning by fourier analysis
Zhiqin John Xu · 2018
Cited alongside, same era.
Multi-scale deep neural networks for solving high dimensional pdes
Wei Cai and Zhi-Qin John Xu · 2019
Cited alongside, same era.
Pathological spectra of the fisher information metric and its variants in deep neural networks
Ryo Karakida, Shotaro Akaho, and Shun-ichi Amari · 2019
Spatial frequency bias in convolutional generative adversarial networks
Mahyar Khayatkhoei and Ahmed Elgammal · 2020
Later among the works it cites.
Neural spectrum alignment: Empirical study
Dmitry Kopitkov and Vadim Indelman · 2020
Later among the works it cites.
Gradient descent with early stopping is provably robust to label noise for overparameterized neural networks
Mingchen Li, Mahdi Soltanolkotabi, and Samet Oymak · 2020
Later among the works it cites.
On the exact computation of linear frequency principle dynamics and its generalization
Tao Luo, Zheng Ma, Zhi-Qin John Xu, and Yaoyu Zhang · 2020
Later among the works it cites.
Implicit neural representations with periodic activation functions
Vincent Sitzmann, Julien Martel, Alexander Bergman, David Lindell, and Gordon Wetzstein · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
On the spectral bias of neural networks
Nasim Rahaman, Aristide Baratin, Devansh Arpit, Felix Draxler, Min Lin, Fred Hamprecht, Yoshua Bengio, and Aaron Courville · 2019
Cited alongside, same era.
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
Maziar Raissi, Paris Perdikaris, and George E Karniadakis · 2019
Cited alongside, same era.
Frequency principle: Fourier analysis sheds light on deep neural networks
Z.-Q. J. Xu, Y. Zhang, T. Luo, Y. Xiao, and Z. Ma · 2019
Cited alongside, same era.
A fine-grained spectral perspective on neural networks
Greg Yang and Hadi Salman · 2019
Cited alongside, same era.
Frequency bias in neural networks for input of non-uniform density
Ronen Basri, Meirav Galun, Amnon Geifman, David Jacobs, Yoni Kasten, and Shira Kritchman · 2020
Cited alongside, same era.
Frequency-aware reconstruction of fluid simulations with generative networks
Simon Biland, Vinicius C Azevedo, Byungsoo Kim, and Barbara Solenthaler · 2020
Cited alongside, same era.
A phase shift deep neural network for high frequency approximation and wave problems
Wei Cai, Xiaoguang Li, and Lizuo Liu · 2020
Cited alongside, same era.
Spectral bias and task-model alignment explain generalization in kernel regression and infinitely wide neural networks
Abdulkadir Canatar, Blake Bordelon, and Cengiz Pehlevan · 2021
Later among the works it cites.
Towards understanding the spectral bias of deep learning
Yuan Cao, Zhiying Fang, Yue Wu, Ding-Xuan Zhou, and Quanquan Gu · 2021
Later among the works it cites.
Spectral bias in practice: The role of function frequency in generalization
Sara Fridovich-Keil, Raphael Gontijo-Lopes, and Rebecca Roelofs · 2021
Later among the works it cites.
Frequency principle in deep learning beyond gradient-descent-based training
Yuheng Ma, Zhi-Qin John Xu, and Jiwei Zhang · 2021
Later among the works it cites.
Understanding deep learning (still) requires rethinking generalization
Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, and Oriol Vinyals · 2021
Later among the works it cites.
Rethink the connections among generalization, memorization and the spectral bias of dnns
Xiao Zhang, Haoyi Xiong, and Dongrui Wu · 2021
Later among the works it cites.
Cnns with compact activation function
Jindong Wang, Jinchao Xu, and Jianqing Zhu · 2022
Closest in time.
Overview frequency principle/spectral bias in deep learning
Zhi-Qin John Xu, Yaoyu Zhang, and Tao Luo · 2022
Closest in time.