Fetching the paper…
Reading the bibliography…
Understanding the effect of depth in deep learning is a critical problem.
A type of generalization error induced by initialization in deep neural networks
Yaoyu Zhang, Zhi-Qin John Xu, Tao Luo, and Zheng Ma · 2007
Earlier work this paper cites.
Exact solutions to the nonlinear dynamics of learning in deep linear neural network
Andrew M Saxe, James L Mcclelland, and Surya Ganguli · 2014
Earlier work this paper cites.
The power of depth for feedforward neural networks
Ronen Eldan and Ohad Shamir · 2016
Earlier work this paper cites.
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Earlier work this paper cites.
benefits of depth in neural networks
Matus Telgarsky · 2016
Earlier work this paper cites.
A closer look at memorization in deep networks
Devansh Arpit, Stanislaw Jastrzebski, Nicolas Ballas, David Krueger, Emmanuel Bengio, Maxinder S Kanwal, Tegan Maharaj, Asja Fischer, Aaron Courville, Yoshua Bengio, et al · 2017
Earlier work this paper cites.
On the optimization of deep networks: Implicit acceleration by overparameterization
Sanjeev Arora, N Cohen, and Elad Hazan · 2018
Earlier work this paper cites.
Exponential convergence of the deep neural network approximationfor analytic functions
Weinan E and Wang Qingcan · 2018
Earlier work this paper cites.
Neural tangent kernel: Convergence and generalization in neural networks
Arthur Jacot, Franck Gabriel, and Clément Hongler · 2018
Earlier work this paper cites.
Deep learning generalizes because the parameter-function map is biased towards simple functions
Guillermo Valle-Perez, Chico Q Camargo, and Ard A Louis · 2018
Earlier work this paper cites.
Understanding training and generalization in deep learning by fourier analysis
Zhiqin John Xu · 2018
Earlier work this paper cites.
On exact computation with an infinitely wide neural net
Sanjeev Arora, Simon S Du, Wei Hu, Zhiyuan Li, Ruslan Salakhutdinov, and Ruosong Wang · 2019
Earlier work this paper cites.
Frequency-aware reconstruction of fluid simulations with generative networks
Simon Biland, Vinicius C Azevedo, Byungsoo Kim, and Barbara Solenthaler · 2019
Cited alongside, same era.
A phase shift deep neural network for high frequency approximation and wave problems
Wei Cai, Xiaoguang Li, and Lizuo Liu · 2019
Cited alongside, same era.
Towards understanding the spectral bias of deep learning
Yuan Cao, Zhiying Fang, Yue Wu, Ding-Xuan Zhou, and Quanquan Gu · 2019
Cited alongside, same era.
The implicit bias of depth: How incremental learning drives generalization
Daniel Gissin, Shai Shalev-Shwartz, and Amit Daniely · 2019
Cited alongside, same era.
Sgd on neural networks learns functions of increasing complexity
Dimitris Kalimeris, Gal Kaplun, Preetum Nakkiran, Benjamin Edelman, Tristan Yang, Boaz Barak, and Haofeng Zhang · 2019
A fine-grained spectral perspective on neural networks
Greg Yang and Hadi Salman · 2019
Later among the works it cites.
Explicitizing an implicit bias of the frequency principle in two-layer neural networks
Yaoyu Zhang, Zhi-Qin John Xu, Tao Luo, and Zheng Ma · 2019
Later among the works it cites.
Suggested notation for machine learning
BAAI · 2020
Closest in time.
Spectrum dependent learning curves in kernel regression and wide neural networks
Blake Bordelon, Abdulkadir Canatar, and Cengiz Pehlevan · 2020
Closest in time.
Machine learning from a continuous viewpoint, i
Weinan E, Chao Ma, and Lei Wu · 2020
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Effect of depth and width on local minima in deep learning
Kenji Kawaguchi, Jiaoyang Huang, and Leslie Pack Kaelbling · 2019
Cited alongside, same era.
Theory of the frequency principle for general deep neural networks
Tao Luo, Zheng Ma, Zhi-Qin John Xu, and Yaoyu Zhang · 2019
Cited alongside, same era.
Neural networks are a priori biased towards boolean functions with low entropy
Chris Mingard, Joar Skalse, Guillermo Valle-Pérez, David Martínez-Rubio, Vladimir Mikulik, and Ard A Louis · 2019
Cited alongside, same era.
On the spectral bias of deep neural networks
Nasim Rahaman, Devansh Arpit, Aristide Baratin, Felix Draxler, Min Lin, Fred A Hamprecht, Yoshua Bengio, and Aaron Courville · 2019
Cited alongside, same era.
The convergence rate of neural networks for learned functions of different frequencies
Basri Ronen, David Jacobs, Yoni Kasten, and Shira Kritchman · 2019
Cited alongside, same era.
Yeonjong Shin · 2019
Cited alongside, same era.
Training behavior of deep neural network in frequency domain
Zhi-Qin J Xu, Yaoyu Zhang, and Yanyang Xiao · 2019
Cited alongside, same era.
Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
Ameya D Jagtap, Kenji Kawaguchi, and George Em Karniadakis · 2020
Closest in time.
A multi-scale dnn algorithm for nonlinear elliptic equations with multiple scales
Xi-An Li, Zhi-Qin John Xu, and Lei Zhang · 2020
Closest in time.
Multi-scale deep neural network (mscalednn) for solving poisson-boltzmann equation in complex domains
Ziqi Liu, Wei Cai, and Zhi-Qin John Xu · 2020
Closest in time.
Phase diagram for two-layer relu neural networks at infinite-width limit
Tao Luo, Zhi-Qin John Xu, Zheng Ma, and Yaoyu Zhang · 2020
Closest in time.
The slow deterioration of the generalization error of the random feature model
Chao Ma, Lei Wu, and Weinan E · 2020
Closest in time.
Multi-resolution convolutional neural networks for inverse problems
Feng Wang, Alberto Eljarrat, Johannes Müller, Trond R Henninen, Rolf Erni, and Christoph T Koch · 2020
Closest in time.
Frequency principle: Fourier analysis sheds light on deep neural networks
Zhi-Qin John Xu, Yaoyu Zhang, Tao Luo, Yanyang Xiao, and Zheng Ma · 2020
Closest in time.