Fetching the paper…
Reading the bibliography…
Along with fruitful applications of Deep Neural Networks (DNNs) to realistic problems, recently, some empirical studies of DNNs reported a universal phenomenon of Frequency Principle (F-Principle): a DNN tends to learn a target function from low to high frequencies during the training.
Explicitizing an Implicit Bias of the Frequency Principle in Two-layer Neural Networks
Zhang, Y., Xu, Z.-Q. J., Luo, T., and Ma, Z · 1905
Earlier work this paper cites.
Approximation by superpositions of a sigmoidal function
Cybenko, G · 1989
Earlier work this paper cites.
Multimodal deep learning for robust rgb-d object recognition
Eitel, A., Springenberg, J. T., Spinello, L., Riedmiller, M., and Burgard, W · 2015
Earlier work this paper cites.
Deep learning
LeCun, Y., Bengio, Y., and Hinton, G · 2015
Earlier work this paper cites.
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al · 2015
Earlier work this paper cites.
Deep speech 2: End-to-end speech recognition in english and mandarin
Amodei, D., Ananthanarayanan, S., Anubhai, R., Bai, J., Battenberg, E., Case, C., Casper, J., Catanzaro, B., Cheng, Q., Chen, G., et al · 2016
Earlier work this paper cites.
Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
E, W., Han, J., and Jentzen, A · 2017
Earlier work this paper cites.
Solving parametric pde problems with artificial neural networks
Khoo, Y., Lu, J., and Ying, L · 2017
Cited alongside, same era.
A multiscale neural network based on hierarchical matrices
Fan, Y., Lin, L., Ying, L., and Zepeda-Núnez, L · 2018
Cited alongside, same era.
Relu deep neural networks and linear finite elements
He, J., Li, L., Xu, J., and Zheng, C · 2018
Cited alongside, same era.
A mean field view of the landscape of two-layer neural networks
Mei, S., Montanari, A., and Nguyen, P.-M · 2018
Cited alongside, same era.
On the spectral bias of deep neural networks
Rahaman, N., Arpit, D., Baratin, A., Draxler, F., Lin, M., Hamprecht, F. A., Bengio, Y., and Courville, A · 2018
Training behavior of deep neural network in frequency domain
Xu, Z.-Q. J., Zhang, Y., and Xiao, Y · 2018
Later among the works it cites.
Recent trends in deep learning based natural language processing
Young, T., Hazarika, D., Poria, S., and Cambria, E · 2018
Later among the works it cites.
Nonlinear collaborative scheme for deep neural networks
Zhen, H.-L., Lin, X., Tang, A. Z., Li, Z., Zhang, Q., and Kwong, S · 2018
Later among the works it cites.
Phasednn-a parallel phase shift deep neural network for adaptive wideband learning
Cai, W., Li, X., and Liu, L · 2019
Closest in time.
Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Parameters as interacting particles: long time convergence and asymptotic error scaling of neural networks
Rotskoff, G. and Vanden-Eijnden, E · 2018
Cited alongside, same era.
Mean field analysis of neural networks: A central limit theorem
Sirignano, J. and Spiliopoulos, K · 2018
Cited alongside, same era.
Understanding training and generalization in deep learning by fourier analysis
Xu, Z. J
Cited in the paper.
Frequency principle in deep learning with general loss functions and its potential application
Xu, Z.-Q. J
Cited in the paper.
Jagtap, A. D. and Karniadakis, G. E · 2019
Closest in time.
Meta-learners’ learning dynamics are unlike learners’
Rabinowitz, N. C · 2019
Closest in time.
Frequency principle: Fourier analysis sheds light on deep neural networks
Xu, Z.-Q. J., Zhang, Y., Luo, T., Xiao, Y., and Ma, Z · 2019
Closest in time.