Fetching the paper…
Reading the bibliography…
Understanding deep learning is increasingly emergent as it penetrates more and more into industry and science.
Dissanayake, M., Phan-Thien, N.: Neural-network-based approximations for solving partial differential equations. communications in Numerical Methods in Engineering 10
1994
Earlier work this paper cites.
Breiman, L.: Reflections after refereeing papers for nips. The Mathematics of Generalization XX
1995
Earlier work this paper cites.
Engel, A., Broeck, C.V.d.: Statistical Mechanics of Learning, (2001). Google-Books-ID: qVo4IT9ByfQC
2001
Earlier work this paper cites.
Dyson, F.: A meeting with Enrico Fermi. Nature 427
2004
Earlier work this paper cites.
Brenner, S.C., Scott, L.R.: The Mathematical Theory of Finite Element Methods. Springer, ??? (2008)
2008
Earlier work this paper cites.
Evans, L.C.: Partial differential equations (2010)
2010
Earlier work this paper cites.
Shen, J., Tang, T., Wang, L.L.: Spectral Methods. Algorithms, Analysis and Applications. Springer, ??? (2011)
2011
Earlier work this paper cites.
Saxe, A.M., McClelland, J.L., Ganguli, S.: Exact solutions to the nonlinear dynamics of learning in deep linear neural networks. In: The International Conference on Learning Representations (2014)
2014
Earlier work this paper cites.
2014
Earlier work this paper cites.
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings (2015)
2015
Earlier work this paper cites.
Choromanska, A., Henaff, M., Mathieu, M., Arous, G.B., LeCun, Y.: The loss surfaces of multilayer networks. In: Artificial Intelligence and Statistics, pp. 192–204 (2015)
2015
Earlier work this paper cites.
Lin, J., Camoriano, R., Rosasco, L.: Generalization properties and implicit regularization for multiple passes sgm. In: International Conference on Machine Learning, pp. 2340–2348 (2016). PMLR
2016
Earlier work this paper cites.
Zhang, C., Bengio, S., Hardt, M., Recht, B., Vinyals, O.: Understanding deep learning requires rethinking generalization. In: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. OpenReview.net, ??? (2017)
2017
Earlier work this paper cites.
Arpit, D., Jastrzębski, S., Ballas, N., Krueger, D., Bengio, E., Kanwal, M.S., Maharaj, T., Fischer, A., Courville, A., Bengio, Y., et al
2017
Earlier work this paper cites.
Xie, B., Liang, Y., Song, L.: Diverse neural network learns true target functions. In: Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, AISTATS 2017, 20-22 April 2017, Fort Lauderdale, FL, USA. Proceedings of Machine Learning Research, vol. 54, pp. 1216–1224. PMLR, ??? (2017)
2017
Earlier work this paper cites.
Shalev-Shwartz, S., Shamir, O., Shammah, S.: Failures of gradient-based deep learning. In: International Conference on Machine Learning, pp. 3067–3075 (2017). PMLR
2017
Earlier work this paper cites.
2017
Earlier work this paper cites.
E, W., Han, J., Jentzen, A.: Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations. Communications in Mathematics and Statistics 5
2017
Earlier work this paper cites.
Aubin, B., Maillard, A., barbier, j., Krzakala, F., Macris, N., Zdeborová, L.: The committee machine: Computational to statistical gaps in learning a two-layers neural network. In: Advances in Neural Information Processing Systems 31, pp. 3223–3234 (2018)
2018
Earlier work this paper cites.
Mei, S., Montanari, A., Nguyen, P.-M.: A mean field view of the landscape of two-layer neural networks. Proceedings of the National Academy of Sciences 115
2018
Earlier work this paper cites.
Rotskoff, G.M., Vanden-Eijnden, E.: Parameters as interacting particles: long time convergence and asymptotic error scaling of neural networks. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems, pp. 7146–7155 (2018)
2018
Earlier work this paper cites.
Chizat, L., Bach, F.: On the global convergence of gradient descent for over-parameterized models using optimal transport. Advances in Neural Information Processing Systems 31
2018
Earlier work this paper cites.
Jacot, A., Gabriel, F., Hongler, C.: Neural tangent kernel: convergence and generalization in neural networks. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems, pp. 8580–8589 (2018)
2018
Earlier work this paper cites.
2018
Earlier work this paper cites.
2018
Earlier work this paper cites.
2018
Earlier work this paper cites.
2018
Earlier work this paper cites.
Weinan, E., Ma, C., Wang, J.: Model reduction with memory and the machine learning of dynamical systems. Communications in Computational Physics 25
2018
Earlier work this paper cites.
Han, J., Zhang, L., Car, R., et al.: Deep potential: A general representation of a many-body potential energy surface. Communications in Computational Physics 23
2018
Earlier work this paper cites.
E, W., Yu, B.: The deep ritz method: A deep learning-based numerical algorithm for solving variational problems. Communications in Mathematics and Statistics 6
2018
Earlier work this paper cites.
Xu, Z.-Q.J., Zhang, Y., Xiao, Y.: Training behavior of deep neural network in frequency domain. International Conference on Neural Information Processing, 264–274 (2019). Springer
2019
Earlier work this paper cites.
Rahaman, N., Arpit, D., Baratin, A., Draxler, F., Lin, M., Hamprecht, F.A., Bengio, Y., Courville, A.: On the spectral bias of deep neural networks. International Conference on Machine Learning (2019)
2019
Earlier work this paper cites.
Jiang, Y., Neyshabur, B., Mobahi, H., Krishnan, D., Bengio, S.: Fantastic generalization measures and where to find them. In: International Conference on Learning Representations (2019)
2019
Earlier work this paper cites.
Saxe, A.M., Bansal, Y., Dapello, J., Advani, M., Kolchinsky, A., Tracey, B.D., Cox, D.D.: On the information bottleneck theory of deep learning. Journal of Statistical Mechanics: Theory and Experiment 2019
2019
Earlier work this paper cites.
Lampinen, A.K., Ganguli, S.: An analytic theory of generalization dynamics and transfer learning in deep linear networks. In: The International Conference on Learning Representations (2019)
2019
Earlier work this paper cites.
Lee, J., Xiao, L., Schoenholz, S., Bahri, Y., Novak, R., Sohl-Dickstein, J., Pennington, J.: Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descent. In: Advances in Neural Information Processing Systems 32, pp. 8572–8583 (2019)
2019
Earlier work this paper cites.
2019
Earlier work this paper cites.
2019
Earlier work this paper cites.
Basri, R., Jacobs, D., Kasten, Y., Kritchman, S.: The convergence rate of neural networks for learned functions of different frequencies. Advances in Neural Information Processing Systems 32
2019
Earlier work this paper cites.
2019
Earlier work this paper cites.
Chen, H., Lin, M., Sun, X., Qi, Q., Li, H., Jin, R.: Muffnet: Multi-layer feature federation for mobile deep learning. In: Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, pp. 0–0 (2019)
2019
Earlier work this paper cites.
Zhu, H., Qiao, Y., Xu, G., Deng, L., Yu-Feng, Y.: Dspnet: A lightweight dilated convolution neural networks for spectral deconvolution with self-paced learning. IEEE Transactions on Industrial Informatics (2019)
2019
Earlier work this paper cites.
Chakrabarty, P.: The spectral bias of the deep image prior. In: Bayesian Deep Learning Workshop and Advances in Neural Information Processing Systems (NeurIPS) (2019)
2019
Earlier work this paper cites.
E, W., Ma, C., Wu, L.: A Priori Estimates of the Population Risk for Two-layer Neural Networks. Communications in Mathematical Sciences 17
2019
Earlier work this paper cites.
Arora, S., Du, S., Hu, W., Li, Z., Wang, R.: Fine-grained analysis of optimization and generalization for overparameterized two-layer neural networks. In: International Conference on Machine Learning, pp. 322–332 (2019). PMLR
2019
Cited alongside, same era.
Kalimeris, D., Kaplun, G., Nakkiran, P., Edelman, B., Yang, T., Barak, B., Zhang, H.: Sgd on neural networks learns functions of increasing complexity. Advances in Neural Information Processing Systems 32
2019
Cited alongside, same era.
2019
Cited alongside, same era.
2019
Cited alongside, same era.
2020
Later among the works it cites.
2020
Later among the works it cites.
Zheng, Q., Babaei, V., Wetzstein, G., Seidel, H.-P., Zwicker, M., Singh, G.: Neural light field 3d printing. ACM Transactions on Graphics (TOG) 39
2020
Later among the works it cites.
2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Khoo, Y., Ying, L.: Switchnet: a neural network model for forward and inverse scattering problems. SIAM Journal on Scientific Computing 41
2019
Cited alongside, same era.
Fan, Y., Lin, L., Ying, L., Zepeda-Núnez, L.: A multiscale neural network based on hierarchical matrices. Multiscale Modeling & Simulation 17
2019
Cited alongside, same era.
Han, J., Ma, C., Ma, Z., Weinan, E.: Uniformly accurate machine learning-based hydrodynamic models for kinetic equations. Proceedings of the National Academy of Sciences 116
2019
Cited alongside, same era.
He, J., Xu, J.: Mgnet: A unified framework of multigrid and convolutional neural network. Science china mathematics 62
2019
Cited alongside, same era.
Strofer, C.M., Wu, J.-L., Xiao, H., Paterson, E.: Data-driven, physics-based feature extraction from fluid flow fields using convolutional neural networks. Communications in Computational Physics 25
2019
Cited alongside, same era.
Raissi, M., Perdikaris, P., Karniadakis, G.E.: Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics 378
2019
Cited alongside, same era.
2019
Cited alongside, same era.
2019
Cited alongside, same era.
2020
Later among the works it cites.
You, H., Li, C., Xu, P., Fu, Y., Wang, Y., Chen, X., Lin, Y., Wang, Z., Baraniuk, R.G.: Drawing early-bird tickets: Towards more efficient training of deep networks. International Conference on Learning Representations (2020)
2020
Later among the works it cites.
Fu, Y., You, H., Zhao, Y., Wang, Y., Li, C., Gopalakrishnan, K., Wang, Z., Lin, Y.: Fractrain: Fractionally squeezing bit savings both temporally and spatially for efficient DNN training. In: Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, Virtual (2020)
2020
Later among the works it cites.
Zang, Y., Bao, G., Ye, X., Zhou, H.: Weak adversarial networks for high-dimensional partial differential equations. Journal of Computational Physics 411
2020
Later among the works it cites.
2020
Later among the works it cites.
Huang, J., Wang, H., Yang, H.: Int-deep: A deep learning initialized iterative method for nonlinear problems. Journal of Computational Physics 419
2020
Later among the works it cites.
2020
Later among the works it cites.
2020
Later among the works it cites.
Wang, B., Zhang, W., Cai, W.: Multi-scale deep neural network (mscalednn) methods for oscillatory stokes flows in complex domains. Communications in Computational Physics 28
2020
Later among the works it cites.
Li, X.-A., Xu, Z.-Q.J., Zhang, L.: A multi-scale dnn algorithm for nonlinear elliptic equations with multiple scales. Communications in Computational Physics 28
2020
Later among the works it cites.
Zhang, Y., Xu, Z.-Q.J., Luo, T., Ma, Z.: A type of generalization error induced by initialization in deep neural networks. In: Mathematical and Scientific Machine Learning, pp. 144–164 (2020). PMLR
2020
Later among the works it cites.
Zhang, Y., Luo, T., Ma, Z., Xu, Z.-Q.J.: A linear frequency principle model to understand the absence of overfitting in neural networks. Chinese Physics Letters 38
2021
Later among the works it cites.
Cao, Y., Fang, Z., Wu, Y., Zhou, D.-X., Gu, Q.: Towards understanding the spectral bias of deep learning. In: Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI-21, pp. 2205–2211 (2021)
2021
Later among the works it cites.
Chen, Y., Li, G., Jin, C., Liu, S., Li, T.: Ssd-gan: Measuring the realness in the spatial and spectral domains. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 1105–1112 (2021)
2021
Later among the works it cites.
Xu, Z.-Q.J., Zhou, H.: Deep frequency principle towards understanding why deeper learning is faster. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35 (2021)
2021
Later among the works it cites.
Deng, X., Zhang, Z.M.: Is the meta-learning idea able to improve the generalization of deep neural networks on the standard supervised learning? In: 2020 25th International Conference on Pattern Recognition (ICPR), pp. 150–157 (2021). IEEE
2021
Later among the works it cites.
Chen, G.-Y., Gan, M., Chen, C.P., Zhu, H.-T., Chen, L.: Frequency principle in broad learning system. IEEE Transactions on Neural Networks and Learning Systems (2021)
2021
Later among the works it cites.
Schwarz, K., Liao, Y., Geiger, A.: On the frequency bias of generative models. Advances in Neural Information Processing Systems 34
2021
Later among the works it cites.
2021
Later among the works it cites.
Pumarola, A., Corona, E., Pons-Moll, G., Moreno-Noguer, F.: D-nerf: Neural radiance fields for dynamic scenes. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10318–10327 (2021)
2021
Later among the works it cites.
Hennigh, O., Narasimhan, S., Nabian, M.A., Subramaniam, A., Tangsali, K., Fang, Z., Rietmann, M., Byeon, W., Choudhry, S.: Nvidia simnet: An ai-accelerated multi-physics simulation framework. In: International Conference on Computational Science, pp. 447–461 (2021). Springer
2021
Later among the works it cites.
Wang, S., Wang, H., Perdikaris, P.: On the eigenvector bias of fourier feature networks: From regression to solving multi-scale pdes with physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering 384
2021
Later among the works it cites.
Xu, R., Wang, X., Chen, K., Zhou, B., Loy, C.C.: Positional encoding as spatial inductive bias in gans. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 13569–13578 (2021)
2021
Later among the works it cites.
Peng, S., Zhang, Y., Xu, Y., Wang, Q., Shuai, Q., Bao, H., Zhou, X.: Neural body: Implicit neural representations with structured latent codes for novel view synthesis of dynamic humans. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9054–9063 (2021)
2021
Later among the works it cites.
Tancik, M., Mildenhall, B., Wang, T., Schmidt, D., Srinivasan, P.P., Barron, J.T., Ng, R.: Learned initializations for optimizing coordinate-based neural representations. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2846–2855 (2021)
2021
Later among the works it cites.
2021
Later among the works it cites.
Lu, L., Jin, P., Pang, G., Zhang, Z., Karniadakis, G.E.: Learning nonlinear operators via deeponet based on the universal approximation theorem of operators. Nature Machine Intelligence 3
2021
Later among the works it cites.
2021
Later among the works it cites.
E, W., Han, J., Jentzen, A.: Algorithms for solving high dimensional pdes: From nonlinear monte carlo to machine learning. Nonlinearity 35
2021
Later among the works it cites.
2021
Later among the works it cites.
2021
Later among the works it cites.
Wang, S., Wang, H., Perdikaris, P.: On the eigenvector bias of fourier feature networks: From regression to solving multi-scale pdes with physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering 384
2021
Later among the works it cites.
Mildenhall, B., Srinivasan, P.P., Tancik, M., Barron, J.T., Ramamoorthi, R., Ng, R.: Nerf: Representing scenes as neural radiance fields for view synthesis. Communications of the ACM 65
2021
Later among the works it cites.
Lu, L., Meng, X., Mao, Z., Karniadakis, G.E.: Deepxde: A deep learning library for solving differential equations. SIAM Review 63
2021
Later among the works it cites.
2021
Later among the works it cites.
Luo, T., Xu, Z.-Q.J., Ma, Z., Zhang, Y.: Phase diagram for two-layer relu neural networks at infinite-width limit. Journal of Machine Learning Research 22
2021
Later among the works it cites.
Zhang, Y., Zhang, Z., Luo, T., Xu, Z.-Q.J.: Embedding principle of loss landscape of deep neural networks. NeurIPS (2021)
2021
Later among the works it cites.
2021
Later among the works it cites.
2022
Closest in time.
Li, Y., Peng, W., Tang, K., Fang, M.: Spatio-frequency decoupled weak-supervision for face reconstruction. Computational Intelligence & Neuroscience (2022)
2022
Closest in time.