The generalization error of random features regression: Precise asymptotics and double descent curve

Szegő, Gabor, Orthogonal polynomials , vol. 23, American Mathematical Soc., 1939

1939

Earlier work this paper cites.

Ronald A DeVore, Ralph Howard, and Charles Micchelli, Optimal nonlinear approximation , Manuscripta mathematica 63

1989

Earlier work this paper cites.

David L Donoho and Iain M Johnstone, Projection-based approximation and a duality with kernel methods , The Annals of Statistics (1989), 58–106

1989

Earlier work this paper cites.

Radford M Neal, Priors for infinite networks , Bayesian Learning for Neural Networks, Springer, 1996, pp. 29–53

1996

Earlier work this paper cites.

Christopher KI Williams, Computing with infinite networks , Advances in neural information processing systems, 1997, pp. 295–301

1997

Earlier work this paper cites.

Yuan Yao, Lorenzo Rosasco, and Andrea Caponnetto, On early stopping in gradient descent learning , Constructive Approximation 26

2007

Earlier work this paper cites.

Ali Rahimi and Benjamin Recht, Random features for large-scale kernel machines , Advances in neural information processing systems, 2008, pp. 1177–1184

2008

Earlier work this paper cites.

Greg W. Anderson, Alice Guionnet, and Ofer Zeitouni, An introduction to random matrices , Cambridge University Press, 2009

2009

Earlier work this paper cites.

Trevor Hastie, Robert Tibshirani, and Jerome Friedman, The elements of statistical learning , Springer, 2009

2009

Earlier work this paper cites.

Zhidong Bai and Jack W Silverstein, Spectral analysis of large dimensional random matrices , vol. 20, Springer, 2010

2010

Earlier work this paper cites.

Noureddine El Karoui, The spectrum of kernel random matrices , The Annals of Statistics 38

2010

Earlier work this paper cites.

Theodore S Chihara, An introduction to orthogonal polynomials , Courier Corporation, 2011

2011

Earlier work this paper cites.

Domenico Marinucci and Giovanni Peccati, Random fields on the sphere: representation, limit theorems and cosmological applications , vol. 389, Cambridge University Press, 2011

2011

Earlier work this paper cites.

Francis Bach, Sharp analysis of low-rank kernel matrix approximations , Conference on Learning Theory, 2013, pp. 185–209

2013

Earlier work this paper cites.

Xiuyuan Cheng and Amit Singer, The spectrum of random inner-product kernel matrices , Random Matrices: Theory and Applications 2

2013

Earlier work this paper cites.

Costas Efthimiou and Christopher Frye, Spherical harmonics in p dimensions , World Scientific, 2014

2014

Earlier work this paper cites.

Ahmed Alaoui and Michael W Mahoney, Fast randomized kernel ridge regression with statistical guarantees , Advances in Neural Information Processing Systems, 2015, pp. 775–783

2015

Earlier work this paper cites.

Tamir Hazan and Tommi Jaakkola, Steps toward deep kernel methods from infinite neural networks , arXiv:1508.05133 (2015)

Original

2015

Earlier work this paper cites.

Amit Daniely, Roy Frostig, and Yoram Singer, Toward deeper understanding of neural networks: The power of initialization and a dual view on expressivity , Advances In Neural Information Processing Systems, 2016, pp. 2253–2261

2016

Earlier work this paper cites.

Yash Deshpande and Andrea Montanari, Sparse pca via covariance thresholding , Journal of Machine Learning Research 17

2016

Earlier work this paper cites.

Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, and Oriol Vinyals, Understanding deep learning requires rethinking generalization , arXiv:1611.03530 (2016)

Original

2016

Earlier work this paper cites.

Madhu S Advani and Andrew M Saxe, High-dimensional dynamics of generalization error in neural networks , arXiv:1710.03667 (2017)

Original

2017

Earlier work this paper cites.

Amit Daniely, Sgd learns the conjugate kernel class of the network , Advances in Neural Information Processing Systems, 2017, pp. 2422–2430

2017

Cited alongside, same era.

Jaehoon Lee, Yasaman Bahri, Roman Novak, Samuel S Schoenholz, Jeffrey Pennington, and Jascha Sohl-Dickstein, Deep neural networks as gaussian processes , arXiv:1711.00165 (2017)

Original

2017

Cited alongside, same era.

Jeffrey Pennington and Pratik Worah, Nonlinear random matrix theory for deep learning , Advances in Neural Information Processing Systems, 2017, pp. 2637–2646

2017

Cited alongside, same era.

Alessandro Rudi and Lorenzo Rosasco, Generalization properties of learning with random features , Advances in Neural Information Processing Systems, 2017, pp. 3215–3225

2017

Cited alongside, same era.

Zeyuan Allen-Zhu, Yuanzhi Li, and Yingyu Liang, Learning and generalization in overparameterized neural networks, going beyond two layers , arXiv:1811.04918 (2018)

Santosh Vempala and John Wilmes, Gradient descent for one-hidden-layer neural networks: Polynomial convergence and sq lower bounds , arXiv:1805.02677 (2018)

Original

2018

Later among the works it cites.

Sanjeev Arora, Simon S Du, Wei Hu, Zhiyuan Li, and Ruosong Wang, Fine-grained analysis of optimization and generalization for overparameterized two-layer neural networks , arXiv:1901.08584 (2019)

Original

2019

Closest in time.

Dyego Araújo, Roberto I Oliveira, and Daniel Yukimura, A mean-field limit for certain deep neural networks , arXiv:1906.00193 (2019)

Original

2019

Closest in time.

Mikhail Belkin, Daniel Hsu, Siyuan Ma, and Soumik Mandal, Reconciling modern machine learning and the bias-variance trade-off , Proceedings of the National Academy of Sciences 116

2019

Closest in time.