Nadaraya-Watson kernel smoothing as a random energy model

B. Derrida, Random-energy model: An exactly solvable model of disordered systems, Phys. Rev. B 24

1981

Earlier work this paper cites.

G. Ben Arous, L. V. Bogachev, and S. A. Molchanov, Limit theorems for sums of random exponentials, Probability Theory and Related Fields 132

2005

Earlier work this paper cites.

A. Mokkadem, M. Pelletier, and B. Thiam, Large and moderate deviations principles for kernel estimators of the multivariate regression, Mathematical Methods of Statistics 17

2008

Earlier work this paper cites.

A. B. Tsybakov, Introduction to Nonparametric Estimation (Springer, New York, NY, 2009)

2009

Earlier work this paper cites.

M. Mézard and A. Montanari, Information, Physics, and Computation (Oxford University Press, 2009)

2009

Earlier work this paper cites.

D. Krotov and J. J. Hopfield, Dense associative memory for pattern recognition, in Advances in Neural Information Processing Systems , Vol. 29, edited by D. Lee, M. Sugiyama, U. Luxburg, I. Guyon, and R. Garnett (Curran Associates, Inc., 2016)

2016

Cited alongside, same era.

D. Conn and G. Li, An oracle property of the Nadaraya–Watson kernel estimator for high-dimensional nonparametric regression, Scandinavian Journal of Statistics 46

2019

Cited alongside, same era.

M. Belkin, A. Rakhlin, and A. B. Tsybakov, Does data interpolation contradict statistical optimality?, in Proceedings of the Twenty-Second International Conference on Artificial Intelligence and Statistics , Proceedings of Machine Learning Research, Vol. 89, edited by K. Chaudhuri and M. Sugiyama (PMLR, 2019) pp. 1611–1619

2019

Cited alongside, same era.

S. Spigler, M. Geiger, and M. Wyart, Asymptotic learning curves of kernel methods: empirical data versus teacher–student paradigm, Journal of Statistical Mechanics: Theory and Experiment 2020

L. Xiao, H. Hu, T. Misiakiewicz, Y. Lu, and J. Pennington, Precise learning curves and higher-order scalings for dot-product kernel regression, in Advances in Neural Information Processing Systems , Vol. 35, edited by S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh (Curran Associates, Inc., 2022) pp. 4558–4570

2022

Later among the works it cites.

A. B. Atanasov, J. A. Zavatone-Veth, and C. Pehlevan, Scaling and renormalization in high-dimensional regression, arXiv (2024), arXiv:2405.00592 [stat.ML]

Original

2024

Closest in time.

C. Lucibello and M. Mézard, Exponential capacity of dense associative memories, Phys. Rev. Lett. 132

2024

Closest in time.

G. Biroli and M. Mézard, Kernel density estimators in large dimensions, arXiv (2024) , arXiv:2408.05807 [cs.LG]

Original

2024

Closest in time.