Fetching the paper…
Reading the bibliography…
We provide exact asymptotic expressions for the performance of regression by an $L-$layer deep random feature (RF) model, where the input is mapped through multiple random embedding and non-linear activation functions.
Eine neue herleitung des exponentialgesetzes in der wahrscheinlichkeitsrechnung
J. W. Lindeberg · 1922
Earlier work this paper cites.
Some inequalities for gaussian processes and applications
Y. Gordon · 1985
Earlier work this paper cites.
Spin glass theory and beyond: An Introduction to the Replica Method and Its Applications
M. Mézard, G. Parisi, and M. A. Virasoro · 1987
Earlier work this paper cites.
On milman’s inequality and random subspaces which escape through a mesh in r n
Y. Gordon · 1988
Earlier work this paper cites.
Limit laws for random matrices and free products
D. Voiculescu · 1991
Earlier work this paper cites.
Lectures on Probability Theory and Statistics: Ecole D’Ete de Probabilites de Saint-Flour XXVIII-1998
M. Emery, A. Nemirovski, and D. Voiculescu · 2007
Earlier work this paper cites.
Random features for large-scale kernel machines
A. Rahimi and B. Recht · 2007
Earlier work this paper cites.
A simple proof of the restricted isometry property for random matrices
R. Baraniuk, M. Davenport, R. DeVore, and M. Wakin · 2008
Earlier work this paper cites.
On the duality of strong convexity and strong smoothness: Learning applications and matrix regularization
S. Kakade, S. Shalev-Shwartz, A. Tewari, et al · 2009
Earlier work this paper cites.
Applications of the lindeberg principle in communications and statistical learning
S. B. Korada and A. Montanari · 2011
Earlier work this paper cites.
Random Matrix Recursions in Estimation, Control, and Adaptive Filtering
A. Vakili · 2011
Earlier work this paper cites.
The convex geometry of linear inverse problems
V. Chandrasekaran, B. Recht, P. A. Parrilo, and A. S. Willsky · 2012
Earlier work this paper cites.
Concentration inequalities: A nonasymptotic theory of independence
S. Boucheron, G. Lugosi, and P. Massart · 2013
Earlier work this paper cites.
The Gaussian min-max theorem in the Presence of Convexity
C. Thrampoulidis, S. Oymak, and B. Hassibi · 2014
Earlier work this paper cites.
Regularized linear regression: A precise analysis of the estimation error
C. Thrampoulidis, S. Oymak, and B. Hassibi · 2015
Earlier work this paper cites.
Toward deeper understanding of neural networks: The power of initialization and a dual view on expressivity
A. Daniely, R. Frostig, and Y. Singer · 2016
Earlier work this paper cites.
On the equivalence between kernel quadrature rules and random feature expansions
F. Bach · 2017
Earlier work this paper cites.
Sgd learns the conjugate kernel class of the network
A. Daniely · 2017
Cited alongside, same era.
Deep neural networks as gaussian processes
J. Lee, Y. Bahri, R. Novak, S. S. Schoenholz, J. Pennington, and J. Sohl-Dickstein · 2017
Cited alongside, same era.
Universality of the elastic net error
A. Montanari and P.-M. Nguyen · 2017
Cited alongside, same era.
A universal analysis of large-scale regularized least squares solutions
A. Panahi and B. Hassibi · 2017
Cited alongside, same era.
Neural tangent kernel: Convergence and generalization in neural networks
A. Jacot, C. Hongler, and F. Gabriel · 2018
Cited alongside, same era.
A random matrix approach to neural networks
C. Louart, Z. Liao, and R. Couillet · 2018
Cited alongside, same era.
Generalisation error in learning with random features and the hidden manifold model
F. Gerace, B. Loureiro, F. Krzakala, M. Mézard, and L. Zdeborová · 2020
Later among the works it cites.
Modeling the influence of data structure on learning in neural networks: The hidden manifold model
S. Goldt, M. Mézard, F. Krzakala, and L. Zdeborová · 2020
Later among the works it cites.
Universality laws for high-dimensional learning with random features
H. Hu and Y. M. Lu · 2020
Later among the works it cites.
High-dimensional probability: An introduction with applications in data science, 2020
O. Papaspiliopoulos · 2020
Later among the works it cites.
Random matrix theory proves that deep learning representations of gan-data behave as gaussian mixtures
M. E. A. Seddik, C. Louart, M. Tamaazousti, and R. Couillet · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Universality laws for randomized dimension reduction, with applications
S. Oymak and J. A. Tropp · 2018
Cited alongside, same era.
Universality in learning from linear measurements
E. Abbasi, F. Salehi, and B. Hassibi · 2019
Cited alongside, same era.
Reconciling modern machine-learning practice and the classical bias–variance trade-off
M. Belkin, D. Hsu, S. Ma, and S. Mandal · 2019
Cited alongside, same era.
Surprises in high-dimensional ridgeless least squares interpolation
T. Hastie, A. Montanari, S. Rosset, and R. J. Tibshirani · 2019
Cited alongside, same era.
The generalization error of random features regression: Precise asymptotics and the double descent curve
S. Mei and A. Montanari · 2019
Cited alongside, same era.
A. Montanari, F. Ruan, Y. Sohn, and J. Yan · 2019
Cited alongside, same era.
Double descent in feature selection: Revisiting lasso and basis pursuit
D. Bosch, A. Panahi, and A. Özcelikkale · 2021
Later among the works it cites.
On the inherent regularization effects of noise injection during training
O. Dhifallah and Y. Lu · 2021
Later among the works it cites.
Linearized two-layers neural networks in high dimension
B. Ghorbani, S. Mei, T. Misiakiewicz, and A. Montanari · 2021
Later among the works it cites.
Random features for kernel approximation: A survey on algorithms, theory, and beyond
F. Liu, X. Huang, Y. Chen, and J. A. Suykens · 2021
Later among the works it cites.
B. Loureiro, C. Gerbelot, H. Cui, S. Goldt, F. Krzakala, M. Mézard, and L. Zdeborová · 2021
Later among the works it cites.
Learning curves of generic features maps for realistic datasets with a teacher-student model, 2021
B. Loureiro, C. Gerbelot, H. Cui, S. Goldt, F. Krzakala, M. Mézard, and L. Zdeborová · 2021
Later among the works it cites.
Understanding deep learning (still) requires rethinking generalization
C. Zhang, S. Bengio, M. Hardt, B. Recht, and O. Vinyals · 2021
Later among the works it cites.
Double descent in random feature models: Precise asymptotic analysis for general convex regularization, 2022
D. Bosch, A. Panahi, A. Özcelikkale, and D. Dubhash · 2022
Later among the works it cites.
Gaussian universality of linear classifiers with random labels in high-dimension
F. Gerace, F. Krzakala, B. Loureiro, L. Stephan, and L. Zdeborová · 2022
Later among the works it cites.
The gaussian equivalence of generative models for learning with shallow neural networks
S. Goldt, B. Loureiro, G. Reeves, F. Krzakala, M. Mézard, and L. Zdeborová · 2022
Later among the works it cites.
Universality laws for high-dimensional learning with random features
H. Hu and Y. M. Lu · 2022
Later among the works it cites.
Universality of empirical risk minimization
A. Montanari and B. N. Saeed · 2022
Later among the works it cites.