On the Approximation Properties of Random ReLU Features

Remarques sur un résultat non publié de B. Maurey

Gilles Pisier · 1980

Earlier work this paper cites.

Universal approximation bounds for superpositions of a sigmoidal function

Andrew R Barron · 1993

Earlier work this paper cites.

Multilayer feedforward networks with a nonpolynomial activation function can approximate any function

Moshe Leshno, Vladimir Ya Lin, Allan Pinkus, and Shimon Schocken · 1993

Earlier work this paper cites.

Functional Analysis

P.D. Lax · 2002

Earlier work this paper cites.

Universal approximation using incremental constructive feedforward networks with random hidden nodes

Guang-Bin Huang, Lei Chen, Chee Kheong Siew, et al · 2006

Earlier work this paper cites.

Universal kernels

Charles A Micchelli, Yuesheng Xu, and Haizhang Zhang · 2006

Earlier work this paper cites.

Random Features for Large-Scale Kernel Machines

Ali Rahimi and Benjamin Recht · 2008

Earlier work this paper cites.

Support Vector Machines

I. Steinwart and A. Christmann · 2008

Cited alongside, same era.

Kernel Methods for Deep Learning

Youngmin Cho and Lawrence K. Saul · 2009

Cited alongside, same era.

Foundations of Machine Learning

Mehryar Mohri, Afshin Rostamizadeh, and Ameet Talwalkar · 2012

Cited alongside, same era.

Sharp estimates for eigenvalues of integral operators generated by dot product kernels on the sphere

D. Azevedo and V. A. Menegatto · 2013

Cited alongside, same era.

Kernel methods match Deep Neural Networks on TIMIT

P. S. Huang, H. Avron, T. N. Sainath, V. Sindhwani, and B. Ramabhadran · 2014

Cited alongside, same era.

TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems

Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Greg S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Jozefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dandelion Mané, Rajat Monga, Sherry Moore, Derek Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda Viégas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng · 2015

Depth Separation for Neural Networks

Original

Amit Daniely · 2017

Later among the works it cites.

UCI Machine Learning Repository

Dua Dheeru and Efi Karra Taniskidou · 2017

Later among the works it cites.

On the Ability of Neural Nets to Express Distributions

Holden Lee, Rong Ge, Tengyu Ma, Andrej Risteski, and Sanjeev Arora · 2017

Later among the works it cites.

Generalization properties of learning with random features

Alessandro Rudi and Lorenzo Rosasco · 2017

Later among the works it cites.

Learning with SGD and Random Features

Luigi Carratino, Alessandro Rudi, and Lorenzo Rosasco · 2018

Closest in time.

But How Does It Work in Theory? Linear SVM with Random Features

Yitong Sun, Anna Gilbert, and Ambuj Tewari · 2018

Closest in time.