Approximation Rates for Neural Networks with General Activation Functions

Mathematics Magazine 21

Stone, M.H.: The generalized weierstrass approximation theorem · 1948

Earlier work this paper cites.

Neural networks 4

Hornik, K.: Approximation capabilities of multilayer feedforward networks · 1991

Earlier work this paper cites.

IEEE Transactions on Information theory 39

Barron, A.R.: Universal approximation bounds for superpositions of a sigmoidal function · 1993

Earlier work this paper cites.

Neural networks 6

Hornik, K.: Some new results on neural network approximation · 1993

Earlier work this paper cites.

Neural networks 6

Leshno, M., Lin, V.Y., Pinkus, A., Schocken, S.: Multilayer feedforward networks with a nonpolynomial activation function can approximate any function · 1993

Earlier work this paper cites.

Acta Numerica 3

Ellacott, S.: Aspects of the numerical analysis of neural networks · 1994

Earlier work this paper cites.

Neural Computation 6

Hornik, K., Stinchcombe, M., White, H., Auer, P.: Degree of approximation results for feedforward networks approximating unknown mappings and their derivatives · 1994

Earlier work this paper cites.

IBM Journal of Research and Development 38

Mhaskar, H.N., Micchelli, C.A.: Dimension-independent bounds on the degree of approximation by neural networks · 1994

Earlier work this paper cites.

Advances in applied mathematics 16

Mhaskar, H., Micchelli, C.A.: Degree of approximation by neural and translation networks with a single hidden layer · 1995

Earlier work this paper cites.

Journal of Approximation Theory 85

Makovoz, Y.: Random approximants and neural networks · 1996

Cited alongside, same era.

Neural computation 8

Mhaskar, H.N.: Neural networks for optimal approximation of smooth and analytic functions · 1996

Cited alongside, same era.

Neural networks 10

Attali, J.G., Pagès, G.: Approximations of functions by a multilayer perceptron: a new approach · 1997

Cited alongside, same era.

SIAM Journal on Mathematical Analysis 30

Petrushev, P.P.: Approximation by ridge functions and neural networks · 1998

Cited alongside, same era.

Acta numerica 8

Pinkus, A.: Approximation theory of the mlp model in neural networks · 1999

Cited alongside, same era.

World Scientific Publishing Company (2003)

Strichartz, R.S.: A guide to distribution theory and Fourier transforms · 2003

Cited alongside, same era.

In: Proceedings of the fourteenth international conference on artificial intelligence and statistics, pp. 315–323 (2011)

Glorot, X., Bordes, A., Bengio, Y.: Deep sparse rectifier neural networks · 2011

Later among the works it cites.

In: Proc. icml, vol. 30, p. 3 (2013)

Maas, A.L., Hannun, A.Y., Ng, A.Y.: Rectifier nonlinearities improve neural network acoustic models · 2013

Later among the works it cites.

Nature 521

LeCun, Y., Bengio, Y., Hinton, G.: Deep learning · 2015

Later among the works it cites.

arXiv preprint arXiv:1607.07819 (2016)

Original

Klusowski, J.M., Barron, A.R.: Uniform approximation by neural networks activated by first and second order ridge splines · 2016

Later among the works it cites.

Princeton university press (2016)

Stein, E.M., Weiss, G.: Introduction to Fourier analysis on Euclidean spaces (PMS-32), vol. 32 · 2016

Later among the works it cites.