Fetching the paper…
Reading the bibliography…
We explain how to use Kolmogorov Superposition Theorem (KST) to break the curse of dimensionality when approximating a dense class of multivariate continuous functions.
A. N. Kolmogorov. The representation of continuous functions of several variables by superpositions of continuous functions of a smaller number of variables. Doklady Akademii Nauk SSSR, 108(2):179–182, 1956
1956
Earlier work this paper cites.
A. N. Kolmogorov, On the representation of continuous function of several variables by superposition of continuous function of one variable and its addition, Dokl. Akad. Nauk SSSR 114 (1957), 369–373
1957
Earlier work this paper cites.
G. G. Lorentz, Metric entropy, widths, and superpositions of functions, Amer. Math. Monthly, 69 (1962), 469–485
1962
Earlier work this paper cites.
R. Doss, On the representation of continuous functions of two variables by means of addition and continuous functions of one variable. Colloquium Mathematicum, X(2):249–259, 1963
1963
Earlier work this paper cites.
D. A. Sprecher, Ph.D. Dissertation, University of Maryland, 1963
1963
Earlier work this paper cites.
D. A. Sprecher, A representation theorem for continuous functions of several variables, Proc. Amer. Math. Soc. 16 (1965), 200–203
1965
Earlier work this paper cites.
D. A. Sprecher, On the structure of continuous functions of several variables. Transactions of the American Mathematical Society, 115:340–355, 1965
1965
Earlier work this paper cites.
G. G. Lorentz, Approximation of Functions, Holt, Rinehart and Winston, Inc. 1966
1966
Earlier work this paper cites.
D. A. Sprecher, On the structure of representation of continuous functions of several variables as finite sums of continuous functions of one variable. Proceedings of the American Mathematical Society, 17(1):98–105, 1966
1966
Earlier work this paper cites.
B. L. Friedman, An improvement in the smoothness of the functions in Kolmogorov’s theorem on superpositions. Doklady Akademii Nauk SSSR, 117:1019–1022, 1967
1967
Earlier work this paper cites.
D. A. Sprecher, An improvement in the superposition theorem of Kolmogorov. Journal of Mathematical Analysis and Applications, 38(1):208–213, 1972
1972
Earlier work this paper cites.
M. J. Powell, Approximation theory and methods, Cambridge University Press, 1981
1981
Earlier work this paper cites.
R. Hecht-Nielsen, Kolmogorov’s mapping neural network existence theorem. In Proceedings of the international conference on Neural Networks, volume 3, pages 11–14. New York: IEEE Press, 1987
1987
Earlier work this paper cites.
G. Cybenko, Approximation by Superpositions of a Sigmoidal Function, Math. Control Signals Systems (1989) 2:303–314
1989
Earlier work this paper cites.
R. DeVore, R. Howard, and C. Micchelli, Optimal nonlinear approximation, Manuscripta Mathematica, 63(4):469–478, 1989
1989
Earlier work this paper cites.
Girosi, F., and Poggio, T. (1989). Representation properties of networks: Kolmogorov’s theorem is irrelevant. Neural Computation, 1(4), 465-469
1989
Earlier work this paper cites.
K. Hornik, Approximation capabilities of multilayer feedforward networks. Neural Networks 4, no. 2 (1991): 251-257
1991
Earlier work this paper cites.
V. Kurkov, Kolmogorov’s Theorem and Multilayer Neural Networks, Neural Networks, Vol. 5, pp. 501– 506, 1992
1992
Earlier work this paper cites.
H. Mhaskar, C. A. Micchelli, Approximation by superposition of sigmoidal and radial basis functions, Adv. Appl. Math. 13 (3) (1992) 350–373
1992
Earlier work this paper cites.
A. R. Barron. Universal approximation bounds for superpositions of a sigmoidal function, IEEE Transactions on Information theory, 39(3):930–945, 1993
1993
Earlier work this paper cites.
D. A. Sprecher, A universal mapping for Kolmogorov’s superposition theorem. Neural Networks, 6(8):1089–1094, 1993
1993
Earlier work this paper cites.
D. A. Sprecher, A numerical implementation of Kolmogorov’s superpositions. Neural Networks, 9(5):765–772, 1996
1996
Earlier work this paper cites.
D. A. Sprecher, A Numerical Implementation of Kolmogorov’s Superpositions II. Neural Networks, 10(3):447–457, 1997
1997
Earlier work this paper cites.
E. W. Cheney, Approximation Theory, AMS Publication, Chelsea, 1998
1998
Earlier work this paper cites.
P. P. Petrushev, Approximation by ridge functions and neural networks, SIAM J. Math. Anal. 30 (1998), 155–189
1998
Earlier work this paper cites.
V. E. Maiorov, On best approximation by ridge functions, J. Approx. Theory 99 (1999),68–94
1999
Earlier work this paper cites.
V. Maiorov and A. Pinkus, Lower bounds for approximation by MLP neural networks, Neurocomputing, 25 (1999), pp. 81–91
1999
Earlier work this paper cites.
A. Pinkus, Approximation theory of the MLP model in neural networks, Acta Numerica (1999), pp. 143–195
1999
Earlier work this paper cites.
S. A. Goreinov and E. E. Tyrtyshnikov, The maximal-volume concept in approximation by low-rank matrices, Contemporary Mathematics, 208: 47–51, 2001
2001
Cited alongside, same era.
M. Von Golitschek, Lai, M. -J. and Schumaker, L. L., Bounds for Minimal Energy Bivariate Polynomial Splines, Numerisch Mathematik, vol. 93 (2002) pp. 315–331
2002
Cited alongside, same era.
B. Igelnik and N. Parikh, Kolmogorov’s spline network. IEEE Transactions on Neural Networks, 14(4):725–733, 2003
2003
Cited alongside, same era.
G. Awanou, M. -J. Lai, P. Wenston, The multivariate spline method for scattered data fitting and numerical solutions of partial differential equations, Wavelets and splines: Athens, Nashboro Publication, (2005), 24–74
2005
Cited alongside, same era.
M. -J. Lai and L. L. Schumaker, Spline Functions over Triangulations, Cambridge University Press, 2007
2019
Later among the works it cites.
Weinan E, Machine Learning and Computational Mathematics, arXiv:2009.14596v1 [math.NA] 23 Sept. 2020
2020
Later among the works it cites.
H. Montanelli and H. Yang, Error Bounds for Deep ReLU Networks using the Kolmogorov–Arnold Superposition Theorem. Neural Networks, 2020
2020
Later among the works it cites.
R. Nakada and M. Imaizumi. ”Adaptive approximation and generalization of deep neural network with intrinsic dimensionality.” Journal of Machine Learning Research 21, no. 174 (2020): 1-38
2020
Later among the works it cites.
J. W. Siegel and J. Xu, Approximation rates for neural networks with general activation functions, Neural Networks 128 (2020): 313-321
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
2007
Cited alongside, same era.
L. L. Schumaker, Spline Functions: Basic Theory, Third Edition, Cambridge University Press, 2007
2007
Cited alongside, same era.
D. W. Bryant. Analysis of Kolmogorov’s superposition theorem and its implementation in applications with low and high dimensional data. PhD thesis, University of Central Florida, 2008
2008
Cited alongside, same era.
M. -J. Lai, Multivariate splines for Data Fitting and Approximation, the conference proceedings of the 12th Approximation Theory, San Antonio, Nashboro Press, (2008) edited by M. Neamtu and Schumaker, L. L. pp. 210–228
2008
Cited alongside, same era.
B J. Braun, An Application of Kolmogorov’s Superposition Theorem to Function Reconstruction in Higher Dimensions, PhD thesis, University of Bonn, 2009
2009
Cited alongside, same era.
B. J. Braun and M. Griebel, On a constructive proof of Kolmogorov’s superposition theorem, Constructive Approximation, 30(3):653–675, 2009
2009
Cited alongside, same era.
M. -J. Lai and L. L. Schumaker, Domain Decomposition Method for Scattered Data Fitting, SIAM Journal on Numerical Analysis, vol. 47 (2009) pp. 911–928
2009
Cited alongside, same era.
Z. Feng, Hilbert’s 13th problem. PhD thesis, University of Pittsburgh, 2010
2010
Cited alongside, same era.
2020
Later among the works it cites.
L. Wang, G. Wang, M. -J. Lai, and Gao, L., Efficient Estimation of Partially Linear Models for Spatial Data over Complex Domains, Statistica Sinica, vol. 30 (2020) pp. 347–360
2020
Later among the works it cites.
D. Yarotsky and A. Zhevnerchuk, The phase diagram of approximation rates for deep neural networks, Advances in neural information processing systems 33 (2020): 13005-13015
2020
Later among the works it cites.
A. Cloninger and T. Klock. ”A deep network construction that adapts to intrinsic dimensionality beyond the domain.” Neural Networks 141 (2021): 404-419
2021
Closest in time.
R. DeVore, B. Hanin, and G. Petrova, Neural Network Approximation, Acta Numerica 30 (2021): 327-444
2021
Closest in time.
M. -J. Lai and Y. Wang, Sparse Solutions of Underdetermined Linear Systems and Their Applications, SIAM Publication, 2021
2021
Closest in time.
M. Laczkovich, A superposition theorem of Kolmogorov type for bounded continuous functions, J. Approx. Theory, vol. 269(2021), 105609
2021
Closest in time.
J. Lu, Z. Shen, H. Yang, S. Zhang, Deep Network Approximation for Smooth Functions, SIAM Journal on Mathematical Analysis, 2021
2021
Closest in time.
H. Montanelli, H. Yang, Q. Du, Deep ReLU Networks Overcome the Curse of Dimensionality for Bandlimited Functions. Journal of Computational Mathematics, 2021
2021
Closest in time.
S. Morris, Hilbert 13: are there any genuine continuous multivariate real-valued functions? Bulletin of AMS, vol. 58. No. 1 (2021), pp 107–118
2021
Closest in time.
J. Schmidt-Hieber, The Kolmogorov-Arnold representation theorem revisited. Neural Networks, 137 (2021), 119-126
2021
Closest in time.
Z. Shen, H. Yang, S. Zhang. Neural Network Approximation: Three Hidden Layers Are Enough. Neural Networks, 2021
2021
Closest in time.
Minshuo Chen, Haoming Jiang, Wenjing Liao, and Tuo Zhao. ”Nonparametric regression on low-dimensional manifolds using deep ReLU networks: Function approximation and statistical recovery.” Information and Inference: A Journal of the IMA 11, no. 4 (2022): 1203-1253
2022
Closest in time.
I. Daubechies, R. DeVore, S. Foucart, B. Hanin, and G. Petrova, Nonlinear Approximation and (Deep) ReLU Networks, Constructive Approximation 55, no. 1 (2022): 127-172
2022
Closest in time.
Weinan E, Chao Ma and Lei Wu, Barron spaces and the flow-induced function spaces for neural network models, Constructive Approximation 55, no. 1 (2022): 369-406
2022
Closest in time.
Weinan E and Stephan Wojtowytsch, Representation formulas and pointwise properties for Barron functions, Calculus of Variations and Partial Differential Equations 61, no. 2 (2022): 1-37
2022
Closest in time.
D. Fakhoury, E. Fakhoury, and H. Speleers, ExSpliNet: An interpretable and expressive spline-based neural network, Neural Networks 152, pp. 332–346, 2022
2022
Closest in time.
M.-J. Lai and J. Lee, A multivariate spline based collocation method for numerical solution of partial differential equations, SIAM J. Numerical Analysis, vol. 60 (2022) pp. 2405–2434
2022
Closest in time.
Z. Shen, H. Yang, and S. Zhang, Deep Network Approximation: Achieving Arbitrary Accuracy with Fixed Number of Neurons. Journal of Machine Learning Research, 2022
2022
Closest in time.
J. W. Siegel and J. Xu. High-Order Approximation Rates for Shallow Neural Networks with Cosine and ( R e L U ) k (ReLU)^{k} Activation Functions, Applied and Computational Harmonic Analysis 58 (2022): 1-26
2022
Closest in time.
2024
Closest in time.
Zhaiming Shen, Sparse Solution Technique in Semi-supervised Local Clustering and High Dimensional Function Approximation. Ph.D. Dissertation, University of Georgia, 2024
2024
Closest in time.