Fetching the paper…
Reading the bibliography…
We show that a collection of Gaussian mixture models (GMMs) in $R^{n}$ can be optimally classified using $O(n)$ neurons in a neural network with two hidden layers (deep neural network), whereas in contrast, a neural network with a single hidden layer (shallow neural network) would require at least $O(\exp(n))$ neurons or possibly exponentially large coefficients.
Improved adaptive gaussian mixture model for background subtraction
Z. Zivkovic · 1902
Earlier work this paper cites.
Approximations by superpositions of a sigmoidal function
G. Cybenko · 1989
Earlier work this paper cites.
On the approximate realization of continuous mappings by neural networks
K.I. Funahashi · 1989
Earlier work this paper cites.
Multilayer feedforward networks are universal approximators
K. Hornik, M. Stinchcombe, and H. White · 1989
Earlier work this paper cites.
Approximation and estimation bounds for artificial neural networks
A. R. Barron · 1994
Earlier work this paper cites.
Maximum a posteriori estimation for multivariate gaussian mixture observations of markov chains
J.L. Gauvain and C.H. Lee · 1994
Earlier work this paper cites.
Speaker verification using adapted gaussian mixture models
D. A. Reynolds, T. F. Quatieri, and R. B. Dunn · 2000
Earlier work this paper cites.
Random projection in dimensionality reduction: applications to image and text data
E. Bingham and H. Mannila · 2001
Cited alongside, same era.
Real analysis
E. DiBenedetto · 2002
Cited alongside, same era.
Image denoising using scale mixtures of gaussians in the wavelet domain
J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli · 2003
Cited alongside, same era.
Handbook of natural language processing , volume 2
N. Indurkhya and F. J. Damerau · 2010
Cited alongside, same era.
Arithmetic Circuits: A Survey of Recent and Open Questions
A. Shpilka and A. Yehudayoff · 2010
Cited alongside, same era.
Shallow vs. deep sum-product networks
O. Delalleau and Y. Bengio · 2011
Cited alongside, same era.
On the expressive power of deep learning: A tensor analysis
N. Cohen, O. Sharir, and A. Shashua · 2015
Later among the works it cites.
Representation benefits of deep feedforward networks
M. Telgarsky · 2015
Later among the works it cites.
The power of depth for feedforward neural networks
R. Eldan and O. Shamir · 2016
Later among the works it cites.
Why does deep and cheap learning work so well?
H. W. Lin, M. Tegmark, and D. Rolnick · 2017
Later among the works it cites.
Provable limitations of deep learning
E. Abbe and C. Sandon · 2018
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
J. Martens and V. Medabalimi · 2014
Cited alongside, same era.
D. Rolnick and M. Tegmark · 2018
Later among the works it cites.