Fetching the paper…
Reading the bibliography…
This paper addresses the following question of neural network identifiability: Does the input-output map realized by a feed-forward neural network with respect to a given nonlinearity uniquely specify the network architecture, weights, and biases? Existing literature on the subject Sussman 1992, Albertini, Sontag et al.
L. Kronecker, Werke (Näherungsweise ganzzahlige Auflösung linearer Gleichungen) . reprint, Chelsea, 1979, vol. 3
1979
Earlier work this paper cites.
W. Rudin, Real and Complex Analysis , 3rd ed., ser. Higher Mathematics. McGraw-Hill, 1987
1987
Earlier work this paper cites.
K. Hornik, M. Stinchcombe, and H. White, “Multilayer feedforward networks are universal approximators,” Neural Networks , vol. 2, no. 5, pp. 359–366, 1989
1989
Earlier work this paper cites.
G. Cybenko, “Approximation by superpositions of a sigmoidal function,” Mathematics of Control, Signals, and Systems , vol. 2, no. 4, pp. 303–314, Dec. 1989
1989
Earlier work this paper cites.
H. J. Sussman, “Uniqueness of the weights for minimal feedforward nets with a given input-output map,” Neural Networks , vol. 5, no. 4, pp. 589–593, July 1992
1992
Earlier work this paper cites.
F. Albertini, E. D. Sontag, and V. Maillot, “Uniqueness of weights for neural networks,” Artificial Neural Networks for Speech and Vision , pp. 113–125, 1993
1993
Earlier work this paper cites.
F. Albertini and E. D. Sontag, “For neural networks, function determines form,” Neural Networks , vol. 6, pp. 975–990, 1993
1993
Earlier work this paper cites.
——, “Uniqueness of weights for recurrent networks,” vol. 2. Akademie Verlag, Regensburg, 1993, pp. 599–602
1993
Cited alongside, same era.
C. Fefferman, “Reconstructing a neural net from its output,” Revista Matemática Iberoamericana , vol. 10, no. 3, pp. 507–555, 1994
1994
Cited alongside, same era.
Y. LeCun, L. D. Jackel, L. Bottou, A. Brunot, C. Cortes, J. S. Denker, H. Drucker, I. Guyon, U. A. Müller, E. Säckinger, P. Simard, and V. Vapnik, “Comparison of learning algorithms for handwritten digit recognition,” International Conference on Artificial Neural Networks , pp. 53–60, 1995
1995
Cited alongside, same era.
V. Scheidemann, Introduction to Complex Analysis in Several Variables . Birkhäuser, 2005
2005
Cited alongside, same era.
A. Bonday and M. R. Murty, Graph Theory , ser. Graduate Texts in Mathematics. Springer, 2008
2008
S. Mallat, “Group invariant scattering,” Comm. Pure and Appl. Math. , vol. 65, no. 10, pp. 1331–1398, 2012
2012
Later among the works it cites.
D. Garling, A Course in Mathematical Analysis . Cambridge University Press, 2013, vol. 2
2013
Later among the works it cites.
B. C. Hall, Lie Groups, Lie Algebras, and Representations: An Elementary Introduction , 2nd ed., ser. Graduate Texts in Mathematics. Springer, 2015
2015
Later among the works it cites.
I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning . MIT Press, 2016
2016
Later among the works it cites.
P. Petersen and F. Voigtländer, “Optimal approximation of piecewise smooth functions using deep ReLU neural networks,” Neural Networks , no. 108, pp. 296–330, 2018
2018
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” in Advances in Neural Information Processing Systems 25 . Curran Associates, Inc., 2012, pp. 1097–1105. [Online]. Available: http://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf
2012
Cited alongside, same era.
G. Hinton, L. Deng, D. Yu, G. E. Dahl, A. R. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath, and B. Kingsbury, “Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups,” IEEE Signal Process. Mag. , vol. 29, no. 6, pp. 82–97, 2012
2012
Cited alongside, same era.
T. Wiatowski and H. Bölcskei, “A mathematical theory of deep convolutional neural networks for feature extraction,” IEEE Transactions on Information Theory , vol. 64, no. 3, pp. 1845–1866, Mar. 2018
2018
Later among the works it cites.
H. Bölcskei, P. Grohs, G. Kutyniok, and P. Petersen, “Optimal approximation with sparsely connected deep neural networks,” SIAM Journal on Mathematics of Data Science , vol. 1, no. 1, pp. 8–45, 2019
2019
Closest in time.