Fetching the paper…
Reading the bibliography…
The function space of deep-learning machines is investigated by studying growth in the entropy of functions of a given error with respect to a reference function, realized by a deep-learning machine.
C. De Dominicis, “Dynamics as a substitute for replicas in systems with quenched random impurities,” Phys. Rev. B
1978
Earlier work this paper cites.
C. De Dominicis,
1978
Earlier work this paper cites.
E. Gardner, “The space of interactions in neural network models,” Journal of Physics A: Mathematical and General
1988
Earlier work this paper cites.
D. B. Schwartz, V. K. Samalam, S. A. Solla, and J. S. Denker, “Exhaustive learning,” Neural Computation
1990
Earlier work this paper cites.
P. Savický, “Random boolean formulas representing any boolean function with asymptotically equal probability,” Discrete Mathematics
1990
Earlier work this paper cites.
D. B. Schwartz, V. K. Samalam, S. A. Solla, and J. S. Denker,
1990
Earlier work this paper cites.
Addison-Wesley, 1991
J. Hertz, A. Krogh, and R. Palmer, Introduction To The Theory Of Neural Computation · 1991
Earlier work this paper cites.
H. S. Seung, H. Sompolinsky, and N. Tishby, “Statistical mechanics of learning from examples,” Phys. Rev. A
1992
Earlier work this paper cites.
H. S. Seung, H. Sompolinsky, and N. Tishby,
1992
Earlier work this paper cites.
T. L. H. Watkin, A. Rau, and M. Biehl, “The statistical mechanics of learning a rule,” Rev. Mod. Phys
1993
Earlier work this paper cites.
D. Saad and S. A. Solla, “Exact solution for on-line learning in multilayer neural networks,” Phys. Rev. Lett
1995
Earlier work this paper cites.
Cambridge University Press, 1998
D. Saad, ed., On-Line Learning in Neural Networks · 1998
Earlier work this paper cites.
Y. LeCun, C. Cortes, and C. J. Burges. The MNIST Database of Handwritten Digits (1998), http://yann.lecun.com/exdb/mnist/
1998
Cited alongside, same era.
New York: Cambridge University Press, 2001
A. Engel and C. V. d. Broeck, Statistical Mechanics of Learning · 2001
Cited alongside, same era.
A. Engel and C. V. d. Broeck,
2001
Cited alongside, same era.
J. P. L. Hatchett, B. Wemmenhove, I. P. Castillo, T. Nikoletopoulos, N. S. Skantzos, and A. C. C. Coolen, “Parallel dynamics of disordered ising spin systems on finitely connected random graphs,” Journal of Physics A: Mathematical and General
2004
Cited alongside, same era.
A. Mozeika, D. Saad, and J. Raymond, “Computing with noise: Phase transitions in boolean formulas,” Phys. Rev. Lett
2009
Cited alongside, same era.
W. Shang, K. Sohn, D. Almeida, and H. Lee, “Understanding and improving convolutional neural networks via concatenated rectified linear units,” in Proceedings of The 33rd International Conference on Machine Learning, New York, 2016
2016
Later among the works it cites.
B. Poole, S. Lahiri, M. Raghu, J. Sohl-Dickstein, and S. Ganguli, “Exponential expressivity in deep neural networks through transient chaos,” in Advances in Neural Information Processing Systems 29
2016
Later among the works it cites.
M. Rastegari, V. Ordonez, J. Redmon, and A. Farhadi, “Xnor-net: Imagenet classification using binary convolutional neural networks,” in Computer Vision – ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part IV
2016
Later among the works it cites.
B. Poole, S. Lahiri, M. Raghu, J. Sohl-Dickstein, and S. Ganguli, in
2016
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
A. Mozeika, D. Saad, and J. Raymond, “Noisy random boolean formulae: A statistical physics perspective,” Phys. Rev. E
2010
Cited alongside, same era.
A. Mozeika, D. Saad, and J. Raymond,
2010
Cited alongside, same era.
M. D. Zeiler and R. Fergus, “Visualizing and understanding convolutional networks,” in Computer Vision – ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part I
2014
Cited alongside, same era.
Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature
2015
Cited alongside, same era.
2015
Cited alongside, same era.
2015
Cited alongside, same era.
J. T. Springenberg, A. Dosovitskiy, T. Brox, and M. Riedmiller,
2015
Cited alongside, same era.
W. Shang, K. Sohn, D. Almeida, and H. Lee, in
2016
Later among the works it cites.
M. Elad, “Deep, deep trouble.” siam news, https://sinews.siam.org/Details-Page/deep-deep-trouble, 2017
2017
Closest in time.
C. Zhang, S. Bengio, M. Hardt, B. Recht, and O. Vinyals, “Understanding deep learning requires rethinking generalization,” in Proceedings of the 5th International Conference on Learning Representations, 2017
2017
Closest in time.
P. Chaudhari, A. Choromanska, S. Soatto, Y. LeCun, C. Baldassi, C. Borgs, J. Chayes, L. Sagun, and R. Zecchina, “Entropy-sgd: Biasing gradient descent into wide valleys,” in Proceedings of the 5th International Conference on Learning Representations, 2017
2017
Closest in time.
B. Neyshabur, S. Bhojanapalli, D. McAllester, and N. Srebro, “Exploring generalization in deep learning,” in Advances in Neural Information Processing Systems 30
2017
Closest in time.
M. Raghu, B. Poole, J. Kleinberg, S. Ganguli, and J. Sohl-Dickstein, “On the expressive power of deep neural networks,” in Proceedings of the 34th International Conference on Machine Learning, Sydney, 2017
2017
Closest in time.
J. Lee, J. Sohl-dickstein, J. Pennington, R. Novak, S. Schoenholz, and Y. Bahri, “Deep neural networks as gaussian processes,” in Proceedings of the 6th International Conference on Learning Representations, 2018
2018
Closest in time.
J. Lee, J. Sohl-dickstein, J. Pennington, R. Novak, S. Schoenholz, and Y. Bahri,
2018
Closest in time.