Criticality & Deep Learning I: Generally Weighted Nets

J. J. Hopfield, ”Neural Networks and physical systems with emergent collective computational abilities,” Proceedings of the National Academy of Science, USA, 79 (1982) 2554-2558

1982

Earlier work this paper cites.

Carsten Peterson, James R . Anderson, ”A Mean Field Theory Learning Algorithm for Neural Networks”, Complex Systems 1 (1987) 995- 1019

1987

Earlier work this paper cites.

Stuart A. Kauffman, ”The Origins of Order: Self-Organization and Selection in Evolution”, Oxford University Press, 1993

1993

Earlier work this paper cites.

Per Bak, ”How Nature Works: the science of self-organized criticality”, Copernicus Springer-Verlag, New York, 1996

1996

Earlier work this paper cites.

Silvio Salinas, ”Introduction to statistical physics”, Springer, 2001

2001

Cited alongside, same era.

Kim Christensen, Nicholas R. Moloney, ”Complexity and Criticality (Advanced Physics Texts)”, Imperial College Press, 2005

2005

Cited alongside, same era.

Thomas M. Cover, Joy A. Thomas, ”Elements of Information Theory”, Wiley Series, 2006

2006

Cited alongside, same era.

Uwe C. Tauber, ”Renormalization Group: Applications in Statistical Physics”, Nuclear Physics B, (2011) 1–28

2011

Cited alongside, same era.

Thierry Mora, William Bialek, ”Are biological systems poised at criticality?”, arXiv:1012.2242 [q-bio.QM]

Original

Cited in the paper.

Kunihiko Fukushima, ”Neocognitron: A Self-organizing Neural Network Model for a Mechanism of Pattern Recognition Unaffected by Shift in Position” www.cs.princeton.edu/courses/archive/spr08/cos598B/Readings/Fukushima1980.pdf

Cited in the paper.

Adriano Barra,Giuseppe Genovese, Peter Sollich, Daniele Tantari, ”Phase transitions in Restricted Boltzmann Machines with generic priors”, arXiv:1612.03132 [cond-mat.dis-nn]

Original

Cited in the paper.

Adriano Barra, Alberto Bernacchia, Enrica Santucci, Pierluigi Contucci, ”On the equivalence of Hopfield Networks and Boltzmann Machines”, arXiv:1105.2790 [cond-mat.dis-nn]

Original

Cited in the paper.

Anna Choromanska, Mikael Henaff, Michael Mathieu, Gerard Ben Arous, Yann LeCun, ”The Loss Surfaces of Multilayer Networks”, arXiv:1412.0233 [cs.LG]

Original

Cited in the paper.

Gasper Tkacik, Elad Schneidman, Michael J. Berry II, William Bialek, ”Spin glass models for a network of real neurons”, arXiv:0912.5409 [q-bio.NC]

Original

Cited in the paper.

Hanna Kamyshanska, Roland Memisevic, ”The Potential Energy of an Autoencoder” https://www.iro.umontreal.ca/~memisevr/pubs/AEenergy.pdf

Cited in the paper.

H.E. Stanley, ”Scaling,universality and renormalization:three pillars of modern critical phenomena”, http://journals.aps.org/rmp/abstract/10.1103/RevModPhys.71.S358

Cited in the paper.

Lesne Annick, Lagues Michel, ”Scale Invariance, From Phase Transitions to Turbulence”, Springer, 2012

2012

Later among the works it cites.

Gunnar Pruessner, ”Self-organised criticality”, Cambridge University Press, 2012

2012

Later among the works it cites.

Philip Ball, ”One rule of life: Are we poised on the border of order?”, New Scientist, April 2014

2014

Later among the works it cites.