Fetching the paper…
Reading the bibliography…
It has been observed that residual networks can be viewed as the explicit Euler discretization of an Ordinary Differential Equation (ODE).
A. Lindenmayer, “Mathematical models for cellular interactions in development i. filaments with one-sided inputs,”
1968
Earlier work this paper cites.
A. M. Turing, “The chemical basis of morphogenesis,”
1990
Earlier work this paper cites.
J. Schmidhuber, “Learning to control fast-weight memories: An alternative to dynamic recurrent networks,”
1992
Earlier work this paper cites.
R. K. Belew and T. E. Kammeyer, “Evolving aesthetic sorting networks using developmental grammars.,” in
1993
Earlier work this paper cites.
J. Schmidhuber, “A ‘self-referential’weight matrix,” in
1993
Earlier work this paper cites.
F. Dellaert and R. D. Beer, “A developmental model for the evolution of complete autonomous agents,” in
1996
Earlier work this paper cites.
P. Eggenberger, “Evolving morphologies of simulated 3d organisms based on differential gene expression,” in
1997
Earlier work this paper cites.
P. Bentley and S. Kumar, “Three ways to grow designs: A comparison of embryogenies for an evolutionary design problem,” in
1999
Earlier work this paper cites.
G. S. Hornby and J. B. Pollack, “Creating high-level components with a generative representation for body-brain evolution,”
2002
Earlier work this paper cites.
K. O. Stanley, “Exploiting regularity without development,” in
2006
Cited alongside, same era.
K. O. Stanley, “Compositional pattern producing networks: A novel abstraction of development,”
2007
Cited alongside, same era.
K. O. Stanley, D. B. D’Ambrosio, and J. Gauci, “A hypercube-based encoding for evolving large-scale neural networks,”
2009
Cited alongside, same era.
J. Koutnik, F. Gomez, and J. Schmidhuber, “Evolving neural networks in compressed weight space,” in
2010
Cited alongside, same era.
Springer Science & Business Media, 2010
L. Younes, · 2010
Cited alongside, same era.
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in
2016
Cited alongside, same era.
E. Weinan, “A proposal on machine learning via dynamical systems,”
2017
Later among the works it cites.
E. Haber and L. Ruthotto, “Stable architectures for deep neural networks,”
2017
Later among the works it cites.
D. Ha, A. Dai, and Q. Le, “HyperNetworks,” in
2017
Later among the works it cites.
L. Ruthotto and E. Haber, “Deep neural networks motivated by partial differential equations,”
2018
Later among the works it cites.
Y. Lu, A. Zhong, Q. Li, and B. Dong, “Beyond finite layer neural networks: Bridging deep architectures and numerical differential equations,” in
2018
Later among the works it cites.
M. Ciccone, M. Gallieri, J. Masci, C. Osendorfer, and F. Gomez, “NAIS-Net: stable deep networks from non-autonomous differential equations,” in
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
K. He, X. Zhang, S. Ren, and J. Sun, “Identity mappings in deep residual networks,” in
2016
Cited alongside, same era.
C. Fernando, D. Banarse, M. Reynolds, F. Besse, D. Pfau, M. Jaderberg, M. Lanctot, and D. Wierstra, “Convolution by evolution: Differentiable pattern producing networks,” in
2016
Cited alongside, same era.
2018
Later among the works it cites.
T. Q. Chen, Y. Rubanova, J. Bettencourt, and D. K. Duvenaud, “Neural ordinary differential equations,” in
2018
Later among the works it cites.