Fetching the paper…
Reading the bibliography…
Continuous-depth neural networks can be viewed as deep limits of discrete neural networks whose dynamics resemble a discretization of an ordinary differential equation (ODE).
Robust learning with implicit residual networks
V. Reshniak and C. Webster · 1905
Earlier work this paper cites.
Barron spaces and the compositional function spaces for neural network models
W. E, C. Ma, and L. Wu · 1906
Earlier work this paper cites.
Deep learning theory review: An optimal control and dynamical systems perspective
G.-H. Liu and E. A. Theodorou · 1908
Earlier work this paper cites.
Variational integrator networks for physically meaningful embeddings
S. Sæmundsson, A. Terenin, K. Hofmann, and M. P. Deisenroth · 1910
Earlier work this paper cites.
Applied optimal control: optimization, estimation, and control. 1975
A. Bryson and Y. Ho · 1975
Earlier work this paper cites.
Mathematical Methods of Classical Mechanics
V. I. Arnold · 1978
Earlier work this paper cites.
Math. Control Signals Syst
Approximation by superpositions of a sigmoidal function · 1989
Earlier work this paper cites.
Finite difference and spectral methods for ordinary and partial differential equations
L. N. Trefethen · 1996
Earlier work this paper cites.
A computational fluid mechanics solution to the Monge-Kantorovich mass transfer problem
J.-D. Benamou and Y. Brenier · 2000
Earlier work this paper cites.
S. Massaroli, M. Poli, J. Park, A. Yamashita, and H. Asama · 2002
Earlier work this paper cites.
Rademacher and gaussian complexities: Risk bounds and structural results
P. L. Bartlett and S. Mendelson · 2003
Earlier work this paper cites.
Geodesic shooting for computational anatomy
M. Miller, A. Trouvé, and L. Younes · 2006
Earlier work this paper cites.
Numerical recipes 3rd edition: The art of scientific computing
W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery · 2007
Earlier work this paper cites.
Evaluating derivatives: principles and techniques of algorithmic differentiation
A. Griewank and A. Walther · 2008
Earlier work this paper cites.
The recurrent temporal restricted Boltzmann machine
I. Sutskever, G. Hinton, and G. Taylor · 2009
Earlier work this paper cites.
Shapes and Diffeomorphisms
L. Younes · 2010
Cited alongside, same era.
Geodesic regression for image time-series
M. Niethammer, Y. Huang, and F.-X. Vialard · 2011
Cited alongside, same era.
Optimization with sparsity-inducing penalties
F. Bach, R. Jenatton, J. Mairal, and G. Obozinski · 2012
Cited alongside, same era.
Variational calculus and optimal control: optimization with elementary convexity
J. L. Troutman · 2012
Cited alongside, same era.
Optimal control: an introduction to the theory and its applications
M. Athans and P. L. Falb · 2013
Cited alongside, same era.
The shooting approach to optimal control problems
J. F. Bonnans · 2013
Cited alongside, same era.
Neural ordinary differential equations
R. T. Q. Chen, Y. Rubanova, J. Bettencourt, and D. K. Duvenaud · 2018
Later among the works it cites.
i-RevNet: Deep invertible networks
J.-H. Jacobsen, A. Smeulders, and E. Oyallon · 2018
Later among the works it cites.
L. Younes · 2018
Later among the works it cites.
Deep equilibrium models
S. Bai, J. Z. Kolter, and V. Koltun · 2019
Later among the works it cites.
Invertible residual networks
J. Behrmann, W. Grathwohl, R. T. Chen, D. Duvenaud, and J.-H. Jacobsen · 2019
Later among the works it cites.
Augmented neural ODEs
E. Dupont, A. Doucet, and Y. W. Teh · 2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
K. He, X. Zhang, S. Ren, and J. Sun · 2016
Cited alongside, same era.
Identity mappings in deep residual networks
K. He, X. Zhang, S. Ren, and J. Sun · 2016
Cited alongside, same era.
A vector-contraction inequality for rademacher complexities
A. Maurer · 2016
Cited alongside, same era.
OptNet: Differentiable optimization as a layer in neural networks
B. Amos and J. Z. Kolter · 2017
Cited alongside, same era.
On completeness of groups of diffeomorphisms
M. Bruveris and F.-X. Vialard · 2017
Cited alongside, same era.
Stable architectures for deep neural networks
E. Haber and L. Ruthotto · 2017
Cited alongside, same era.
ANODE: Unconditionally accurate memory-efficient gradients for neural odes
A. Gholami, K. Keutzer, and G. Biros · 2019
Later among the works it cites.
Deep neural networks motivated by partial differential equations
L. Ruthotto and E. Haber · 2019
Later among the works it cites.
High-Dimensional Statistics: A Non-asymptotic Viewpoint
M. J. Wainwright · 2019
Later among the works it cites.
ODE 2 VAE: Deep generative second order ODEs with Bayesian neural networks
C. Yildiz, M. Heinonen, and H. Lahdesmaki · 2019
Later among the works it cites.
ANODEV2: A coupled neural ODE framework
T. Zhang, Z. Yao, A. Gholami, J. E. Gonzalez, K. Keutzer, M. W. Mahoney, and G. Biros · 2019
Later among the works it cites.
How to train your neural ODE: the world of Jacobian and kinetic regularization
C. Finlay, J.-H. Jacobsen, L. Nurbekyan, and A. M. Oberman · 2020
Closest in time.
Hamiltonian generative networks
P. Toth, D. J. Rezende, A. Jaegle, S. Racanière, A. Botev, and I. Higgins · 2020
Closest in time.
Approximation Capabilities of Neural ODEs and Invertible Residual Networks
H. Zhang, X. Gao, J. Unterman, and T. Arodz · 2020
Closest in time.