Fetching the paper…
Reading the bibliography…
In this manuscript, we study the properties of a family of second-order differential equations with damping, its discretizations and their connections with accelerated optimization algorithms for $m$-strongly convex and $L$-smooth functions.
Some methods of speeding up the convergence of iteration methods
B.T. Polyak · 1964
Earlier work this paper cites.
Error analysis for a class of methods for stiff non-linear initial value problems
G. G. Dahlquist · 1976
Earlier work this paper cites.
On the scope of the method of modified equations
D. F. Griffiths and J. M. Sanz-Serna · 1986
Earlier work this paper cites.
Markov Chains and Stochastic Stability
S.P. Meyn and R.L. Tweedie · 1993
Earlier work this paper cites.
Solving ordinary differential equations II. Stiff and differential-algebraic problems
Ernst Hairer and Gerhard Wanner · 1996
Earlier work this paper cites.
Ergodic properties of dissipative differential equations subject to random impulses
J.M. Sanz-Serna and A.M. Stuart · 1999
Earlier work this paper cites.
On the existence and the applications of modified equations for stochastic differential equations
K. C. Zygalakis · 2011
Earlier work this paper cites.
Introductory Lectures on Convex Optimization: A Basic Course
Y. Nesterov · 2014
Earlier work this paper cites.
Global convergence of the heavy-ball method for convex optimization
E. Ghadimi, H. R. Feyzmahdavian, and M. Johansson · 2015
Earlier work this paper cites.
Accelerated mirror descent in continuous and discrete time
Walid Krichene, Alexandre Bayen, and Peter L Bartlett · 2015
Earlier work this paper cites.
Numerical methods for ordinary differential equations
J. C. Butcher · 2016
Earlier work this paper cites.
Analysis and design of optimization algorithms via integral quadratic constraints
Laurent Lessard, Benjamin Recht, and Andrew Packard · 2016
Earlier work this paper cites.
Regularized nonlinear acceleration
Damien Scieur, Alexandre d’Aspremont, and Francis Bach · 2016
Cited alongside, same era.
A differential equation for modeling nesterov’s accelerated gradient method: Theory and insights
W. Su, S. Boyd, and E. J. Candès · 2016
Cited alongside, same era.
A variational perspective on accelerated methods in optimization
A. Wibisono, A. C. Wilson, and M. I. Jordan · 2016
Cited alongside, same era.
A Lyapunov analysis of momentum methods in optimization
Ashia C. Wilson, Benjamin Recht, and Michael I. Jordan · 2016
Cited alongside, same era.
Randomized hamiltonian monte carlo
Nawaf Bou-Rabee and Jesús María Sanz-Serna · 2017
Cited alongside, same era.
Lyapunov functions: An optimization theory perspective
Boris Polyak and Pavel Shcherbakov · 2017
Understanding the acceleration phenomenon via high-resolution differential equations, 2018
Bin Shi, Simon S. Du, Michael I. Jordan, and Weijie J. Su · 2018
Later among the works it cites.
The physical systems behind optimization algorithms
Lin Yang, Raman Arora, Vladimir braverman, and Tuo Zhao · 2018
Later among the works it cites.
Optimization algorithms inspired by the geometry of dissipative systems, 2019
Alessandro Bravetti, Maria L. Daza-Torres, Hugo Flores-Arguedas, and Michael Betancourt · 2019
Later among the works it cites.
A dynamical systems perspective on Nesterov acceleration
Michael Muehlebach and Michael Jordan · 2019
Later among the works it cites.
Shadowing properties of optimization algorithms
Antonio Orvieto and Aurelien Lucchi · 2019
Later among the works it cites.
Acceleration via symplectic discretization of high-resolution differential equations
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Integration methods and optimization algorithms
D. Scieur, V. Roulet, F. R. Bach, and A. d’Aspremont · 2017
Cited alongside, same era.
Michael Betancourt, Michael I. Jordan, and Ashia C. Wilson · 2018
Cited alongside, same era.
A geometric integration approach to smooth optimisation: Foundations of the discrete gradient method, 2018
M. J. Ehrhardt, E. S. Riis, T. Ringholm, and C.-B. Schönlieb · 2018
Cited alongside, same era.
Analysis of optimization algorithms via integral quadratic constraints: nonstrongly convex problems
Mahyar Fazlyab, Alejandro Ribeiro, Manfred Morari, and Victor M. Preciado · 2018
Cited alongside, same era.
Numerical Hamiltonian Problems
J.M. Sanz-Serna and M.P. Calvo · 2018
Cited alongside, same era.
Bin Shi, Simon S Du, Weijie Su, and Michael I Jordan · 2019
Later among the works it cites.
Discrete processes and their continuous limits
Uri M. Ascher · 2020
Closest in time.
On dissipative symplectic integration with applications to gradient-based optimization, 2020
Guilherme França, Michael I. Jordan, and René Vidal · 2020
Closest in time.
A lyapunov analysis for accelerated gradient methods: from deterministic to stochastic case
Maxime Laborde and Adam Oberman · 2020
Closest in time.
Optimization with momentum: Dynamical, control-theoretic, and symplectic perspectives, 2020
Michael Muehlebach and Michael I. Jordan · 2020
Closest in time.
Contractivity of runge–kutta methods for convex gradient systems
J. M. Sanz Serna and K. C. Zygalakis · 2020
Closest in time.