Fetching the paper…
Reading the bibliography…
Our approach is part of the close link between continuous dissipative dynamical systems and optimization algorithms.
The harmonic functions associated with the parabolic cylinder
G.N. Watson · 1918
Earlier work this paper cites.
A stochastic approximation method
Herbert Robins and Sutton Monro · 1951
Earlier work this paper cites.
Some methods of speeding up the convergence of iteration methods
Boris Polyak · 1964
Earlier work this paper cites.
Weak convergence of the sequence of successive approximations for nonexpansive mappings
Z. Opial · 1967
Earlier work this paper cites.
Convex analysis
R.T. Rockafellar · 1997
Earlier work this paper cites.
A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics
F. Alvarez, H. Attouch, J. Bolte, and P. Redont · 2002
Earlier work this paper cites.
Stochastic differential equations and applications
Xuerong Mao · 2007
Earlier work this paper cites.
On the long time behavior of second order differential equations with asymptotically small dissipation
Alexandre Cabot, Hans Engler, and Gadat Sébastien · 2009
Earlier work this paper cites.
Nist handbook of mathematical functions
F.W.J. Olver, D.w. Lozier, R.F Boisvert, and Clarck C.W · 2010
Earlier work this paper cites.
The heavy ball with friction method. i- the continuous dynamical system
Hedy Attouch, Xavier Goudou, and Patrick Redont · 2011
Earlier work this paper cites.
Convergence rates of inexact proximal-gradient methods for convex optimization
M. Schmidt, N. Le Roux, and F. Bach · 2011
Earlier work this paper cites.
Stochastic differential equations in infinite dimensions
Leszek Gawarecki and Vidyadhar Mandrekar · 2011
Earlier work this paper cites.
On a second order dissipative ODE in Hilbert space with an integrable source term
A. Haraux and Jendoubi M.A · 2012
Earlier work this paper cites.
Accelerated and inexact forward-backward
S. Villa, S. Salzo, and Baldassarres L · 2013
Earlier work this paper cites.
Stochastic processes and applications
Grigorios A. Pavliotis · 2014
Earlier work this paper cites.
Long time behaviour and stationary regime of memory gradient diffusions
Sébastien Gadat and Fabien Panloup · 2014
Earlier work this paper cites.
Stability of over-relaxations for the forward-backward algorithm, application to fista
C. Dossal and J.F. Aujol · 2015
Earlier work this paper cites.
Un-regularizing: approximate proximal point and faster stochastic algorithms for empirical risk minimization
R. Frostig, S. Kakade R. Ge, and A. Sidford · 2015
Earlier work this paper cites.
From error bounds to the complexity of first-order descent methods for convex functions
J. Bolte, T.P. Nguyen, J. Peypouquet, and B. W. Suter · 2016
Earlier work this paper cites.
A differential equation for modeling Nesterov’s accelerated gradient method: Theory and insights
Weijie Su, Stephen Boyd, and Emmanuel J. Candès · 2016
Earlier work this paper cites.
The rate of convergence of Nesterov’s accelerated forward-backward method is actually faster than
Hedy Attouch and Juan Peypouquet · 2016
Earlier work this paper cites.
Fast convex optimization via inertial dynamics with Hessian driven damping
Hedy Attouch, Juan Peypouquet, and Patrick Redont · 2016
Earlier work this paper cites.
A variational analysis of stochastic gradient algorithms
S. Mandt, M. Hoffman, and D. Blei · 2016
Earlier work this paper cites.
Fast convex minimization via inertial dynamics with Hessian driven damping
H. Attouch, J. Peypouquet, and P. Redont · 2016
Cited alongside, same era.
Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity
H. Attouch and A. Cabot · 2017
Cited alongside, same era.
Asymptotic for a second order evolution equation with convex potential and vanishing damping term
Ramzi May · 2017
Cited alongside, same era.
Stochastic modified equations and adaptive stochastic gradient algorithms
Qianxiao Li, Cheng Tai, and Weinan E · 2017
Cited alongside, same era.
Underdamped Langevin MCMC: A non-asymptotic analysis
Xiang Cheng, Niladri S. Chatterji, Peter L. Bartlett, and Michael I. Jordan · 2017
Cited alongside, same era.
First-order and stochastic optimization methods for machine learning
Guanghui Lan · 2020
Later among the works it cites.
An extension of the second order dynamical system that models Nesterov convex gradient method
C. Alecsa, S. László, and T. Pinta · 2021
Later among the works it cites.
Optimization with momentum: dynamical, control-theoretic, and symplectic perspectives
Michael Muehlebach and Michael I. Jordan · 2021
Later among the works it cites.
On the validity of modeling sgd with stochastic differential equations
Zhiyuan Li, Sadhika Malladi, and Sanjeev Arora · 2021
Later among the works it cites.
A diffusion theory for deep learning dynamics: Stochastic gradient descent exponentially favors flat minima
Z. Xie, I. Sato, and M. Sugiyama · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity
Hedy Attouch and Alexandre Cabot · 2017
Cited alongside, same era.
Catalyst acceleration for first-order convex optimization: from theory to practice
Hongzhou Lin, Julien Mairal, and Zaid Harchaoui · 2017
Cited alongside, same era.
Parallelizing stochastic gradient descent for least squares regression: mini-batching, averaging, and model misspecification
Prateek Jain, Praneeth Netrapalli, Sham M. Kakade, Rahul Kidambi, and Aaron Sidford · 2017
Cited alongside, same era.
Katyusha: the first direct acceleration of stochastic gradient methods
Zeyuan Allen-Zhu · 2017
Cited alongside, same era.
Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
H. Attouch, Z. Chbani, J. Peypouquet, and P. Redont · 2018
Cited alongside, same era.
On the diffusion approximation of nonconvex stochastic gradient descent
Wenqing Hu, Chris Junchi Li, Lei Li, and Jian-Guo Lui · 2018
Cited alongside, same era.
Stochastic gradient descent performs variational inference, converges to limit cycles for deep networks
S. Soatto and P. Chaudhari · 2018
Cited alongside, same era.
Analysis of stochastic gradient descent in continuous time
J. Latz · 2021
Later among the works it cites.
Is there an analog of Nesterov acceleration for MCMC?
Yi-An Ma, Niladri Chatterji, Xiang Cheng, Nicolas Flammarion, Peter Bartlett, and Michael I. Jordan · 2021
Later among the works it cites.
Understanding the acceleration phenomenon via high resolution differential equations
B. Shi, S.S. Du, M.I. Jordan, and Su W.J · 2021
Later among the works it cites.
Convergence of iterates for first-order optimization algorithms with inertia and Hessian driven damping
H. Attouch, Z. Chbani, J. Fadili, and H. Riahi · 2021
Later among the works it cites.
First-order optimization algorithms via inertial systems with Hessian driven damping
Hedy Attouch, Zaki Chbani, Jalal Fadili, and Hassan Riahi · 2022
Later among the works it cites.
Fast convex optimization via inertial dynamics combining viscous and Hessian-driven damping with time rescaling
Hedy Attouch, Aïcha Balhag, Zaki Chbani, and Hassan Riahi · 2022
Later among the works it cites.
An SDE perspective on stochastic convex optimization
Rodrigo Maulen S., Jalal Fadili, and Hedy Attouch · 2022
Later among the works it cites.
Stochastic differential equations for modeling first order optimization methods
M. Dambrine, C. Dossal, B. Puig, and A. Rondepierre · 2022
Later among the works it cites.
Adaptivity without compromise: a momentumized, adaptive, dual averaged gradient method for stochastic optimization
Aaron Defazio and Samy Jelassi · 2022
Later among the works it cites.
Accelerating variance-reduced stochastic gradient methods
Derek Driggs, Matthias J. Ehrhardt, and Carola-Bibiane Schönlieb · 2022
Later among the works it cites.
Fast convex optimization via time scale and averaging of the steepest descent
Hedy Attouch, Radu Ioan Bot, and Dang-Khoa Nguyen · 2022
Later among the works it cites.
On learning rates and Schrödinger operators
Bin Shi, Weijie J. Su, and Michael I. Jordan · 2023
Later among the works it cites.
On the effect of perturbations in first-order optimization methods with inertia and Hessian driven damping
Hedy Attouch, Jalal Fadili, and Vyacheslav Kungurtsev · 2023
Later among the works it cites.
Tikhonov regularization for stochastic non-smooth convex optimization in Hilbert spaces
Rodrigo Maulen-Soto, Jalal Fadili, and Hedy Attouch · 2024
Closest in time.
A Hessian-aware stochastic differential equation for modelling SGD
X. Li, Z. Shen, L. Zhang, and N. He · 2024
Closest in time.
Stochastic inertial dynamics via time scaling and averaging
Rodrigo Maulen-Soto, Jalal Fadili, Hedy Attouch, and Peter Ochs · 2024
Closest in time.
Sharper bounds for proximal gradient algorithms with errors
Anis Hamadouche, Yun Wu, Andrew M. Wallace, and João F. C. Mota · 2024
Closest in time.
The stochastic ravine accelerated gradient method with general extrapolation coefficients, 2024
Hedy Attouch, Jalal Fadili, and Vyacheslav Kungurtsev · 2024
Closest in time.