Fetching the paper…
Reading the bibliography…
We interpret the variational inference of the Stochastic Gradient Descent (SGD) as minimizing a new potential function named the \textit{quasi-potential}.
Space–time approach to non–relativistic quantum mechanics
R.P. Feynmann · 1948
Earlier work this paper cites.
On small random perturbations of dynamical systems
A. Ventsel’ and M. Freidlin · 1970
Earlier work this paper cites.
Memoir on the probability of causes of events. Mèmoires de Mathèmatique et de Physique, Tome Sixiéme. (English translation by S. M. Stigler 1986.)
P.S. Laplace · 1986
Earlier work this paper cites.
Large Deviations Techniques and Applications, Second Edition
A. Dembo and O. Zeitouni · 1998
Earlier work this paper cites.
Random perturbations of dynamical systems (2nd ed)
M. Freidlin and A. Wentzell · 1998
Earlier work this paper cites.
Stochastic Differential Equations
B. Øksendal · 2003
Earlier work this paper cites.
Large-scale machine learning with stochastic gradient descent
L. Bottou · 2010
Earlier work this paper cites.
On perturbations of the generalized Landau–Lifschitz dynamics
M. Freidlin and W. Hu · 2011
Earlier work this paper cites.
Random perturbations of dynamical systems (3rd ed)
M. Freidlin and A. Wentzell · 2012
Earlier work this paper cites.
On metastability in nearly-elastic systems
W. Hu · 2012
Earlier work this paper cites.
Non–strongly–convex smooth stochastic approximation with convergence rate o ( 1 / n ) o(1/n)
F. Bach and E. Moulines · 2013
Cited alongside, same era.
Random perturbations of dynamical systems with reflecting boundary and corresponding PDE with a small parameter
W. Hu and L. Tcheuko · 2014
Cited alongside, same era.
From averaging to accelaration, there is only a step–size
N. Flammarion and F. Bach · 2015
Cited alongside, same era.
Escaping From Saddle Points–Online Stochastic Gradient for Tensor Decomposition
Chi Jin, Rong Ge, Furong Huang, and Yang Yuan · 2015
Cited alongside, same era.
Early stopping as non–parametric variational inference
D. Duvenaud, D. Maclaurin, and R. Adams · 2016
Cited alongside, same era.
Construction of the landscape for multi–stable systems: Potential landscape, quasi–potential, A–type integral and beyond
Stochastic modified equations and adapetive stochastic gradient algorithms
Q. Li, C. Tai, and W. E · 2017
Later among the works it cites.
Stochastic Gradient Descent as Approximate Bayesian Inference
S. Mandt, M.D. Hoffman, and D.M. Blei · 2017
Later among the works it cites.
Opening the black box of deep neural networks via information
R. Shiwarz-Ziv and N. Tishby · 2017
Later among the works it cites.
Stochastic gradient descent performes variational inference, converges to limit cycles for deep networks
P. Chaudhari and S. Soatto · 2018
Later among the works it cites.
Escaping saddles with stochastic gradients
H. Daneshmand, J. Kohler, A. Lucchi, and T. Hofmann · 2018
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
T. Li and P. Zhou · 2016
Cited alongside, same era.
A variational analysis of stochastic gradient algorithms
S. Mandt, M. Hoffman, and D.M. Blei · 2016
Cited alongside, same era.
Understanding deep learning requires rethinking generalization
C. Zhang, S. Bengio, M. Hardt, B. Recht, and O. Vinyals · 2016
Cited alongside, same era.
How to Escape Saddle Points Efficiently
Chi Jin, Rong Ge, Praneeth Netrapalli, Sham M. Kakade, and Michael I. Jordan · 2017
Cited alongside, same era.
On large–batch training for deep learning: Generalization gap and sharp minima
N.S. Keskar, D. Mudigere, J. Nocedal, M. Smelyanskiy, and P.T.P. Tang · 2017
Cited alongside, same era.
On the fast convergence of random perturbations of the gradient flow
W. Hu and C.J. Li
Cited in the paper.
On the diffusion approximation of nonconvex stochastic gradient descent
W. Hu, C.J. Li, L. Li, and J.G. Liu
Cited in the paper.
A convergence analysis of the perturbed compositional gradient flow: averaging principle and normal deviations
W. Hu and C.J. Li · 2018
Later among the works it cites.
On the local minima of the Empirical Risk
Chi Jin, Lydia T. Liu, Rong Ge, and Michael I. Jordan · 2018
Later among the works it cites.
An Alternative View: When does SGD escape local minima?
R. Kleinberg, Y. Li, and Y. Yuan · 2018
Later among the works it cites.
Zhanxing Zhu, Jingfeng Wu, Bing Yu, Bing Wu, and Jinwen Ma · 2018
Later among the works it cites.