Fetching the paper…
Reading the bibliography…
This work considers the question: what convergence guarantees does the stochastic subgradient method have in the absence of smoothness and convexity? We prove that the stochastic subgradient method, on any semialgebraic locally Lipschitz function, produces limit points that are all first-order stationary.
A function not constant on a connected set of critical points
H. Whitney · 1935
Earlier work this paper cites.
A stochastic approximation method
H. Robbins and S. Monro · 1951
Earlier work this paper cites.
Ensemble semi-analytiques
S. Łojasiewicz · 1965
Earlier work this paper cites.
Opérateurs maximaux monotones et semi-groupes de contraction dans des espaces de Hilbert
H. Brézis · 1973
Earlier work this paper cites.
Minimization of nondifferentiable functions in the presence of noise
E. A. Nurminskii · 1974
Earlier work this paper cites.
Asymptotic convergence of nonlinear contraction semigroups in Hilbert space
R.E. Bruck, Jr · 1975
Earlier work this paper cites.
Generalized gradients and applications
F.H. Clarke · 1975
Earlier work this paper cites.
The theory of subgradients and its applications to problems of optimization
R.T. Rockafellar · 1981
Earlier work this paper cites.
Problem complexity and method efficiency in optimization
A.S. Nemirovsky and D.B. Yudin · 1983
Earlier work this paper cites.
Geometric categories and o-minimal structures
L. van den Dries and C. Miller · 1996
Earlier work this paper cites.
A.J. Wilkie · 1996
Earlier work this paper cites.
Variational Analysis
R.T. Rockafellar and R.J-B. Wets · 1998
Earlier work this paper cites.
An introduction to o-minimal geometry
M. Coste · 1999
Cited alongside, same era.
Lipschitz func tions with maximal Clarke subdifferentials are generic
J.M. Borwein and X. Wang · 2000
Cited alongside, same era.
An Introduction to Semialgebraic Geometry
M. Coste · 2002
Cited alongside, same era.
Introduction to the theory of differential inclusions
G.V. Smirnov · 2002
Cited alongside, same era.
Stochastic approximation and recursive algorithms and applications
H.J. Kushner and G.G. Yin · 2003
Cited alongside, same era.
Stochastic approximations and differential inclusions
M. Benaïm, J. Hofbauer, and S. Sorin · 2005
Cited alongside, same era.
Robust stochastic approximation approach to stochastic programming
A. Nemirovski, A. Juditsky, G. Lan, and A. Shapiro · 2008
Later among the works it cites.
An introduction to measure theory
Terence Tao · 2011
Later among the works it cites.
Stochastic first- and zeroth-order methods for nonconvex stochastic programming
S. Ghadimi and G. Lan · 2013
Later among the works it cites.
TensorFlow: Large-scale machine learning on heterogeneous systems, 2015
M. Abadi, A. Agarwal, P. Barham, E. Brevdo, et al · 2015
Later among the works it cites.
Curves of descent
D. Drusvyatskiy, A. D. Ioffe, and A. S. Lewis · 2015
Later among the works it cites.
Probability theory: Stat310/math230 september 3, 2016
A. Dembo · 2016
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
M. Benaïm, J. Hofbauer, and S. Sorin · 2006
Cited alongside, same era.
Clarke subgradients of stratifiable functions
J. Bolte, A. Daniilidis, A.S. Lewis, and M. Shiota · 2007
Cited alongside, same era.
Stochastic approximation
V.S. Borkar · 2008
Cited alongside, same era.
Nonsmooth analysis and control theory
F.H. Clarke, Y.S. Ledyaev, R.J. Stern, and P.R. Wolenski · 2008
Cited alongside, same era.
Critical values of set-valued maps with stratifiable graphs. Extensions of Sard and Smale-Sard theorems
A.D. Ioffe · 2008
Cited alongside, same era.
An invitation to tame optimization
A.D. Ioffe · 2008
Cited alongside, same era.
J.C. Duchi and F. Ruan · 2017
Later among the works it cites.
Variational analysis of regular mappings
A.D. Ioffe · 2017
Later among the works it cites.
Automatic differentiation in pytorch
A. Paszke, S. Gross, S. Chintala, G. Chanan, E. Yang, Z. DeVito, Z. Lin, A. Desmaison, L. Antiga, and A. Lerer · 2017
Later among the works it cites.
Stochastic model-based minimization of weakly convex functions
D. Davis and D. Drusvyatskiy · 2018
Closest in time.
D. Davis and D. Drusvyatskiy · 2018
Closest in time.
Analysis of nonsmooth stochastic approximation: the differential inclusion approach
S. Majewski, B. Miasojedow, and E. Moulines · 2018
Closest in time.