Fetching the paper…
Reading the bibliography…
In this paper, we introduce a new stochastic approximation (SA) type algorithm, namely the randomized stochastic gradient (RSG) method, for solving an important class of nonlinear (possibly nonconvex) stochastic programming (SP) problems.
A stochastic approximation method
H. Robbins and S. Monro · 1951
Earlier work this paper cites.
On a stochastic approximation method
K.L. Chung · 1954
Earlier work this paper cites.
Asymptotic distribution of stochastic approximation
J. Sacks · 1958
Earlier work this paper cites.
Problem complexity and method efficiency in optimization
A. Nemirovski and D. Yudin · 1983
Earlier work this paper cites.
A method for unconstrained convex minimization problem with the rate of convergence O ( 1 / k 2 ) O(1/k^{2})
Y. E. Nesterov · 1983
Earlier work this paper cites.
A unified view of the IPA, SF, and LR gradient estimation techniques
P. LÉcuyer · 1990
Earlier work this paper cites.
New stochastic approximation type procedures
B.T. Polyak · 1990
Earlier work this paper cites.
Acceleration of stochastic approximation by averaging
B.T. Polyak and A.B. Juditsky · 1992
Earlier work this paper cites.
Discrete Event Systems: Sensitivity Analysis and Stochastic Optimization by the Score Function Method
R.Y. Rubinstein and A. Shapiro · 1993
Earlier work this paper cites.
A review of simulation optimization techniques
S. Andradóttir · 1998
Earlier work this paper cites.
Variational analysis, ser. Grundlehren der Mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences]
R. T. Rockafellar and R. J.-B. Wets · 1998
Earlier work this paper cites.
Boosting algorithms as gradient descent in function space
L. Mason, J. Baxter, P. Bartlett, and M. Frean · 1999
Earlier work this paper cites.
Numerical optimization
J. Nocedal and S. J. Wright · 1999
Earlier work this paper cites.
Confidence level solutions for stochastic programming
Y. E. Nesterov and J. P. Vial · 2000
Earlier work this paper cites.
The sample average approximation method for stochastic discrete optimization
A. J. Kleywegt, A. Shapiro, and T. Homem de Mello · 2001
Cited alongside, same era.
Optimization for simulation: Theory vs. practice
M. Fu · 2002
Cited alongside, same era.
Gradient Estimation via Perturbation Analysis
P. Glasserman · 2003
Cited alongside, same era.
Monte carlo sampling methods
A. Shapiro · 2003
Cited alongside, same era.
Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control
J.C. Spall · 2003
Cited alongside, same era.
Introductory Lectures on Convex Optimization: a basic course
Y. E. Nesterov · 2004
Cited alongside, same era.
Robust stochastic approximation approach to stochastic programming
A. Nemirovski, A. Juditsky, G. Lan, and A. Shapiro · 2009
Later among the works it cites.
On the complexity of steepest descent, newton’s and regularized newton’s methods for nonconvex unconstrained optimization
C. Cartis, N. I. M. Gould, and Ph. L. Toint · 2010
Later among the works it cites.
Optimal stochastic approximation algorithms for strongly convex stochastic composite optimization, II: shrinking procedures and optimal algorithms
S. Ghadimi and G. Lan · 2010
Later among the works it cites.
Random gradient-free minimization of convex functions
Y. E. Nesterov · 2010
Later among the works it cites.
On the oracle complexity of first-order and derivative-free algorithms for smooth nonconvex minimization
C. Cartis, N. I. M. Gould, and Ph. L. Toint · 2012
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Recursive aggregation of estimators via the mirror descent algorithm with average
A. Juditsky, A. Nazin, A. B. Tsybakov, and N. Vayatis · 2005
Cited alongside, same era.
Primal-dual subgradient methods for convex problems
Y. E. Nesterov · 2006
Cited alongside, same era.
Large deviations of vector-valued martingales in 2 2 -smooth normed spaces
A. Juditsky and A. Nemirovski · 2008
Cited alongside, same era.
Learning by mirror averaging
A. Juditsky, P. Rigollet, and A. B. Tsybakov · 2008
Cited alongside, same era.
Recursive trust-region methods for multiscale nonlinear optimization
A. Sartenaer S. Gratton and Ph. L. Toint · 2008
Cited alongside, same era.
Introduction to Derivative-Free Optimization
A. R. Conn, K. Scheinberg, and L. N. Vicente · 2009
Cited alongside, same era.
Randomized smoothing for stochastic optimization
J. C. Duchi, P. L. Bartlett, and M. J. Wainwright · 2012
Later among the works it cites.
Smoothing and worst-case complexity for direct-search methods in nonsmooth optimization
R. Garmanjani and L. N. Vicente · 2012
Later among the works it cites.
Optimal stochastic approximation algorithms for strongly convex stochastic composite optimization, I: a generic algorithmic framework
S. Ghadimi and G. Lan · 2012
Later among the works it cites.
Stochastic first- and zeroth-order methods for nonconvex stochastic programming
S. Ghadimi and G. Lan · 2012
Later among the works it cites.
An optimal method for stochastic composite optimization
G. Lan · 2012
Later among the works it cites.
Validation analysis of mirror descent stochastic approximation method
G. Lan, A. Nemirovski, and A. Shapiro · 2012
Later among the works it cites.
Worst case complexity of direct search
L. N. Vicente · 2012
Later among the works it cites.
On stochastic gradient and subgradient methods with adaptive steplength sequences
F. Yousefian, A. Nedic, and U. V. Shanbhag · 2012
Later among the works it cites.