On the linear convergence of the stochastic gradient method with constant step-size

P. Tseng, An incremental gradient (-projection) method with momentum term and adaptive stepsize rule, SIAM J. Optim

1998

Earlier work this paper cites.

M. V. Solodov, Incremental gradient algorithms with stepsizes bounded away from zero, Comput. Optim. Appl

1998

Earlier work this paper cites.

A. Nedić and D. Bertsekas, Convergence rate of incremental subgradient algorithms, chapter in Stochastic Optimization: Algorithms and Applications, S. Uryasev and P. Pardalos edts., 263-304, 2000

2000

Earlier work this paper cites.

A. Nemirovski, A. Juditsky, G. Lan, and A. Shapiro. Robust stochastic approximation approach to stochastic programming. SIAM J. Optim

2008

Earlier work this paper cites.

J. C. Duchi and Y. Singer, Efficient online and batch learning using forward backward splitting, J. Mach. Learn. Res.,

2009

Earlier work this paper cites.

T. Strohmer and R. Vershynin, A randomized Kaczmarz algorithm with exponential convergence, J. Fourier Anal. Appl

2009

Earlier work this paper cites.

H. H. Bauschke, P. L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces. Springer, New York (2011)

2011

Cited alongside, same era.

N. Le Roux, M. Schmidt, and F. Bach, A stochastic gradient method with an exponential convergence rate for strongly-convex optimization with finite training sets. Adv. Neural Inf. Process. Syst

2012

Cited alongside, same era.

M. Schmidt and N. Le Roux, Fast convergence of stochastic Gradient descent under a strong growth condition, 2013, https://arxiv.org/pdf/1308.6370.pdf

Original

2013

Cited alongside, same era.

O. Shamir and T. Zhang, Stochastic gradient descent for non-smooth optimization: Convergence results and optimal averaging schemes, ICML

2013

Cited alongside, same era.

L. Xiao and T. Zhang, A proximal stochastic gradient method with progressive variance reduction, SIAM J. Optim

H. Zhang and L. Cheng, Restricted strong convexity and its applications to convergence analysis of gradient-type methods in convex optimization, Optim. Lett

Original

2015

Later among the works it cites.

P. L. Combettes and J.-C. Pesquet, Stochastic approximations and perturbations in forward-backward splitting for monotone operators, Pure Appl. Funct. Anal

2016

Later among the works it cites.

L. Rosasco, S. Villa, and B. C. Vũ, Stochastic Forward-Backward Splitting for Monotone Inclusions, J. Optim. Theory Appl., vol.169, pp. 388-406, 2016

2016

Later among the works it cites.

D. Needell, N. Srebro and R. Ward, Stochastic gradient descent, weighted sampling, and the randomized Kaczmarz algorithm, Math. Program.,

2016

Later among the works it cites.

E. Ryu and S. Boyd, Stochastic proximal iteration: a non-asymptotic improvement upon stochastic gradient descent, http://web.stanford.edu/ eryu/, 2016