Convergence diagnostics for stochastic gradient descent with constant step size

A stochastic approximation method

Robbins, H. and S. Monro (1951) · 1951

Earlier work this paper cites.

Accelerated stochastic approximation

Kesten, H. (1958) · 1958

Earlier work this paper cites.

Generalized linear models

McCullagh, P. (1984) · 1984

Earlier work this paper cites.

Numerical techniques for stochastic optimization

Ermoliev, Y. M. and R.-B. Wets (1988) · 1988

Earlier work this paper cites.

Stopping times for stochastic approximation

Yin, G. (1989) · 1989

Earlier work this paper cites.

Adaptive algorithms and stochastic approximations

Benveniste, A., P. Priouret, and M. Métivier (1990) · 1990

Earlier work this paper cites.

Non-asymptotic confidence bounds for stochastic approximation algorithms with constant step size

Pflug, G. C. (1990) · 1990

Earlier work this paper cites.

Gradient estimates for the performance of markov chains and discrete event processes

Pflug, G. C. (1992) · 1992

Earlier work this paper cites.

Accelerated stochastic approximation

Delyon, B. and A. Juditsky (1993) · 1993

Earlier work this paper cites.

A statistical study of on-line learning

Murata, N. (1998) · 1998

Earlier work this paper cites.

Beating the hold-out: Bounds for k-fold and progressive cross-validation

Blum, A., A. Kalai, and J. Langford (1999) · 1999

Earlier work this paper cites.

Stochastic approximation

Borkar, V. S. (2008) · 2008

Cited alongside, same era.

Robust stochastic approximation approach to stochastic programming

Nemirovski, A., A. Juditsky, G. Lan, and A. Shapiro (2009) · 2009

Cited alongside, same era.

Large-scale machine learning with stochastic gradient descent

Bottou, L. (2010) · 2010

Cited alongside, same era.

Implicit online learning

Kulis, B. and P. L. Bartlett (2010) · 2010

Cited alongside, same era.

Incremental proximal methods for large scale convex optimization

Bertsekas, D. P. (2011) · 2011

Cited alongside, same era.

Non-asymptotic analysis of stochastic approximation algorithms for machine learning

Moulines, E. and F. R. Bach (2011) · 2011

Cited alongside, same era.

Stochastic gradient descent, weighted sampling, and the randomized kaczmarz algorithm

Needell, D., R. Ward, and N. Srebro (2014) · 2014

Later among the works it cites.

Convergence of stochastic proximal gradient algorithm

Original

Rosasco, L., S. Villa, and B. C. Vũ (2014) · 2014

Later among the works it cites.

Statistical analysis of stochastic gradient methods for generalized linear models

Toulis, P., J. Rennie, and E. Airoldi (2014) · 2014

Later among the works it cites.

Solving large scale linear prediction problems using stochastic gradient descent algorithms

Zhang, T. (2004) · 2014

Later among the works it cites.

Scalable estimation strategies based on stochastic approximations: classical results and new insights

Toulis, P. and E. M. Airoldi (2015) · 2015

Later among the works it cites.