Fetching the paper…
Reading the bibliography…
We consider convex-concave saddle-point problems where the objective functions may be split in many components, and extend recent stochastic variance reduction methods (such as SVRG or SAGA) to provide the first large-scale linearly convergent algorithms for this class of problems which is common in machine learning.
Monotone operators associated with saddle-functions and minimax problems
R. T. Rockafellar · 1970
Earlier work this paper cites.
Monotone operators and the proximal point algorithm
R. T. Rockafellar · 1976
Earlier work this paper cites.
Finite-dimensional variational inequality and nonlinear complementarity problems: a survey of theory, algorithms and applications
P. T. Harker and J.-S. Pang · 1990
Earlier work this paper cites.
Co-coercivity and its role in the convergence of iterative schemes for solving variational inequalities
D. L. Zhu and P. Marcotte · 1996
Earlier work this paper cites.
Convergence rates in forward-backward splitting
G. H. G. Chen and R. T. Rockafellar · 1997
Earlier work this paper cites.
Large margin rank boundaries for ordinal regression
R. Herbrich, T. Graepel, and K. Obermayer · 1999
Earlier work this paper cites.
Maximum margin clustering
L. Xu, J. Neufeld, B. Larson, and D. Schuurmans · 2004
Earlier work this paper cites.
Introductory Lectures on Convex Optimization
Y. Nesterov · 2004
Earlier work this paper cites.
A support vector method for multivariate performance measures
T. Joachims · 2005
Earlier work this paper cites.
Convex sparse matrix factorizations
F. Bach, J. Mairal, and J. Ponce · 2008
Earlier work this paper cites.
A fast iterative shrinkage-thresholding algorithm for linear inverse problems
A. Beck and M. Teboulle · 2009
Earlier work this paper cites.
Robust Optimization
A. Ben-Tal, L. El Ghaoui, and A. Nemirovski · 2009
Cited alongside, same era.
Convex Analysis and Monotone Operator Theory in Hilbert Spaces
H. H. Bauschke and P. L. Combettes · 2011
Cited alongside, same era.
A first-order primal-dual algorithm for convex problems with applications to imaging
A. Chambolle and T. Pock · 2011
Cited alongside, same era.
A stochastic gradient method with an exponential convergence rate for finite training sets
N. Le Roux, M. Schmidt, and F. Bach · 2012
Cited alongside, same era.
Optimization with sparsity-inducing penalties
F. Bach, R. Jenatton, J. Mairal, and G. Obozinski · 2012
Cited alongside, same era.
Sublinear optimization for machine learning
K. L. Clarkson, E. Hazan, and D. P. Woodruff · 2012
Cited alongside, same era.
A stochastic forward-backward splitting method for solving monotone inclusions in hilbert spaces
L. Rosasco, S. Villa, and B. C. Vũ · 2014
Later among the works it cites.
A proximal stochastic gradient method with progressive variance reduction
L. Xiao and T. Zhang · 2014
Later among the works it cites.
A universal catalyst for first-order optimization
H. Lin, J. Mairal, and Z. Harchaoui · 2015
Later among the works it cites.
Adaptive stochastic primal-dual coordinate descent for separable saddle point problems
X. Zhu and A. J. Storkey · 2015
Later among the works it cites.
Stochastic primal-dual coordinate method for regularized empirical risk minimization
Y. Zhang and L. Xiao · 2015
Later among the works it cites.
Non-uniform stochastic average gradient method for training conditional random fields
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Accelerating stochastic gradient descent using predictive variance reduction
R. Johnson and T. Zhang · 2013
Cited alongside, same era.
A generalized forward-backward splitting
H. Raguet, J. Fadili, and G. Peyré · 2013
Cited alongside, same era.
SAGA: A fast incremental gradient method with support for non-strongly convex composite objectives
A. Defazio, F. Bach, and S. Lacoste-Julien · 2014
Cited alongside, same era.
Sketching as a tool for numerical linear algebra
D. Woodruff · 2014
Cited alongside, same era.
M. Schmidt, R. Babanezhad, M.O. Ahmed, A. Defazio, A. Clifton, and A. Sarkar · 2015
Later among the works it cites.
Stop wasting my gradients: Practical SVRG
R. Harikandeh, M. O. Ahmed, A. Virani, M. Schmidt, J. Konečnỳ, and S. Sallinen · 2015
Later among the works it cites.
A primer on monotone operator methods
E. Ryu and S. Boyd · 2016
Closest in time.
Smart: The stochastic monotone aggregated root-finding algorithm
D. Davis · 2016
Closest in time.
Solving OSCAR regularization problems by fast approximate proximal splitting algorithms
X. Zeng and M. Figueiredo · 2016
Closest in time.