Fetching the paper…
Reading the bibliography…
As datasets continue to increase in size and multi-core computer architectures are developed, asynchronous parallel optimization algorithms become more and more essential to the field of Machine Learning.
Parallel and Distributed Computation: Numerical Methods
Dimitri P. Bertsekas and John N. Tsitsiklis · 1989
Earlier work this paper cites.
A parallel mixture of SVMs for very large scale problems
R. Collobert, S. Bengio, and Y. Bengio · 2002
Earlier work this paper cites.
RCV1: A new benchmark collection for text categorization research
David D Lewis, Yiming Yang, Tony G Rose, and Fan Li · 2004
Earlier work this paper cites.
Identifying suspicious URLs: an application of large-scale online learning
Justin Ma, Lawrence K. Saul, Stefan Savage, and Geoffrey M. Voelker · 2009
Earlier work this paper cites.
Non-asymptotic analysis of stochastic approximation algorithms for machine learning
Eric Moulines and Francis R. Bach · 2011
Earlier work this paper cites.
Hogwild: A lock-free approach to parallelizing stochastic gradient descent
Feng Niu, Benjamin Recht, Christopher Re, and Stephen Wright · 2011
Earlier work this paper cites.
A stochastic gradient method with an exponential convergence rate for finite training sets
Nicolas Le Roux, Mark Schmidt, and Francis Bach · 2012
Earlier work this paper cites.
Accelerating stochastic gradient descent using predictive variance reduction
Rie Johnson and Tong Zhang · 2013
Earlier work this paper cites.
Semi-stochastic gradient descent methods
Jakub Konečný and Peter Richtárik · 2013
Earlier work this paper cites.
Stochastic dual coordinate ascent methods for regularized loss
Shai Shalev-Shwartz and Tong Zhang · 2013
Earlier work this paper cites.
SAGA: A fast incremental gradient method with support for non-strongly convex composite objectives
Aaron Defazio, Francis Bach, and Simon Lacoste-Julien · 2014
Cited alongside, same era.
Stochastic gradient descent, weighted sampling, and the randomized Kaczmarz algorithm
Deanna Needell, Rachel Ward, and Nati Srebro · 2014
Cited alongside, same era.
Convergence rate of stochastic gradient with constant step size
Mark Schmidt · 2014
Cited alongside, same era.
Taming the wild: A unified analysis of Hogwild!-style algorithms
Christopher De Sa, Ce Zhang, Kunle Olukotun, and Christopher Ré · 2015
Cited alongside, same era.
Asynchronous stochastic convex optimization
John C. Duchi, Sorathan Chaturapruek, and Christopher Ré · 2015
Cited alongside, same era.
Variance reduced stochastic gradient descent with neighbors
Thomas Hofmann, Aurelien Lucchi, Simon Lacoste-Julien, and Brian McWilliams · 2015
Adding vs. averaging in distributed primal-dual optimization
Chenxin Ma, Virginia Smith, Martin Jaggi, Michael I. Jordan, Peter Richtarik, and Martin Takac · 2015
Later among the works it cites.
On variance reduction in stochastic gradient descent and its asynchronous variants
Sashank J. Reddi, Ahmed Hefny, Suvrit Sra, Barnabás Póczos, and Alex Smola · 2015
Later among the works it cites.
Cyclades: Conflict-free asynchronous machine learning
Xinghao Pan, Maximilian Lam, Stephen Tu, Dimitris Papailiopoulos, Ce Zhang, Michael I. Jordan, Kannan Ramchandran, Chris Re, and Benjamin Recht · 2016
Later among the works it cites.
Stochastic variance reduction for nonconvex optimization
Sashank J. Reddi, Ahmed Hefny, Suvrit Sra, Barnabás Póczós, and Alex Smola · 2016
Later among the works it cites.
Minimizing finite sums with the stochastic average gradient
M. Schmidt, N. Le Roux, and F. Bach · 2016
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
PASSCoDe: Parallel asynchronous stochastic dual co-ordinate descent
Cho-Jui Hsieh, Hsiang-Fu Yu, and Inderjit Dhillon · 2015
Cited alongside, same era.
Asynchronous parallel stochastic gradient for nonconvex optimization
Xiangru Lian, Yijun Huang, Yuncheng Li, and Ji Liu · 2015
Cited alongside, same era.
An asynchronous parallel stochastic coordinate descent algorithm
Ji Liu, Stephen J. Wright, Christopher Ré, Victor Bittorf, and Srikrishna Sridhar · 2015
Cited alongside, same era.
Shen-Yi Zhao and Wu-Jun Li · 2016
Later among the works it cites.
ASAGA: Asynchronous parallel SAGA
Rémi Leblond, Fabian Pedregosa, and Simon Lacoste-Julien · 2017
Later among the works it cites.
Perturbed iterate analysis for asynchronous stochastic optimization
Horia Mania, Xinghao Pan, Dimitris Papailiopoulos, Benjamin Recht, Kannan Ramchandran, and Michael I. Jordan · 2017
Later among the works it cites.
Breaking the nonsmooth barrier: A scalable parallel method for composite optimization
Fabian Pedregosa, Rémi Leblond, and Simon Lacoste-Julien · 2017
Later among the works it cites.