Fetching the paper…
Reading the bibliography…
In this letter, we introduce a distributed Nesterov method, termed as $\mathcal{ABN}$, that does not require doubly-stochastic weight matrices.
“Asy-sonata: Achieving geometric convergence for distributed asynchronous optimization,”
Y. Tian, Y. Sun, B. Du, and G. Scutari, · 1901
Earlier work this paper cites.
Introduction to optimization
B. Polyak, · 1987
Earlier work this paper cites.
“Gossip-based computation of aggregate information,”
D. Kempe, A. Dobra, and J. Gehrke, · 2003
Earlier work this paper cites.
“Distributed optimization in sensor networks,”
M. Rabbat and R. Nowak, · 2004
Earlier work this paper cites.
“Consensus problems in networks of agents with switching topology and time-delays,”
R. Olfati-Saber and R. M. Murray, · 2004
Earlier work this paper cites.
“Fast linear iterations for distributed averaging,”
Lin Xiao and Stephen Boyd, · 2004
Earlier work this paper cites.
“Distributed subgradient projection algorithm for convex optimization,”
S. S. Ram, A. Nedić, and V. V. Veeravalli, · 2009
Earlier work this paper cites.
“Distributed subgradient methods for multi-agent optimization,”
A. Nedić and A. Ozdaglar, · 2009
Earlier work this paper cites.
“Consensus-based distributed support vector machines,”
P. A. Forero, A. Cano, and G. B. Giannakis, · 2010
Earlier work this paper cites.
“Weighted gossip: Distributed averaging using non-doubly stochastic matrices,”
F. Benezit, V. Blondel, P. Thiran, J. Tsitsiklis, and M. Vetterli, · 2010
Earlier work this paper cites.
“Distributed optimization and statistical learning via the alternating direction method of multipliers,”
S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, · 2011
Earlier work this paper cites.
“Distributed asynchronous constrained stochastic optimization,”
K. Srivastava and A. Nedić, · 2011
Earlier work this paper cites.
“Diffusion adaptation strategies for distributed optimization and learning over networks,”
J. Chen and A. H. Sayed, · 2012
Earlier work this paper cites.
“Average consensus on general strongly connected digraphs,”
K. Cai and H. Ishii, · 2012
Earlier work this paper cites.
“Distributed random projection algorithm for convex optimization,”
S. Lee and A. Nedić, · 2013
Earlier work this paper cites.
The role of the Network in Distributed Optimization Algorithms: Convergence Rates, Scalability, Communication/Computation Tradeoffs and Communication Delays
K. I. Tsianos, · 2013
Cited alongside, same era.
Introductory lectures on convex optimization: A basic course
Y. Nesterov, · 2013
Cited alongside, same era.
“Fast distributed gradient methods,”
D. Jakovetic, J. Xavier, and J. M. F. Moura, · 2014
Cited alongside, same era.
“Convergence rates of distributed nesterov-like gradient methods on random networks.,”
D. Jakovetic, J. M. F. Xavier, and José M. F. Moura, · 2014
Cited alongside, same era.
“Revisiting finite-time distributed algorithms via successive nulling of eigenvalues,”
S. Safavi and U. A. Khan, · 2015
Cited alongside, same era.
“Extra: An exact first-order algorithm for decentralized consensus optimization,”
“Achieving geometric convergence for distributed optimization over time-varying graphs,”
A. Nedić, A. Olshevsky, and W. Shi, · 2017
Later among the works it cites.
“Accelerated distributed Nesterov gradient descent,”
G. Qu and N. Li, · 2017
Later among the works it cites.
“Distributed localization: A linear theory,”
S. Safavi, U. A. Khan, S. Kar, and J. M. F. Moura, · 2018
Later among the works it cites.
“Multi-agent reinforcement learning via double averaging primal-dual optimization,”
H.-T. Wai, Z. Yang, Z. Wang, and M. Hong, · 2018
Later among the works it cites.
“Optimal algorithms for non-smooth distributed optimization in networks,”
K. Scaman, F. Bach, S. Bubeck, L. Massoulié, and Y. T. Lee, · 2018
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
W. Shi, Q. Ling, G. Wu, and W Yin, · 2015
Cited alongside, same era.
“Distributed optimization over time-varying directed graphs,”
A. Nedić and A. Olshevsky, · 2015
Cited alongside, same era.
“A decentralized second-order method with exact linear convergence rate for consensus optimization,”
A. Mokhtari, W. Shi, Q. Ling, and A. Ribeiro, · 2016
Cited alongside, same era.
“Distributed subgradient projection algorithm over directed graphs,”
C. Xi and U. A. Khan, · 2016
Cited alongside, same era.
“Can decentralized algorithms outperform centralized algorithms? A case study for decentralized parallel stochastic gradient descent,”
X. Lian, C. Zhang, H. Zhang, C. Hsieh, W. Zhang, and J. Liu, · 2017
Cited alongside, same era.
“Prox-PDA: The proximal primal-dual algorithm for fast distributed nonconvex optimization and learning over networks,”
M. Hong, D. Hajinezhad, and M. Zhao, · 2017
Cited alongside, same era.
“Harnessing smoothness to accelerate distributed optimization,”
G. Qu and N. Li, · 2017
Cited alongside, same era.
“Linear convergence in optimization over directed graphs with row-stochastic matrices,”
C. Xi, V. S. Mai, R. Xin, E. Abed, and U. A. Khan, · 2018
Later among the works it cites.
“FROST – Fast row-stochastic optimization with uncoordinated step-sizes,”
R. Xin, C. Xi, and U. A. Khan, · 2018
Later among the works it cites.
R. Xin and U. A. Khan, · 2018
Later among the works it cites.
“A linear algorithm for optimization over directed graphs with geometric convergence,”
R. Xin and U. A. Khan, · 2018
Later among the works it cites.
“Optimization over time-varying directed graphs with row and column-stochastic matrices,”
F. Saadatniaki, R. Xin, and U. A. Khan, · 2018
Later among the works it cites.
“Push-pull gradient methods for distributed optimization in networks,”
S. Pu, W. Shi, J. Xu, and A. Nedić, · 2018
Later among the works it cites.
“Second-order guarantees of distributed gradient algorithms,”
A. Daneshmand, G. Scutari, and V. Kungurtsev, · 2018
Later among the works it cites.
“Decentralized consensus optimization with asynchrony and delays,”
T. Wu, K. Yuan, Q. Ling, W. Yin, and A. H. Sayed, · 2018
Later among the works it cites.
“Augmented distributed gradient methods for multi-agent optimization under uncoordinated constant stepsizes,”
J. Xu, S. Zhu, Y. C. Soh, and L. Xie, · 2060
Closest in time.