Fetching the paper…
Reading the bibliography…
In this paper, we study the problem of distributed multi-agent optimization over a network, where each agent possesses a local cost function that is smooth and strongly convex.
The annals of mathematical statistics pp. 400–407 (1951)
Robbins, H., Monro, S.: A stochastic approximation method · 1951
Earlier work this paper cites.
The Annals of Mathematical Statistics 23
Kiefer, J., Wolfowitz, J., et al.: Stochastic estimation of the maximum of a regression function · 1952
Earlier work this paper cites.
IEEE transactions on automatic control 31
Tsitsiklis, J., Bertsekas, D., Athans, M.: Distributed asynchronous deterministic and stochastic gradient optimization algorithms · 1986
Earlier work this paper cites.
In: Proceedings of the twenty-first annual ACM symposium on Theory of computing, pp. 587–598. ACM (1989)
Friedman, J., Kahn, J., Szemeredi, E.: On the second eigenvalue of random regular graphs · 1989
Earlier work this paper cites.
Cambridge university press (1990)
Horn, R.A., Johnson, C.R.: Matrix analysis · 1990
Earlier work this paper cites.
Springer Science & Business Media (2003)
Kushner, H., Yin, G.G.: Stochastic approximation and recursive algorithms and applications, vol. 35 · 2003
Earlier work this paper cites.
IEEE transactions on information theory 52
Boyd, S., Ghosh, A., Prabhakar, B., Shah, D.: Randomized gossip algorithms · 2006
Earlier work this paper cites.
In: Proceedings of the Royal Society of London A: Mathematical, Physical and Engineering Sciences, vol. 463, pp. 3251–3269. The Royal Society (2007)
Forrester, A.I., Sóbester, A., Keane, A.J.: Multi-fidelity optimization via surrogate modelling · 2007
Earlier work this paper cites.
Springer (2008)
Kleijnen, J.P.: Design and analysis of simulation experiments, vol. 20 · 2008
Earlier work this paper cites.
IEEE Transactions on Automatic Control 54
Nedić, A., Ozdaglar, A.: Distributed subgradient methods for multi-agent optimization · 2009
Earlier work this paper cites.
SIAM Journal on optimization 19
Nemirovski, A., Juditsky, A., Lan, G., Shapiro, A.: Robust stochastic approximation approach to stochastic programming · 2009
Earlier work this paper cites.
IEEE Transactions on Automatic Control 55
Nedić, A., Ozdaglar, A., Parrilo, P.A.: Constrained consensus and optimization in multi-agent networks · 2010
Earlier work this paper cites.
Journal of optimization theory and applications 147
Ram, S.S., Nedić, A., Veeravalli, V.V.: Distributed stochastic subgradient projection algorithms for convex optimization · 2010
Earlier work this paper cites.
Mathematical programming 129
Lobel, I., Ozdaglar, A., Feijer, D.: Distributed multi-agent optimization with state-dependent communication · 2011
Earlier work this paper cites.
IEEE Transactions on Automatic Control 56
Lu, J., Tang, C.Y., Regier, P.R., Bow, T.D.: Gossip algorithms for convex consensus optimization over networks · 2011
Earlier work this paper cites.
IEEE Journal of Selected Topics in Signal Processing 5
Srivastava, K., Nedic, A.: Distributed asynchronous constrained stochastic optimization · 2011
Earlier work this paper cites.
IEEE Transactions on Signal Processing 60
Chen, J., Sayed, A.H.: Diffusion adaptation strategies for distributed optimization and learning over networks · 2012
Earlier work this paper cites.
IEEE Transactions on Automatic control 57
Duchi, J.C., Agarwal, A., Wainwright, M.J.: Dual averaging for distributed optimization: Convergence analysis and network scaling · 2012
Earlier work this paper cites.
IEEE Transactions on Signal Processing 60
Mateos, G., Giannakis, G.B.: Distributed recursive least-squares: Stability and performance analysis · 2012
Earlier work this paper cites.
In: Proceedings of the 29th International Coference on International Conference on Machine Learning, pp. 1571–1578. Omnipress (2012)
Rakhlin, A., Shamir, O., Sridharan, K.: Making gradient descent optimal for strongly convex stochastic optimization · 2012
Cited alongside, same era.
IEEE Transactions on Automatic Control 58
Bianchi, P., Jakubowicz, J.: Convergence of a multi-agent projected stochastic gradient algorithm for non-convex optimization · 2013
Cited alongside, same era.
IEEE Journal of Selected Topics in Signal Processing 7
Cavalcante, R.L., Stanczak, S.: A distributed subgradient method for dynamic convex optimization problems under noisy information exchange · 2013
Cited alongside, same era.
IEEE Journal of Selected Topics in Signal Processing 8
Baingana, B., Mateos, G., Giannakis, G.B.: Proximal-gradient algorithms for tracking cascades over social networks · 2014
Cited alongside, same era.
IEEE Transactions on Automatic Control 59
Jakovetić, D., Xavier, J., Moura, J.M.: Fast distributed gradient methods · 2014
Cited alongside, same era.
IEEE Transactions on Automatic Control 63
Aybat, N.S., Wang, Z., Lin, T., Ma, S.: Distributed linearized alternating direction method of multipliers for composite convex consensus optimization · 2017
Later among the works it cites.
IEEE Transactions on Automatic Control 62
Cohen, K., Nedić, A., Srikant, R.: Distributed learning algorithms for spectrum sharing in spatial random access wireless networks · 2017
Later among the works it cites.
IEEE Transactions on Automatic Control 62
Cohen, K., Nedić, A., Srikant, R.: On projected stochastic gradient descent algorithm with weighted averaging for least squares regression · 2017
Later among the works it cites.
arXiv preprint arXiv:1701.03961 (2017)
Lan, G., Lee, S., Zhou, Y.: Communication-efficient algorithms for decentralized and stochastic optimization · 2017
Later among the works it cites.
In: Advances in Neural Information Processing Systems, pp. 5336–5346 (2017)
Lian, X., Zhang, C., Zhang, H., Hsieh, C.J., Zhang, W., Liu, J.: Can decentralized algorithms outperform centralized algorithms? a case study for decentralized parallel stochastic gradient descent · 2017
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Proceedings of the IEEE 102
Sayed, A.H.: Adaptive networks · 2014
Cited alongside, same era.
Signal Processing, IEEE Transactions on 62
Towfic, Z.J., Sayed, A.H.: Adaptive penalty-based distributed stochastic convex optimization · 2014
Cited alongside, same era.
Mathematical Programming 152
Chatzipanagiotis, N., Dentcheva, D., Zavlanos, M.M.: An augmented lagrangian method for distributed optimization · 2015
Cited alongside, same era.
IEEE Transactions on Information Theory 61
Chen, J., Sayed, A.H.: On the learning behavior of adaptive networks—part i: Transient analysis · 2015
Cited alongside, same era.
IEEE Transactions on Information Theory 61
Chen, J., Sayed, A.H.: On the learning behavior of adaptive networks—part ii: Performance analysis · 2015
Cited alongside, same era.
Automatica 55
Kia, S.S., Cortés, J., Martínez, S.: Distributed convex optimization via continuous-time coordination algorithms with discrete-time communication · 2015
Cited alongside, same era.
IEEE Transactions on Signal Processing 63
Ling, Q., Shi, W., Wu, G., Ribeiro, A.: Dlm: Decentralized linearized alternating direction method of multipliers · 2015
Cited alongside, same era.
Later among the works it cites.
SIAM Journal on Optimization 27
Nedic, A., Olshevsky, A., Shi, W.: Achieving geometric convergence for distributed optimization over time-varying graphs · 2017
Later among the works it cites.
IEEE Transactions on Automatic Control 62
Nedić, A., Olshevsky, A., Uribe, C.A.: Fast convergence rates for distributed non-bayesian learning · 2017
Later among the works it cites.
IEEE Transactions on Control of Network Systems (2017)
Qu, G., Li, N.: Harnessing smoothness to accelerate distributed optimization · 2017
Later among the works it cites.
IEEE Transactions on Network Science and Engineering 4
Sayin, M.O., Vanli, N.D., Kozat, S.S., Başar, T.: Stochastic subgradient algorithms for strongly convex optimization over distributed networks · 2017
Later among the works it cites.
arXiv preprint arXiv:1803.07836 (2018)
Jakovetic, D., Bajovic, D., Sahu, A.K., Kar, S.: Convergence rates for distributed stochastic optimization over random networks · 2018
Closest in time.
Proceedings of the IEEE 106
Nedić, A., Olshevsky, A., Rabbat, M.G.: Network topology and communication-computation tradeoffs in decentralized optimization · 2018
Closest in time.
arXiv preprint arXiv:1811.03982 (2018)
Olshevsky, A., Paschalidis, I.C., Spiridonoff, A.: Robust asynchronous stochastic gradient-push: asymptotically optimal and network-independent performance for strongly convex functions · 2018
Closest in time.
Operations Research 1
Pu, S., Garcia, A.: A flocking-based approach for distributed stochastic optimization · 2018
Closest in time.
SIAM Journal on Control and Optimization 56
Pu, S., Garcia, A.: Swarming for faster convergence in stochastic optimization · 2018
Closest in time.
In: 2018 IEEE Conference on Decision and Control (CDC), pp. 963–968. IEEE (2018)
Pu, S., Nedić, A.: A distributed stochastic gradient tracking method · 2018
Closest in time.
SIAM Journal on Optimization 28
Sirb, B., Ye, X.: Decentralized consensus algorithm with delayed and stochastic gradients · 2018
Closest in time.
arXiv preprint arXiv:1906.02702 (2019)
Pu, S., Olshevsky, A., Paschalidis, I.C.: A sharp estimate on the transient time of distributed stochastic gradient descent · 2019
Closest in time.
IEEE Transactions on Automatic Control (2020)
Pu, S., Shi, W., Xu, J., Nedic, A.: Push-pull gradient methods for distributed optimization in networks · 2020
Closest in time.