FedCluster: Boosting the Convergence of Federated Learning via Cluster-Cycling

Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE

1998

Earlier work this paper cites.

A. Krizhevsky. Learning multiple layers of features from tiny images. Technical report, 2009

2009

Earlier work this paper cites.

J. Konečnỳ, H. B. McMahan, D. Ramage, and P. Richtárik. Federated optimization: distributed machine learning for on-device intelligence. ArXiv:1610.02527

Original

2016

Earlier work this paper cites.

C. Finn, P. Abbeel, and S. Levine. Model-agnostic meta-learning for fast adaptation of deep networks. In Proc. International Conference on Machine Learning (ICML)

2017

Earlier work this paper cites.

B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas. Communication-efficient learning of deep networks from decentralized data. In Proc. International Conference on Artificial Intelligence and Statistics (AISTATS)

2017

Earlier work this paper cites.

C. Zhang, S. Bengio, M. Hardt, B. Recht, and O. Vinyals. Understanding deep learning requires rethinking generalization. In Proc. International Conference on Learning Representations (ICLR)

2017

Earlier work this paper cites.

A. K. Sahu, T. Li, M. Sanjabi, M. Zaheer, A. Talwalkar, and V. Smith. On the convergence of federated optimization in heterogeneous networks. ArXiv:1812.06127

Original

2018

Earlier work this paper cites.

Y. Zhao, M. Li, L. Lai, N. Suda, D. Civin, and V. Chandra. Federated learning with non-iid data. ArXiv:1806.00582

Original

2018

Earlier work this paper cites.

A. N. Bhagoji, S. Chakraborty, P. Mittal, and S. Calo. Analyzing federated learning through an adversarial lens. In Proc. International Conference on Machine Learning (ICML)

2019

Earlier work this paper cites.

C. Dinh, N. H. Tran, M. N. Nguyen, C. S. Hong, W. Bao, A. Zomaya, and V. Gramoli. Federated learning over wireless networks: convergence analysis and resource allocation. ArXiv:1910.13067

Original

2019

Earlier work this paper cites.

H. Eichner, T. Koren, H. B. McMahan, N. Srebro, and K. Talwar. Semi-cyclic stochastic gradient descent. In Proc. International Conference on Machine Learning (ICML)

2019

Earlier work this paper cites.

P. Kairouz, H. B. McMahan, B. Avent, A. Bellet, M. Bennis, A. N. Bhagoji, K. Bonawitz, Z. Charles, G. Cormode, R. Cummings, et al. Advances and open problems in federated learning. ArXiv:1912.04977

Original

2019

Earlier work this paper cites.

A. Khaled, K. Mishchenko, and P. Richtárik. First analysis of local gd on heterogeneous data. ArXiv:1909.04715

Original

2019

Earlier work this paper cites.

X. Li, W. Yang, S. Wang, and Z. Zhang. Communication efficient decentralized training with multiple local updates. ArXiv:1910.09126

Original

2019

Earlier work this paper cites.

X. Liang, S. Shen, J. Liu, Z. Pan, E. Chen, and Y. Cheng. Variance reduced local sgd with lower communication complexity. ArXiv:1912.12844

Original

2019

Cited alongside, same era.

M. Mohri, G. Sivek, and A. T. Suresh. Agnostic federated learning. In Proc. International Conference on Machine Learning (ICML)

2019

Cited alongside, same era.

A. Nagar. Privacy-preserving blockchain based federated learning with differential data sharing. ArXiv:1912.04859

Original

2019

Cited alongside, same era.

F. Sattler, K. R. Müller, W. Samek. Clustered federated learning: Model-agnostic distributed multi-task optimization under privacy constraints. ArXiv:1910.01991

Original

2019

Cited alongside, same era.

P. Sharma, P. Khanduri, S. Bulusu, K. Rajawat, and P. K. Varshney. Parallel restarted spider–-communication efficient distributed nonconvex optimization with optimal computation com- plexity. ArXiv:1912.06036

R. Jin, Y. Huang, X. He, H. Dai, and T. Wu. Stochastic-sign sgd for federated learning with theoretical guarantees. ArXiv:2002.10940

Original

2020

Closest in time.

S. P. Karimireddy, S. Kale, M. Mohri, S. J. Reddi, S. U. Stich, and A. T. Suresh. SCAFFOLD: Stochastic Controlled Averaging for Federated Learning. In Proc. International Conference on Machine Learning (ICML)

2020

Closest in time.

S. P. Karimireddy, M. Jaggi, S. Kale, M. Mohri, S. J. Reddi, S. U. Stich, A. T. Suresh. Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning. ArXiv:2008.03606

Original

2020

Closest in time.

A. Koloskova, N. Loizou, S. Boreiri, M. Jaggi, and S. U. Stich. A Unified Theory of Decentralized SGD with Changing Topology and Local Updates. In Proc. International Conference on Machine Learning (ICML)

2020

Closest in time.