Clustered Sampling: Low-Variance and Improved Representativity for Clients Selection in Federated Learning

Clustered Federated Learning: Model-Agnostic Distributed Multi-Task Optimization under Privacy Constraints

Original

Sattler, F., Müller, K.-R., and Samek, W · 1910

Earlier work this paper cites.

Hierarchical grouping to optimize an objective function

Ward, J. H · 1963

Earlier work this paper cites.

Learning multiple layers of features from tiny images

Krizhevsky, A · 2009

Earlier work this paper cites.

Communication-Efficient Learning of Deep Networks from Decentralized Data

McMahan, B., Moore, E., Ramage, D., Hampson, S., and y Arcas, B. A · 2017

Earlier work this paper cites.

Optimization methods for large-scale machine learning

Bottou, L., Curtis, F. E., and Nocedal, J · 2018

Earlier work this paper cites.

Federated Optimization in Heterogeneous Networks

Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., and Smith, V · 2018

Earlier work this paper cites.

Local SGD with periodic averaging: Tighter analysis and adaptive synchronization

Haddadpour, F., Kamani, M. M., Mahdavi, M., and Cadambe, V. R · 2019

Earlier work this paper cites.

Measuring the effects of non-identical data distribution for federated visual classification

Harry Hsu, T. M., Qi, H., and Brown, M · 2019

Cited alongside, same era.

Client selection for federated learning with heterogeneous resources in mobile edge

Nishio, T. and Yonetani, R · 2019

Cited alongside, same era.

Local SGD converges fast and communicates little

Stich, S. U · 2019

Cited alongside, same era.

Matcha: Speeding up decentralized sgd via matching decomposition sampling

Wang, J., Sahu, A. K., Yang, Z., Joshi, G., and Kar, S · 2019

Cited alongside, same era.

Parallel Restarted SGD with Faster Convergence and Less Communication: Demystifying Why Model Averaging Works for Deep Learning

Yu, H., Yang, S., and Zhu, S · 2019

Cited alongside, same era.

Optimal Client Sampling for Federated Learning

Chen, W., Horvath, S., and Richtarik, P · 2020

SCAFFOLD: Stochastic controlled averaging for federated learning

Karimireddy, S. P., Kale, S., Mohri, M., Reddi, S., Stich, S., and Suresh, A. T · 2020

Later among the works it cites.

Tighter theory for local sgd on identical and heterogeneous data

Khaled, A., Mishchenko, K., and Richtarik, P · 2020

Later among the works it cites.

On the convergence of fedavg on non-iid data

Li, X., Huang, K., Yang, W., Wang, S., and Zhang, Z · 2020

Later among the works it cites.

Don’t use large mini-batches, use local sgd

Lin, T., Stich, S. U., Patel, K. K., and Jaggi, M · 2020

Later among the works it cites.

Tackling the objective inconsistency problem in heterogeneous federated optimization

Wang, J., Liu, Q., Liang, H., Joshi, G., and Poor, H. V · 2020

Later among the works it cites.

Is local SGD better than minibatch SGD?

Woodworth, B., Patel, K. K., Stich, S., Dai, Z., Bullins, B., Mcmahan, B., Shamir, O., and Srebro, N · 2020