AdaBest: Minimizing Client Drift in Federated Learning via Adaptive Bias Estimation

LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proceedings of the IEEE 86

1998

Earlier work this paper cites.

Krizhevsky, A., Hinton, G., et al.: Learning multiple layers of features from tiny images. Tech. rep., University of Toronto (2009)

2009

Earlier work this paper cites.

Roux, N., Schmidt, M., Bach, F.: A stochastic gradient method with an exponential convergence _rate for finite training sets. Advances in neural information processing systems 25

2012

Earlier work this paper cites.

Johnson, R., Zhang, T.: Accelerating stochastic gradient descent using predictive variance reduction. Advances in neural information processing systems 26

2013

Earlier work this paper cites.

Shalev-Shwartz, S., Zhang, T.: Stochastic dual coordinate ascent methods for regularized loss minimization. Journal of Machine Learning Research 14

2013

Earlier work this paper cites.

Shamir, O., Srebro, N., Zhang, T.: Communication-efficient distributed optimization using an approximate newton-type method. In: International conference on machine learning. pp. 1000–1008. PMLR (2014)

2014

Earlier work this paper cites.

Xiao, L., Zhang, T.: A proximal stochastic gradient method with progressive variance reduction. SIAM Journal on Optimization 24

2014

Earlier work this paper cites.

Babanezhad Harikandeh, R., Ahmed, M.O., Virani, A., Schmidt, M., Konečnỳ, J., Sallinen, S.: Stopwasting my gradients: Practical svrg. Advances in Neural Information Processing Systems 28

2015

Earlier work this paper cites.

Konečnỳ, J., Liu, J., Richtárik, P., Takáč, M.: Mini-batch semi-stochastic gradient descent in the proximal setting. IEEE Journal of Selected Topics in Signal Processing 10

2015

Earlier work this paper cites.

Konečnỳ, J., McMahan, H.B., Ramage, D., Richtárik, P.: Federated optimization: Distributed machine learning for on-device intelligence. arXiv preprint arXiv:1610.02527 (2016)

Original

2016

Earlier work this paper cites.

Reddi, S.J., Konečnỳ, J., Richtárik, P., Póczós, B., Smola, A.: Aide: Fast and communication efficient distributed optimization. arXiv preprint arXiv:1608.06879 (2016)

Original

2016

Earlier work this paper cites.

McMahan, B., Moore, E., Ramage, D., Hampson, S., y Arcas, B.A.: Communication-efficient learning of deep networks from decentralized data. In: Artificial intelligence and statistics. pp. 1273–1282. PMLR (2017)

2017

Earlier work this paper cites.

Nguyen, L.M., Liu, J., Scheinberg, K., Takáč, M.: Sarah: A novel method for machine learning problems using stochastic recursive gradient. In: International Conference on Machine Learning. pp. 2613–2621. PMLR (2017)

2017

Cited alongside, same era.

Stich, S.U.: Local sgd converges fast and communicates little. In: International Conference on Learning Representations (2018)

2018

Cited alongside, same era.

Zhao, Y., Li, M., Lai, L., Suda, N., Civin, D., Chandra, V.: Federated learning with non-iid data. arXiv preprint arXiv:1806.00582 (2018)

Original

2018

Cited alongside, same era.

Hsu, T.M.H., Qi, H., Brown, M.: Measuring the effects of non-identical data distribution for federated visual classification. arXiv preprint arXiv:1909.06335 (2019)

Original

2019

Cited alongside, same era.

Li, D., Wang, J.: Fedmd: Heterogenous federated learning via model distillation. arXiv preprint arXiv:1910.03581 (2019)

Li, T., Sahu, A.K., Zaheer, M., Sanjabi, M., Talwalkar, A., Smith, V.: Federated optimization in heterogeneous networks. Proceedings of Machine Learning and Systems 2

2020

Later among the works it cites.

Lin, T., Kong, L., Stich, S.U., Jaggi, M.: Ensemble distillation for robust model fusion in federated learning. Advances in Neural Information Processing Systems 33

2020

Later among the works it cites.

Pathak, R., Wainwright, M.J.: Fedsplit: An algorithmic framework for fast federated optimization. Advances in Neural Information Processing Systems 33

2020

Later among the works it cites.

Wang, J., Liu, Q., Liang, H., Joshi, G., Poor, H.V.: Tackling the objective inconsistency problem in heterogeneous federated optimization. Advances in neural information processing systems 33

2020

Later among the works it cites.

Zhang, X., Hong, M., Dhople, S., Yin, W., Liu, Y.: Fedpd: A federated learning framework with optimal rates and adaptivity to non-iid data. arXiv preprint arXiv:2005.11418 (2020)