Fetching the paper…
Reading the bibliography…
In this work, we explore combining automatic hyperparameter tuning and optimization for federated learning (FL) in an online, one-shot procedure.
Inequalities
G. Hardy, J. Littlewood, and G. Pólya · 1988
Earlier work this paper cites.
Simple statistical gradient-following algorithms for connectionist reinforcement learning
R. J. Williams · 1992
Earlier work this paper cites.
Discrete convex analysis
K. Murota · 1998
Earlier work this paper cites.
Online convex programming and generalized infinitesimal gradient ascent
M. Zinkevich · 2003
Earlier work this paper cites.
Discrete-Time Signal Processing
A. V. Oppenheim and R. W. Schafer · 2009
Earlier work this paper cites.
Auto-encoding variational bayes, 2013
D. P. Kingma and M. Welling · 2013
Earlier work this paper cites.
Adam: A method for stochastic optimization, 2014
D. P. Kingma and J. Ba · 2014
Earlier work this paper cites.
Communication-efficient learning of deep networks from decentralized data, 2016
H. B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas · 2016
Earlier work this paper cites.
Online optimization in dynamic environments: Improved regret rates for strongly convex problems
A. Mokhtari, S. Shahrampour, A. Jadbabaie, and A. Ribeiro · 2016
Earlier work this paper cites.
Online learning rate adaptation with hypergradient descent, 2017
A. G. Baydin, R. Cornish, D. M. Rubio, M. Schmidt, and F. Wood · 2017
Earlier work this paper cites.
Emnist: Extending mnist to handwritten letters
G. Cohen, S. Afshar, J. Tapson, and A. Van Schaik · 2017
Earlier work this paper cites.
Convergence of the exponentiated gradient method with armijo line search
Y.-H. Li and V. Cevher · 2018
Earlier work this paper cites.
Efficient neural architecture search via parameters sharing
H. Pham, M. Guan, B. Zoph, Q. Le, and J. Dean · 2018
Cited alongside, same era.
Adaptive communication strategies to achieve the best error-runtime trade-off in local-update sgd, 2018
J. Wang and G. Joshi · 2018
Cited alongside, same era.
ProxylessNAS: Direct neural architecture search on target task and hardware
H. Cai, L. Zhu, and S. Han · 2019
Cited alongside, same era.
Exponentiated gradient meets gradient descent, 2019
U. Ghai, E. Hazan, and Y. Singer · 2019
Cited alongside, same era.
Adaptive gradient-based meta-learning methods, 2019
M. Khodak, M.-F. Balcan, and A. Talwalkar · 2019
Cited alongside, same era.
On the convergence of fedavg on non-iid data, 2019
X. Li, K. Huang, W. Yang, S. Wang, and Z. Zhang · 2019
Adaptive federated optimization, 2020
S. Reddi, Z. Charles, M. Zaheer, Z. Garrett, K. Rush, J. Konečný, S. Kumar, and H. B. McMahan · 2020
Later among the works it cites.
Differentially private federated bayesian optimization with distributed exploration, 2021
Z. Dai, B. K. H. Low, and P. Jaillet · 2021
Later among the works it cites.
Evaluation of hyperparameter-optimization approaches in an industrial federated learning system, 2021
S. Holly, T. Hiessl, S. R. Lakani, D. Schall, C. Heitzinger, and J. Kemnitz · 2021
Later among the works it cites.
Federated hyperparameter tuning: Challenges, baselines, and connections to weight-sharing
M. Khodak, R. Tu, T. Li, L. Li, N. Balcan, V. Smith, and A. Talwalkar · 2021
Later among the works it cites.
Fedjax: Federated learning simulation with jax
J. H. Ro, A. T. Suresh, and K. Wu · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Robust federated learning through representation matching and adaptive hyper-parameters, 2019
H. Mostafa · 2019
Cited alongside, same era.
Tensorflow federated stack overflow dataset, 2019
TensorFlow-Federated-Authors · 2019
Cited alongside, same era.
On the outsized importance of learning rates in local update methods, 2020
Z. Charles and J. Konečný · 2020
Cited alongside, same era.
Federated bayesian optimization via thompson sampling, 2020
Z. Dai, K. H. Low, and P. Jaillet · 2020
Cited alongside, same era.
Local sgd: Unified theory and new efficient methods, 2020
E. Gorbunov, F. Hanzely, and P. Richtárik · 2020
Cited alongside, same era.
Geometry-aware gradient algorithms for neural architecture search, 2020
L. Li, M. Khodak, M.-F. Balcan, and A. Talwalkar · 2020
Cited alongside, same era.
A field guide to federated optimization, 2021
J. Wang, Z. Charles, Z. Xu, G. Joshi, H. B. McMahan, B. A. y Arcas, M. Al-Shedivat, G. Andrew, S. Avestimehr, K. Daly, D. Data, S. Diggavi, H. Eichner, A. Gadhikar, Z. Garrett, A. M. Girgis, F. Hanzely, A. Hard, C. He, S. Horvath, Z. Huo, A. Ingerman, M. Jaggi, T. Javidi, P. Kairouz, S. Kale, S. P. Karimireddy, J. Konecny, S. Koyejo, T. Li, L. Liu, M. Mohri, H. Qi, S. J. Reddi, P. Richtarik, K. Singhal, V. Smith, M. Soltanolkotabi, W. Song, A. T. Suresh, S. U. Stich, A. Talwalkar, H. Wang, B. Woodworth, S. Wu, F. X. Yu, H. Yuan, M. Zaheer, M. Zhang, T. Zhang, C. Zheng, C. Zhu, and W. Zhu · 2021
Later among the works it cites.
Achieving linear speedup with partial worker participation in non-iid federated learning, 2021
H. Yang, M. Fang, and J. Liu · 2021
Later among the works it cites.
Step-size adaptation using exponentiated gradient updates, 2022
E. Amid, R. Anil, C. Fifty, and M. K. Warmuth · 2022
Closest in time.
Auto-fedrl: Federated hyperparameter optimization for multi-institutional medical image segmentation
P. Guo, D. Yang, A. Hatamizadeh, A. Xu, Z. Xu, W. Li, C. Zhao, D. Xu, S. Harmon, E. Turkbey, et al · 2022
Closest in time.
Fedhpo-b: A benchmark suite for federated hyperparameter optimization, 2022
Z. Wang, W. Kuang, C. Zhang, B. Ding, and Y. Li · 2022
Closest in time.
Single-shot hyper-parameter optimization for federated learning: A general algorithm and analysis, 2022
Y. Zhou, P. Ram, T. Salonidis, N. Baracaldo, H. Samulowitz, and H. Ludwig · 2022
Closest in time.