Fetching the paper…
Reading the bibliography…
The theoretical landscape of federated learning (FL) undergoes rapid evolution, but its practical application encounters a series of intricate challenges, and hyperparameter optimization is one of these critical challenges.
Two-point step size gradient methods
Jonathan Barzilai and Jonathan M Borwein · 1988
Earlier work this paper cites.
Federated learning with matched averaging
Hongyi Wang, Mikhail Yurochkin, Yuekai Sun, Dimitris Papailiopoulos, and Yasaman Khazaeni · 2002
Earlier work this paper cites.
Bidirectional lstm networks for improved phoneme classification and recognition
Alex Graves, Santiago Fernández, and Jürgen Schmidhuber · 2005
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Alex Krizhevsky, Geoffrey Hinton, et al · 2009
Earlier work this paper cites.
Large-scale machine learning with stochastic gradient descent
Léon Bottou · 2010
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P Kingma and Jimmy Ba · 2014
Earlier work this paper cites.
Gradient-based hyperparameter optimization through reversible learning
Dougal Maclaurin, David Duvenaud, and Ryan Adams · 2015
Earlier work this paper cites.
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Earlier work this paper cites.
Online learning rate adaptation with hypergradient descent
Atilim Gunes Baydin, Robert Cornish, David Martinez Rubio, Mark Schmidt, and Frank Wood · 2017
Earlier work this paper cites.
Communication-efficient learning of deep networks from decentralized data
Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas · 2017
Earlier work this paper cites.
Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms
Han Xiao, Kashif Rasul, and Roland Vollgraf · 2017
Earlier work this paper cites.
Federated learning of predictive models from federated electronic health records
Theodora S Brisimi, Ruidi Chen, Theofanie Mela, Alex Olshevsky, Ioannis Ch Paschalidis, and Wei Shi · 2018
Cited alongside, same era.
Federated learning for mobile keyboard prediction
Andrew Hard, Kanishka Rao, Rajiv Mathews, Swaroop Ramaswamy, Françoise Beaufays, Sean Augenstein, Hubert Eichner, Chloé Kiddon, and Daniel Ramage · 2018
Cited alongside, same era.
On the convergence of fedavg on non-iid data
Xiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang, and Zhihua Zhang · 2019
Cited alongside, same era.
Adagrad—an optimizer for stochastic gradient descent
Agnes Lydia and Sagayaraj Francis · 2019
Cited alongside, same era.
How does learning rate decay help modern neural networks?
Kaichao You, Mingsheng Long, Jianmin Wang, and Michael I Jordan · 2019
A survey on federated learning
Chen Zhang, Yu Xie, Hang Bai, Bin Yu, Weihong Li, and Yuan Gao · 2021
Later among the works it cites.
Flora: Single-shot hyper-parameter optimization for federated learning
Yi Zhou, Parikshit Ram, Theodoros Salonidis, Nathalie Baracaldo, Horst Samulowitz, and Heiko Ludwig · 2021
Later among the works it cites.
Differentiable self-adaptive learning rate
Bozhou Chen, Hongzhi Wang, and Chenmin Ba · 2022
Later among the works it cites.
Adaptive hierarchical hyper-gradient descent
Renlong Jie, Junbin Gao, Andrey Vasnev, and Minh-Ngoc Tran · 2022
Later among the works it cites.
Federated hypergradient descent
Andrew K Kan · 2022
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Mime: Mimicking centralized stochastic algorithms in federated learning
Sai Praneeth Karimireddy, Martin Jaggi, Satyen Kale, Mehryar Mohri, Sashank J Reddi, Sebastian U Stich, and Ananda Theertha Suresh · 2020
Cited alongside, same era.
Weight sharing for hyperparameter optimization in federated learning
Mikhail Khodak, Tian Li, Liam Li, M Balcan, Virginia Smith, and Ameet Talwalkar · 2020
Cited alongside, same era.
Accelerating federated learning via momentum gradient descent
Wei Liu, Li Chen, Yunfei Chen, and Wenyi Zhang · 2020
Cited alongside, same era.
Adaptive federated optimization
Sashank Reddi, Zachary Charles, Manzil Zaheer, Zachary Garrett, Keith Rush, Jakub Konečnỳ, Sanjiv Kumar, and H Brendan McMahan · 2020
Cited alongside, same era.
Genetic cfl: Hyperparameter optimization in clustered federated learning
Shaashwat Agrawal, Sagnik Sarkar, Mamoun Alazab, Praveen Kumar Reddy Maddikunta, Thippa Reddy Gadekallu, Quoc-Viet Pham, et al · 2021
Cited alongside, same era.
Advances and open problems in federated learning
Peter Kairouz, H Brendan McMahan, Brendan Avent, Aurélien Bellet, Mehdi Bennis, Arjun Nitin Bhagoji, Kallista Bonawitz, Zachary Charles, Graham Cormode, Rachel Cummings, et al · 2021
Cited alongside, same era.
Tackling the objective inconsistency problem in heterogeneous federated optimization
Jianyu Wang, Qinghua Liu, Hao Liang, Gauri Joshi, and H Vincent Poor
Cited in the paper.
To talk or to work: Dynamic batch sizes assisted time efficient federated learning over future mobile edge devices
Dian Shi, Liang Li, Maoqiang Wu, Minglei Shu, Rong Yu, Miao Pan, and Zhu Han · 2022
Later among the works it cites.
Fedhpo-b: A benchmark suite for federated hyperparameter optimization
Zhen Wang, Weirui Kuang, Ce Zhang, Bolin Ding, and Yaliang Li · 2022
Later among the works it cites.
Seizing critical learning periods in federated learning
Gang Yan, Hao Wang, and Jian Li · 2022
Later among the works it cites.
Single-shot hyper-parameter optimization for federated learning: A general algorithm & analysis
Yi Zhou, Parikshit Ram, Theodoros Salonidis, Nathalie Baracaldo, Horst Samulowitz, and Heiko Ludwig · 2022
Later among the works it cites.
Fedexp: Speeding up federated averaging via extrapolation
Divyansh Jhunjhunwala, Shiqiang Wang, and Gauri Joshi · 2023
Closest in time.