Fetching the paper…
Reading the bibliography…
Is it possible to design an universal API for federated learning using which an ad-hoc group of data-holders (agents) collaborate with each other and perform federated learning? Such an API would necessarily need to be model-agnostic i.e.
Federated evaluation of on-device personalization
Kangkang Wang, Rajiv Mathews, Chloé Kiddon, Hubert Eichner, Françoise Beaufays, and Daniel Ramage · 1910
Earlier work this paper cites.
Theory of reproducing kernels
Nachman Aronszajn · 1950
Earlier work this paper cites.
The product of projection operators
Israel Halperin · 1962
Earlier work this paper cites.
Practical and mathematical aspects of the problem of reconstructing objects from radiographs
Kennan T Smith, Donald C Solmon, and Sheldon L Wagner · 1977
Earlier work this paper cites.
A generalized representer theorem
Bernhard Schölkopf, Ralf Herbrich, and Alex J Smola · 2001
Earlier work this paper cites.
Alternating projections
Stephen Boyd and Jon Dattorro · 2003
Earlier work this paper cites.
Model compression
Cristian Bucilua, Rich Caruana, and Alexandru Niculescu-Mizil · 2006
Earlier work this paper cites.
The Schur complement and its applications , volume 4
Fuzhen Zhang · 2006
Earlier work this paper cites.
Local convergence for alternating and averaged nonconvex projections
Adrian Lewis, Russell Luke, and Jerome Malick · 2007
Earlier work this paper cites.
Mime: Mimicking centralized stochastic algorithms in federated learning
Sai Praneeth Karimireddy, Martin Jaggi, Satyen Kale, Mehryar Mohri, Sashank J Reddi, Sebastian U Stich, and Ananda Theertha Suresh · 2008
Earlier work this paper cites.
Ml confidential: Machine learning on encrypted data
Thore Graepel, Kristin Lauter, and Michael Naehrig · 2012
Earlier work this paper cites.
Distilling the knowledge in a neural network
Geoffrey Hinton, Oriol Vinyals, and Jeff Dean · 2015
Earlier work this paper cites.
Very deep convolutional networks for large-scale image recognition, 2015
Karen Simonyan and Andrew Zisserman · 2015
Earlier work this paper cites.
Practical secure aggregation for federated learning on user-held data
Keith Bonawitz, Vladimir Ivanov, Ben Kreuter, Antonio Marcedone, H Brendan McMahan, Sarvar Patel, Daniel Ramage, Aaron Segal, and Karn Seth · 2016
Earlier work this paper cites.
Communication-efficient learning of deep networks from decentralized data
Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Agüera y Arcas · 2017
Cited alongside, same era.
The marginal value of adaptive gradient methods in machine learning
Ashia C Wilson, Rebecca Roelofs, Mitchell Stern, Nathan Srebro, and Benjamin Recht · 2017
Cited alongside, same era.
A gift from knowledge distillation: Fast optimization, network minimization and transfer learning
Junho Yim, Donggyu Joo, Jihoon Bae, and Junmo Kim · 2017
Cited alongside, same era.
Large scale distributed neural network training through online distillation
Rohan Anil, Gabriel Pereyra, Alexandre Passos, Robert Ormandi, George E Dahl, and Geoffrey E Hinton · 2018
Cited alongside, same era.
Deep mutual learning
Ying Zhang, Tao Xiang, Timothy M Hospedales, and Huchuan Lu · 2018
Cited alongside, same era.
Adaptive federated optimization
Sashank Reddi, Zachary Charles, Manzil Zaheer, Zachary Garrett, Keith Rush, Jakub Konečnỳ, Sanjiv Kumar, and H Brendan McMahan · 2020
Later among the works it cites.
Communication-efficient federated distillation
Felix Sattler, Arturo Marban, Roman Rischke, and Wojciech Samek · 2020
Later among the works it cites.
Federated knowledge distillation
Hyowoon Seo, Jihong Park, Seungeun Oh, Mehdi Bennis, and Seong-Lyun Kim · 2020
Later among the works it cites.
Model fusion via optimal transport
Sidak Pal Singh and Martin Jaggi · 2020
Later among the works it cites.
A closer look at codistillation for distributed training
Shagun Sodhani, Olivier Delalleau, Mahmoud Assran, Koustuv Sinha, Nicolas Ballas, and Michael Rabbat · 2020
Later among the works it cites.
Knowledge distillation: A survey
Jianping Gou, Baosheng Yu, Stephen J Maybank, and Dacheng Tao · 2021
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Advances and open problems in federated learning
Peter Kairouz, H Brendan McMahan, Brendan Avent, Aurélien Bellet, Mehdi Bennis, Arjun Nitin Bhagoji, Keith Bonawitz, Zachary Charles, Graham Cormode, Rachel Cummings, et al · 2019
Cited alongside, same era.
Towards understanding ensemble, knowledge distillation and self-distillation in deep learning
Zeyuan Allen-Zhu and Yuanzhi Li · 2020
Cited alongside, same era.
Adaptive personalized federated learning
Yuyang Deng, Mohammad Mahdi Kamani, and Mehrdad Mahdavi · 2020
Cited alongside, same era.
Practical one-shot federated learning for cross-silo setting
Qinbin Li, Bingsheng He, and Dawn Song · 2020
Cited alongside, same era.
Ensemble distillation for robust model fusion in federated learning
Tao Lin, Lingjing Kong, Sebastian U Stich, and Martin Jaggi · 2020
Cited alongside, same era.
Three approaches for personalization with applications to federated learning
Yishay Mansour, Mehryar Mohri, Jae Ro, and Ananda Theertha Suresh · 2020
Cited alongside, same era.
Why distillation helps: a statistical perspective
Aditya Krishna Menon, Ankit Singh Rawat, Sashank J. Reddi, Seungyeon Kim, and Sanjiv Kumar · 2020
Cited alongside, same era.
Optimal model averaging: Towards personalized collaborative learning
Felix Grimberg, Mary-Anne Hartley, Sai Praneeth Karimireddy, and Martin Jaggi · 2021
Closest in time.
Quped: Quantized personalization via distillation with applications to federated learning
Kaan Ozkara, Navjot Singh, Deepesh Data, and Suhas Diggavi · 2021
Closest in time.
Towards understanding knowledge distillation
Mary Phuong and Christoph H. Lampert · 2021
Closest in time.
Understanding and improving knowledge distillation
Jiaxi Tang, Rakesh Shivanna, Zhe Zhao, Dong Lin, Anima Singh, Ed H. Chi, and Sagar Jain · 2021
Closest in time.
A field guide to federated optimization
Jianyu Wang, Zachary Charles, Zheng Xu, Gauri Joshi, H Brendan McMahan, Maruan Al-Shedivat, Galen Andrew, Salman Avestimehr, Katharine Daly, Deepesh Data, et al · 2021
Closest in time.
Fedkd: Communication efficient federated learning via knowledge distillation
Chuhan Wu, Fangzhao Wu, Ruixuan Liu, Lingjuan Lyu, Yongfeng Huang, and Xing Xie · 2021
Closest in time.
Fed2: Feature-aligned federated learning
Fuxun Yu, Weishan Zhang, Zhuwei Qin, Zirui Xu, Di Wang, Chenchen Liu, Zhi Tian, and Xiang Chen · 2021
Closest in time.