Adaptive Distillation for Decentralized Learning from Heterogeneous Clients

M. Li, R. Poovendran, and S. Narayanan, “Protecting Patient Privacy against Unauthorized Release of Medical Images in a Group Communication Environment,” Computerized Medical Imaging and Graphics , vol. 29, no. 5, pp. 367 – 383, 2005

2005

Earlier work this paper cites.

P.-Y. Hsueh, P. Melville, and V. Sindhwani, “Data Quality from Crowdsourcing: A Study of Annotation Selection Criteria,” in NAACL HLT Workshop on Active Learning for Natural Language Processing , 2009

2009

Earlier work this paper cites.

C. Dwork, A. Roth et al. , “The Algorithmic Foundations of Differential Privacy,” Foundations and Trends® in Theoretical Computer Science , vol. 9, no. 3–4, pp. 211–407, 2014

2014

Earlier work this paper cites.

I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, “Generative Adversarial Nets,” in Conference on Neural Information Processing Systems , 2014, pp. 2672–2680

2014

Earlier work this paper cites.

G. Hinton, O. Vinyals, and J. Dean, “Distilling the knowledge in a neural network,” arXiv preprint arXiv:1503.02531 , 2015

Original

2015

Earlier work this paper cites.

A. A. Rusu, S. G. Colmenarejo, C. Gulcehre, G. Desjardins, J. Kirkpatrick, R. Pascanu, V. Mnih, K. Kavukcuoglu, and R. Hadsell, “Policy Distillation,” arXiv preprint arXiv:1511.06295 , 2015

Original

2015

Earlier work this paper cites.

S. Chowdhury, M. S. Ferdous, and J. M. Jose, “Exploring Lifelog Sharing and Privacy,” in ACM International Joint Conference on Pervasive and Ubiquitous Computing , 2016, pp. 553–558

2016

Earlier work this paper cites.

J. Konecný, H. B. McMahan, F. X. Yu, P. Richtárik, A. T. Suresh, and D. Bacon, “Federated Learning: Strategies for Improving Communication Efficiency,” in NIPS Workshop on Private Multi-Party Machine Learning , 2016

2016

Earlier work this paper cites.

G. B. Giannakis, Q. Ling, G. Mateos, I. D. Schizas, and H. Zhu, “Decentralized Learning for Wireless Communications and Networking,” in Splitting Methods in Communication, Imaging, Science, and Engineering , 2016, pp. 461–497

2016

Earlier work this paper cites.

N. Papernot, M. Abadi, U. Erlingsson, I. Goodfellow, and K. Talwar, “Semi-Supervised Knowledge Transfer for Deep Learning from Private Training Data,” arXiv preprint arXiv:1610.05755 , 2016

Original

2016

Earlier work this paper cites.

K. He, X. Zhang, S. Ren, and J. Sun, “Deep Residual Learning for Image Recognition,” in IEEE Conference on Computer Vision and Pattern Recognition , 2016, pp. 770–778

2016

Cited alongside, same era.

H. B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas, “Communication-Efficient Learning of Deep Networks from Decentralized Data,” in International Conference on Artificial Intelligence and Statistics , 2017

2017

Cited alongside, same era.

K. Bonawitz, V. Ivanov, B. Kreuter, A. Marcedone, H. B. McMahan, S. Patel, D. Ramage, A. Segal, and K. Seth, “Practical Secure Aggregation for Privacy-Preserving Machine Learning,” in ACM Computer and Communications Security Conference , 2017, pp. 1175–1191

2017

Cited alongside, same era.

A. Tarvainen and H. Valpola, “Mean Teachers are Better Role Models: Weight-Averaged Consistency Targets Improve Semi-supervised Deep Learning Results,” in Conference on Neural Information Processing Systems , 2017, pp. 1195–1204

2017

E. Bagdasaryan, A. Veit, Y. Hua, D. Estrin, and V. Shmatikov, “How To Backdoor Federated Learning,” arXiv preprint arXiv:1807.00459 , 2018

Original

2018

Later among the works it cites.

S. Wang, T. Tuor, T. Salonidis, K. K. Leung, C. Makaya, T. He, and K. Chan, “When Edge Meets Learning: Adaptive Control for Resource-Constrained Distributed Machine Learning,” in IEEE International Conference on Communications , 2018

2018

Later among the works it cites.

N. Papernot, S. Song, I. Mironov, A. Raghunathan, K. Talwar, and Ú. Erlingsson, “Scalable Private Learning with PATE,” arXiv preprint arXiv:1802.08908 , 2018

Original

2018

Later among the works it cites.

R. Anil, G. Pereyra, A. Passos, R. Ormandi, G. E. Dahl, and G. E. Hinton, “Large Scale Distributed Neural Network Training through Online Distillation,” arXiv preprint arXiv:1804.03235 , 2018

Original

2018

Later among the works it cites.