Wireless Federated Distillation for Distributed Edge Learning with Heterogeneous Data

D. L. Donoho, A. Maleki, and A. Montanari, “Message-passing algorithms for compressed sensing,” Proc. Nat. Acad. Sci. USA

Original

1907

Earlier work this paper cites.

T. M. Cover and J. A. Thomas, Elements of Information Theory

2006

Earlier work this paper cites.

B. Nazer and M. Gastpar, “Computation over multiple-access channels,” IEEE Trans. Inf. Theory

2007

Earlier work this paper cites.

M. Goldenbaum, H. Boche, and S. Stańczak, “Harnessing interference for analog function computation in wireless sensor networks,” IEEE Trans. Signal Process

2013

Earlier work this paper cites.

G. Hinton, O. Vinyals, and J. Dean, “Distilling the knowledge in a neural network,” in Proc. NIPS

2014

Earlier work this paper cites.

H. B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas, “Communication-efficient learning of deep networks from decentralized data,” in Proc. Int. Conf. on AISTATS

2017

Cited alongside, same era.

E. Jeong, S. Oh, H. Kim, J. Park, M. Bennis, and S. Kim, “Communication-efficient on-device machine learning: federated distillation and augmentation under Non-IID private data,” in Proc. NIPS

2018

Cited alongside, same era.

R. Anil, G. Pereyra, A. Passos, R. Ormandi, G. E. Dahl, and G. Hinton, “Large scale distributed neural network training through online distillation,” in Proc. Int. Conf. on Learning Representations (ICLR)

2018

Cited alongside, same era.

Y. Zhang, T. Xiang, T. M. Hospedales, and H. Lu, “Deep mutual learning,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

2018

Cited alongside, same era.

G. Zhu and K. Huang, “MIMO over-the-air computation for high mobility multi-modal sensing,” IEEE Internet Things J

2018

Later among the works it cites.

F. Sattler, S. Wiedemann, K.-R. Müller, W. Samek, “Sparse binary compression: Towards distributed deep learning with minimal communication,” ArXiv e-prints

2018

Later among the works it cites.

G. Zhu, Y. Wang, and K. Huang, “Low-latency broadband analog aggregation for federated edge learning,” ArXiv e-prints

2019

Closest in time.

M. M. Amiri and D. Gündüz, “Machine learning at the wireless edge: Distributed stochastic gradient descent over-the-air,” ArXiv e-prints

2019

Closest in time.