Accelerating DNN Training in Wireless Federated Edge Learning Systems

M. Chen, Z. Yang, W. Saad, C. Yin, H. V. Poor, and S. Cui, “A joint learning and communications framework for federated learning over wireless networks,” 2019, arXiv:1909.07972. [Online]. Available: http://arxiv.org/abs/1909.07972

Original

1909

Earlier work this paper cites.

G. Zhu, Y. Du, D. Gunduz, K. Huang, “One-bit over-the-air aggregation for communication-efficient federated edge learning: Design and convergence analysis,” 2020, arXiv:2001.05713 , 2020. [Online]. Available: http://arxiv.org/abs/2001.05713

Original

2001

Earlier work this paper cites.

S. Geisser and W. M. Johnson, Modes of Parametric Statistical Inference. Hoboken, NJ, USA: Wiley, 2006

2006

Earlier work this paper cites.

M. Li, T. Zhang, Y. Chen, and A. J. Smola, “Efficient mini-batch training for stochastic optimization,” in Proc. ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining , New York, NY, USA, Aug. 2014, pp. 661-670

2014

Earlier work this paper cites.

A. Krizhevsky, “One weird trick for parallelizing convolutional neural networks,” 2014, arXiv:1404.5997. [Online]. Available: http://arxiv.org/abs/1404.5997

Original

2014

Earlier work this paper cites.

Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature , vol. 521, pp. 436-444, May 2015

2015

Earlier work this paper cites.

J. Konečnỳ, H. B. McMahan, F. X. Yu, P. Richtárik, A. T. Suresh, and D. Bacon, “Federated learning: Strategies for improving communication efficiency,” in Proc. of NeurIPS Workshop on Private Multi-Party Machine Learning , Barcelona, Spain, Dec. 2016, pp. 1-5

2016

Earlier work this paper cites.

J. Liu, B. Bai, J. Zhang, and K. B. Letaief, “Content caching at the wireless network edge: A distributed algorithm via belief propagation,” in Proc. IEEE Int. Conf. Commun. (ICC) , Kuala Lumpur, Malaysia, May 2016, pp. 1-6

2016

Earlier work this paper cites.

Y. Mao, C. You, J. Zhang, K. Huang, and K. B. Letaief, “A survey on mobile edge computing: The communication perspective,” IEEE Commun. Surveys Tuts. , vol. 19, no. 4, pp. 2322-2358, Aug. 2017

2017

Earlier work this paper cites.

C. You, K. Huang, H. Chae, and B.-H. Kim, “Energy-efficient resource allocation for mobile-edge computation offloading,” IEEE Trans. Wireless Commun. , vol. 16, no. 3, pp. 1397-1411, Mar. 2017

2017

Earlier work this paper cites.

Y. Mao, J. Zhang, S. H. Song, and K. B. Letaief, “Stochastic joint radio and computational resource management for multi-user mobile-edge computing systems,” IEEE Trans. Wireless Commun. , vol. 16, no. 9, pp. 5994-6009, Sep. 2017

2017

Earlier work this paper cites.

H. B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas, “Communication-efficient learning of deep networks from decentralized data,” in Proc. Int. Conf. Artif. Intell. Statist. (AISTATS) , Fort Lauderdale, FL, USA, Apr. 2017, pp. 1-10

2017

Earlier work this paper cites.

D. Alistarh, D. Grubic, J. Li, R. Tomioka, and M. Vojnovic, “Qsgd: Communication-efficient sgd via gradient quantization and encoding,” in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS) , Long Beach, CA, USA, Dec. 2017, pp. 1707-1718

2017

Cited alongside, same era.

V. Smith, C.-K. Chiang, M. Sanjabi, and A. S. Talwalkar, “Federated multi-task learning,” in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS) , Long Beach, CA, USA, Dec. 2017, pp. 4427-4437

2017

Cited alongside, same era.

P. Goyal et al. . “Accurate, large minibatch SGD: Training imagenet in 1 hour,” 2017, arXiv:1706.02677. [Online]. Available: http://arxiv.org/abs/1706.02677

Original

2017

Cited alongside, same era.

Q. Mao, F. Hu, and Q. Hao, “Deep learning for intelligent wireless networks: A comprehensive survey,” IEEE Commun. Surveys Tuts. , vol. 20, no. 4, pp. 2595-2621, 4th Quart., 2018

2018

Cited alongside, same era.

C. Zhang, P. Patras, and H. Haddadi, “Deep learning in mobile and wireless networking: A survey,” IEEE Commun. Surveys Tuts. , vol. 21, no. 3, pp. 2224-2287, 3rd Quart., 2019

2019

Closest in time.

F. Sattler, S. Wiedemann, K.-R. Müller, and W. Samek, “Sparse binary compression: Towards distributed deep learning with minimal communication,” in Proc. Int. Joint Conf. Neural Networks (IJCNN) , Budapest, Hungary, Jul. 2019, pp. 1–8

2019

Closest in time.

S. Wang, T. Tuor, T. Salonidis, K. K. Leung, C. Makaya, T. He, and K. Chan, “Adaptive federated learning in resource constrained edge computing systems,” IEEE J. Sel. Areas Commun. , vol. 37 no. 6, pp. 1205-1221, Jun. 2019

2019

Closest in time.

N. H. Tran, W. Bao, A. Zomaya, N. Minh N.H., and C. S. Hong, “Federated learning over wireless networks: Optimization model design and analysis,” in Proc. IEEE Int. Conf. Comput. Comnun. , Paris, France, Apr. 2019, pp. 1387-1395

2019

Closest in time.