Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunities

P. Vepakomma, O. Gupta, T. Swedish, and R. Raskar, “Split Learning for Health: Distributed Deep Learning Without Sharing Raw Patient Data,” arXiv preprint arXiv:1812.00564 , Dec. 2018

Original

2018

Earlier work this paper cites.

D. Narayanan, M. Shoeybi, J. Casper, P. LeGresley, M. Patwary, V. Korthikanti, D. Vainbrand, P. Kashinkunti, J. Bernauer, B. Catanzaro et al. , “Efficient Large-scale Language Model Training on GPU Clusters Using Megatron-LM,” in Proc. SC , Nov. 2021, pp. 1–15

2021

Earlier work this paper cites.

J. Achiam, S. Adler, S. Agarwal, L. Ahmad, I. Akkaya, F. L. Aleman, D. Almeida, J. Altenschmidt, S. Altman, S. Anadkat et al. , “Gpt-4 Technical Report,” arXiv preprint arXiv:2303.08774 , Mar. 2023

Original

2023

Earlier work this paper cites.

D. Driess, F. Xia, M. S. Sajjadi, C. Lynch, A. Chowdhery, B. Ichter, A. Wahid, J. Tompson, Q. Vuong, T. Yu et al. , “Palm-e: An Embodied Multimodal Language Model,” Proc. ICML , Jul. 2023

2023

Earlier work this paper cites.

ITU-R, “IMT-2030 Framework and Overall Objectives of the Future Development of IMT for 2030 and Beyond,” https://www.itu.int/rec/R-REC-M.2160 , 2023

2023

Earlier work this paper cites.

Nvidia, “Fastertransformer,” 2023. [Online]. Available: https://github.com/NVIDIA/FasterTransformer

2023

Cited alongside, same era.

Y. Leviathan, M. Kalman, and Y. Matias, “Fast Inference From Transformers via Speculative Decoding,” in Proc. ICML , 2023

2023

Cited alongside, same era.

Y. Shen, J. Shao, X. Zhang, Z. Lin, H. Pan, D. Li, J. Zhang, and K. B. Letaief, “Large Language Models Empowered Autonomous Edge AI for Connected Intelligence,” IEEE Commun. Mag. , Jan. 2024

2024

Cited alongside, same era.

K. Alizadeh, S. I. Mirzadeh, D. Belenko, S. Khatamifard, M. Cho, C. C. Del Mundo, M. Rastegari, and M. Farajtabar, “LLM in a Flash: Efficient Large Language Model Inference with Limited Memory,” in Proc. ACL , Jul. 2024

2024

Cited alongside, same era.

Z. Liu, C. Zhao, F. Iandola, C. Lai, Y. Tian, I. Fedorov, Y. Xiong, E. Chang, Y. Shi, R. Krishnamoorthi et al. , “MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases,” arXiv preprint arXiv:2402.14905 , Feb. 2024

Z. Lin, G. Qu, X. Chen, and K. Huang, “Split Learning in 6G Edge Networks,” IEEE Wireless Commun. , Jan. 2024

2024

Closest in time.

Z. Lin, X. Hu, Y. Zhang, Z. Chen, Z. Fang, X. Chen, A. Li, P. Vepakomma, and Y. Gao, “Splitlora: A Split Parameter-efficient Fine-tuning Framework for Large Language Models,” arXiv preprint arXiv:2407.00952 , Jul. 2024

Original

2024

Closest in time.

H. Kang, Q. Zhang, S. Kundu, G. Jeong, Z. Liu, T. Krishna, and T. Zhao, “Gear: An Efficient KV Cache Compression Recipefor Near-lossless Generative Inference of LLM,” arXiv preprint arXiv:2403.05527 , Mar. 2024

Original

2024

Closest in time.

J. Wang, H. Du, D. Niyato, J. Kang, Z. Xiong, D. I. Kim, and K. B. Letaief, “Toward Scalable Generative AI via Mixture of Experts in Mobile Edge Networks,” arXiv preprint arXiv:2402.06942 , Feb. 2024

Original

2024

Closest in time.