EdgeShard: Efficient LLM Inference via Collaborative Edge Computing

B. Hubert et al. , “Linux advanced routing & traffic control howto,” Netherlabs BV , vol. 1, pp. 99–107, 2002

2002

Earlier work this paper cites.

W. Shi, J. Cao, Q. Zhang, Y. Li, and L. Xu, “Edge computing: Vision and challenges,” IEEE Internet of Things Journal , vol. 3, no. 5, pp. 637–646, 2016

2016

Earlier work this paper cites.

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in neural information processing systems , vol. 30, 2017

2017

Earlier work this paper cites.

S. Merity, C. Xiong, J. Bradbury, and R. Socher, “Pointer sentinel mixture models,” in International Conference on Learning Representations , 2017

2017

Earlier work this paper cites.

J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” arXiv preprint arXiv:1810.04805 , 2018

Original

2018

Earlier work this paper cites.

J. Chen and X. Ran, “Deep learning with edge computing: A review,” Proceedings of the IEEE , vol. 107, no. 8, pp. 1655–1674, 2019

2019

Earlier work this paper cites.

Y. Huang, Y. Cheng, A. Bapna, O. Firat, D. Chen, M. Chen, H. Lee, J. Ngiam, Q. V. Le, Y. Wu et al. , “Gpipe: Efficient training of giant neural networks using pipeline parallelism,” Advances in neural information processing systems , vol. 32, 2019

2019

Earlier work this paper cites.

D. Narayanan, A. Harlap, A. Phanishayee, V. Seshadri, N. R. Devanur, G. R. Ganger, P. B. Gibbons, and M. Zaharia, “Pipedream: Generalized pipeline parallelism for dnn training,” in Proceedings of the 27th ACM Symposium on Operating Systems Principles , 2019, pp. 1–15

2019

Earlier work this paper cites.

E. Frantar, S. Ashkboos, T. Hoefler, and D. Alistarh, “Gptq: Accurate post-training quantization for generative pre-trained transformers,” arXiv preprint arXiv:2210.17323 , 2022

Original

2022

Earlier work this paper cites.

——, “Optq: Accurate quantization for generative pre-trained transformers,” in The Eleventh International Conference on Learning Representations , 2022

2022

Cited alongside, same era.

M. Zhang, J. Cao, Y. Sahni, Q. Chen, S. Jiang, and T. Wu, “Eaas: A service-oriented edge computing framework towards distributed intelligence,” in 2022 IEEE International Conference on Service-Oriented System Engineering (SOSE) . IEEE, 2022, pp. 165–175

2022

Cited alongside, same era.

M. Zhang, J. Cao, L. Yang, L. Zhang, Y. Sahni, and S. Jiang, “Ents: An edge-native task scheduling system for collaborative edge computing,” in 2022 IEEE/ACM 7th Symposium on Edge Computing (SEC) . IEEE, 2022, pp. 149–161

2022

Cited alongside, same era.

J. Achiam, S. Adler, S. Agarwal, L. Ahmad, I. Akkaya, F. L. Aleman, D. Almeida, J. Altenschmidt, S. Altman, S. Anadkat et al. , “Gpt-4 technical report,” arXiv preprint arXiv:2303.08774 , 2023

Original

2023

Cited alongside, same era.

G. Xiao, J. Lin, M. Seznec, H. Wu, J. Demouth, and S. Han, “Smoothquant: Accurate and efficient post-training quantization for large language models,” in International Conference on Machine Learning . PMLR, 2023, pp. 38 087–38 099

2023

Later among the works it cites.

Y. Wang, Y. Lin, X. Zeng, and G. Zhang, “Privatelora for efficient privacy preserving llm,” arXiv preprint arXiv:2311.14030 , 2023

Original

2023

Later among the works it cites.

Y. Chen, R. Li, Z. Zhao, C. Peng, J. Wu, E. Hossain, and H. Zhang, “Netgpt: A native-ai network architecture beyond provisioning personalized generative services,” 2023

2023

Later among the works it cites.

L. Dong, F. Jiang, Y. Peng, K. Wang, K. Yang, C. Pan, and R. Schober, “Lambo: Large language model empowered edge intelligence,” arXiv preprint arXiv:2308.15078 , 2023

Original

2023

Later among the works it cites.