NetGPT: A Native-AI Network Architecture Beyond Provisioning Personalized Generative Services

Built on

N. Shazeer, “GLU variants improve transformer,” Feb. 2020. [Online]. Available: http://arxiv.org/abs/2002.05202
Original
2002
Earlier work this paper cites.
L. Pang, C. Yang , et al. , “A survey on intent-driven networks,” IEEE Access , vol. 8, pp. 22 862–22 873, 2020
2020
Earlier work this paper cites.
N. Kandpal, E. Wallace , et al. , “Deduplicating training data mitigates privacy risks in language models,” in Proc. ICML 2022 , Baltimore, USA, Jun. 2022
2022
Earlier work this paper cites.
E. J. Hu, Y. Shen , et al. , “LoRA: Low-rank adaptation of large language models,” in Proc. ICLR 2022 , Virtual Edition, Jan. 2022
2022
Earlier work this paper cites.
H. Zou, Q. Zhao , et al. , “Wireless multi-agent generative AI: From connected intelligence to collective intelligence,” Jul. 2023. [Online]. Available: http://arxiv.org/abs/2307.02757
Original
2023
Earlier work this paper cites.

W. Wang, M. Ghobadi , et al. , “How to build low-cost networks for large language models (without sacrificing performance)?” Nov. 2023. [Online]. Available: http://arxiv.org/abs/2307.12169
Original
2023
Cited alongside, same era.
J. Zhang, S. Vahidian , et al. , “Towards building the federated GPT: Federated instruction tuning,” in International Workshop on Federated Learning in the Age of Foundation Models in Conjunction with NeurIPS 2023 , New Orleans, LA, USA, Dec. 2023
2023
Cited alongside, same era.
M. Xu, H. Du , et al. , “Unleashing the power of edge-cloud generative AI in mobile networks: A survey of AIGC services,” Oct. 2023. [Online]. Available: http://arxiv.org/abs/2303.16129
Original
2023
Cited alongside, same era.
W. Wu, M. Li , et al. , “Split learning over wireless networks: Parallel design and resource management,” IEEE J. Sel. Area. Comm. , vol. 41, no. 4, pp. 1051–1066, Apr. 2023
2023
Cited alongside, same era.

H. Touvron, T. Lavril , et al. , “LLaMA: Open and efficient foundation language models,” Feb. 2023. [Online]. Available: http://arxiv.org/abs/2302.13971
Original
2023
Closest in time.
Y. Wang, Y. Kordi , et al. , “Self-instruct: Aligning language model with self generated instructions,” in Proc. ACL 2023 , Toronto, Canada, Jul. 2023
2023
Closest in time.
J. Zhu, R. Li , et al. , “AoI-based temporal attention graph neural network for popularity prediction and content caching,” IEEE Trans. Cogn. Commun. Netw. , vol. 9, no. 2, pp. 345–358, 2023
2023
Closest in time.
J. Su, M. Ahmed , et al. , “RoFormer: Enhanced transformer with rotary position embedding,” Neurocomputing , vol. 568, p. 127063, 2024
2024
Closest in time.
R. Taori, I. Gulrajani , et al. , “Stanford alpaca: An instruction-following llama model,” https://github.com/tatsu-lab/stanford_alpaca