Leveraging Fine-Tuned Retrieval-Augmented Generation with Long-Context Support: For 3GPP Standards

T. Chen, S. Kornblith, M. Norouzi, and G. Hinton, “A simple framework for contrastive learning of visual representations,” in Proc. ICML , 2020, pp. 1597–1607

2020

Earlier work this paper cites.

A. Aghajanyan, S. Gupta, and L. Zettlemoyer, “Intrinsic dimensionality explains the effectiveness of language model fine-tuning,” in Proc. ACL-IJCNLP , 2021, pp. 7319–7328

2021

Earlier work this paper cites.

J. Liu, “LlamaIndex,” 2022. [Online]. Available: https://github.com/jerryjliu/llama_index

2022

Earlier work this paper cites.

E. J. Hu, yelong shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen, “LoRA: Low-rank adaptation of large language models,” in Proc. ICLR , 2022

2022

Earlier work this paper cites.

S. Bubeck et al. , “Sparks of artificial general intelligence: Early experiments with GPT-4,” CoRR , vol. abs/2303.12712, 2023

Original

2023

Earlier work this paper cites.

L. Huang, W. Yu, W. Ma, W. Zhong, Z. Feng, H. Wang, Q. Chen, W. Peng, X. Feng, B. Qin, and T. Liu, “A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions,” CoRR , vol. abs/2311.05232, 2023

Original

2023

Earlier work this paper cites.

H. Touvron et al. , “Llama 2: Open foundation and fine-tuned chat models,” CoRR , vol. abs/2307.09288, 2023

Original

2023

Earlier work this paper cites.

A. Maatouk, F. Ayed, N. Piovesan, A. D. Domenico, M. Debbah, and Z.-Q. Luo, “TeleQnA: A benchmark dataset to assess large language models telecommunications knowledge,” CoRR , vol. abs/2310.15051, 2023

Original

2023

Earlier work this paper cites.

I. Karim, K. S. Mubasshir, M. M. Rahman, and E. Bertino, “SPEC5G: A dataset for 5G cellular network protocol analysis,” in Proc. IJCNLP-AACL , 2023, pp. 20–38

2023

Earlier work this paper cites.

L. Bariah, H. Zou, Q. Zhao, B. Mouhouche, F. Bader, and M. Debbah, “Understanding telecom language through large language models,” in Proc. IEEE Globecom , 2023, pp. 6542–6547

2023

Cited alongside, same era.

A. Maatouk, N. Piovesan, F. Ayed, A. D. Domenico, and M. Debbah, “Large language models for telecom: Forthcoming impact on the industry,” IEEE Commun. Mag , pp. 1–7, 2024

2024

Cited alongside, same era.

R. Zhang, H. Du, Y. Liu, D. Niyato, J. Kang, S. Sun, X. Shen, and H. V. Poor, “Interactive AI with retrieval-augmented generation for next generation networking,” IEEE Netw , pp. 1–1, 2024

2024

Cited alongside, same era.

O. Erak, O. Alhussein, S. Naser, N. Alabbasi, D. Mi, and S. Muhaidat, “Large language model-driven curriculum design for mobile networks,” CoRR , vol. abs/2405.18039, 2024

Original

2024

Cited alongside, same era.

H. Jin, X. Han, J. Yang, Z. Jiang, Z. Liu, C.-Y. Chang, H. Chen, and X. Hu, “LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning,” CoRR , vol. abs/2401.01325, 2024

Original

2024

Closest in time.

A. Karapantelakis, M. Thakur, A. Nikou, F. Moradi, C. Orlog, F. Gaim, H. Holm, D. D. Nimara, and V. Huang, “Using large language models to understand telecom standards,” CoRR , vol. abs/2404.02929, 2024

Original

2024

Closest in time.

R. Nikbakht, M. Benzaghta, and G. Geraci, “TSpec-LLM: An open-source dataset for LLM understanding of 3GPP specifications,” CoRR , vol. abs/2406.01768, 2024

Original

2024

Closest in time.

P. Gajjar and V. K. Shah, “ORAN-Bench-13K: An open source benchmark for assessing LLMs in open radio access networks,” CoRR , vol. abs/2407.06245, 2024

Original

2024

Closest in time.