Telco-RAG: Navigating the Challenges of Retrieval-Augmented Language Models for Telecommunications

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. u. Kaiser, and I. Polosukhin, “Attention is all you need,” in Advances in neural information processing systems (NIPS) , 2017, pp. 5998–6008

2017

Earlier work this paper cites.

J. Johnson, M. Douze, and H. Jégou, “Faiss: Facebook ai similarity search,” https://github.com/facebookresearch/faiss, 2017

2017

Earlier work this paper cites.

J. Gao, M. Galley, and L. Li, “Neural Approaches to Conversational AI,” in Annual Meeting of the Association for Computational Linguistics (ACL): Tutorial Abstracts , 2019

2019

Earlier work this paper cites.

N. C. Thompson, K. Greenewald, K. Lee, and G. F. Manso, “The computational limits of deep learning,” arXiv preprint arXiv:2007.05558 , 2020

Original

2020

Earlier work this paper cites.

A. Kusupati, G. Bhatt, A. Rege, M. Wallingford, A. Sinha, V. Ramanujan, W. Howard-Snyder, K. Chen, S. Kakade, P. Jain, and A. Farhadi, “Matryoshka Representation Learning,” in Advances in Neural Information Processing Systems (NeurIPS) , 2022

2022

Earlier work this paper cites.

A. Maatouk, F. Ayed, N. Piovesan, A. De Domenico, M. Debbah, and Z.-Q. Luo, “TeleQnA: A Benchmark Dataset to Assess Large Language Models Telecommunications Knowledge,” arXiv preprint arXiv:2310.15051 , 2023

Original

2023

Earlier work this paper cites.

Banghao Chen, Zhaofeng Zhang, Nicolas Langren, Shengxin Zhu, “Unleashing the potential of prompt engineering in Large Language Models: a comprehensive review,” arXiv preprint arXiv:2310.14735 , 2023

Original

2023

Cited alongside, same era.

S. Siriwardhana, R. Weerasekera, E. Wen, T. Kaluarachchi, R. Rana, and S. Nanayakkara, “Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answering,” Transactions of the Association for Computational Linguistics , vol. 11, pp. 1–17, 01 2023

2023

Cited alongside, same era.

F. Gilardi, M. Alizadeh, and M. Kubli, “ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks,” Proceedings of the National Academy of Sciences , vol. 120, no. 30, 2023

2023

Cited alongside, same era.

A. Maatouk, N. Piovesan, F. Ayed, A. D. Domenico, and M. Debbah, “Large Language Models for Telecom: Forthcoming Impact on the Industry,” IEEE Communications Magazine , pp. 1–7, 2024

2024

Cited alongside, same era.

N. Piovesan, A. De Domenico, and F. Ayed, “Telecom language models: Must they be large?” IEEE 35th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) , 2024

2024

Closest in time.

LlamaIndex, “Evaluating the Ideal Chunk Size for a RAG System Using LlamaIndex,” LlamaIndex Blog, 2024. [Online]. Available: https://www.llamaindex.ai/blog/evaluating-the-ideal-chunk-size-for-a-rag-system-using-llamaindex-6207e5d3fec5

2024

Closest in time.

P. Finardi, L. Avila, R. Castaldoni, P. Gengo, C. Larcher, M. Piau, P. Costa, and V. Caridá, “The Chronicles of RAG: The Retriever, the Chunk and the Generator,” arXiv preprint arXiv:2401.07883 , 2024

Original

2024

Closest in time.

C.-M. Chan, C. Xu, R. Yuan, H. Luo, W. Xue, Y. Guo, and J. Fu, “RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generation,” in arXiv preprint arXiv:2404.00610 , 2024

Original

2024

Closest in time.