Adapting Foundation Models for Information Synthesis of Wireless Communication Specifications

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al · 1901

Earlier work this paper cites.

Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing . Association for Computational Linguistics

Original

Nils Reimers and Iryna Gurevych. 2019 · 1908

Earlier work this paper cites.

Competing through cooperation: The organization of standard setting in wireless telecommunications

Aija Elina Leiponen. 2008 · 1919

Earlier work this paper cites.

Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th annual meeting of the Association for Computational Linguistics . 311–318

Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002

Earlier work this paper cites.

Wireless communication standards: A study of IEEE 802.11, 802.15, 802.16

Todor Cooklev. 2004 · 2004

Earlier work this paper cites.

ROUGE: A Package for Automatic Evaluation of Summaries. In Text Summarization Branches Out . Association for Computational Linguistics, Barcelona, Spain, 74–81

Chin-Yew Lin. 2004 · 2004

Earlier work this paper cites.

The promises and perils of mining github. In Proceedings of the 11th working conference on mining software repositories . 92–101

Eirini Kalliamvakou, Georgios Gousios, Kelly Blincoe, Leif Singer, Daniel M German, and Daniela Damian. 2014 · 2014

Earlier work this paper cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

Unpacking 3GPP standards

Justus Baron and Kirti Gupta. 2018 · 2018

Earlier work this paper cites.

Bert: Pre-training of deep bidirectional transformers for language understanding

Original

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018

Earlier work this paper cites.

Billion-scale similarity search with gpus

Jeff Johnson, Matthijs Douze, and Hervé Jégou. 2019 · 2019

Earlier work this paper cites.

Domain adaptation with BERT-based domain classification and data selection. In Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019) . 76–83

Xiaofei Ma, Peng Xu, Zhiguo Wang, Ramesh Nallapati, and Bing Xiang. 2019 · 2019

Earlier work this paper cites.

Adapt or get left behind: Domain adaptation through bert language model finetuning for aspect-target sentiment classification

Original

Alexander Rietzler, Sebastian Stabinger, Paul Opitz, and Stefan Engl. 2019 · 2019

Earlier work this paper cites.

Xlnet: Generalized autoregressive pretraining for language understanding

Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R Salakhutdinov, and Quoc V Le. 2019 · 2019

Earlier work this paper cites.

Bertscore: Evaluating text generation with bert

Original

Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q Weinberger, and Yoav Artzi. 2019 · 2019

Earlier work this paper cites.

Interpreting Pretrained Contextualized Representations via Reductions to Static Embeddings. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics . Association for Computational Linguistics, Online, 4758–4781

Rishi Bommasani, Kelly Davis, and Claire Cardie. 2020 · 2020

Earlier work this paper cites.

On the opportunities and risks of foundation models

Original

Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al · 2021

Cited alongside, same era.

Bookworm Game: Automatic Discovery of LTE Vulnerabilities Through Documentation Analysis. In 2021 IEEE Symposium on Security and Privacy (SP) . 1197–1214

Yi Chen, Yepeng Yao, XiaoFeng Wang, Dandan Xu, Chang Yue, Xiaozhong Liu, Kai Chen, Haixu Tang, and Baoxu Liu. 2021 · 2021

Cited alongside, same era.

Taming pre-trained language models with n-gram representations for low-resource domain adaptation. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) . 3336–3349

Shizhe Diao, Ruijia Xu, Hongjin Su, Yilei Jiang, Yan Song, and Tong Zhang. 2021 · 2021

Cited alongside, same era.

Bidirectional Encoder Representations from Transformers (BERT) for Question Answering in the Telecom Domain.: Adapting a BERT-like language model to the telecom domain using the ELECTRA pre-training approach

PLACES: Prompting language models for social conversation synthesis

Original

Maximillian Chen, Alexandros Papangelis, Chenyang Tao, Seokhwan Kim, Andy Rosenbaum, Yang Liu, Zhou Yu, and Dilek Hakkani-Tur. 2023 · 2023

Closest in time.

GPT4All embeddings

GPT4All. 2023 · 2023

Closest in time.

Textbooks Are All You Need

Original

Suriya Gunasekar, Yi Zhang, Jyoti Aneja, Caio César Teodoro Mendes, Allie Del Giorno, Sivakanth Gopi, Mojan Javaheripi, Piero Kauffmann, Gustavo de Rosa, Olli Saarikivi, et al · 2023

Closest in time.

SPEC5G: A Dataset for 5G Cellular Network Protocol Analysis

Original

Imtiaz Karim, Kazi Samin Mubasshir, Mirza Masfiqur Rahman, and Elisa Bertino. 2023 · 2023

Closest in time.

LangChain

LangChain. 2023 · 2023

Closest in time.