Efficient Detection of LLM-generated Texts with a Bayesian Surrogate Model

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 · 1901

Earlier work this paper cites.

Bertscore: Evaluating text generation with bert

Original

Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q Weinberger, and Yoav Artzi. 2019 · 1904

Earlier work this paper cites.

Real or fake? learning to discriminate machine from human generated text

Original

Anton Bakhtin, Sam Gross, Myle Ott, Yuntian Deng, Marc’Aurelio Ranzato, and Arthur Szlam. 2019 · 1906

Earlier work this paper cites.

Roberta: A robustly optimized bert pretraining approach

Original

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907

Earlier work this paper cites.

Release strategies and the social impacts of language models

Original

Irene Solaiman, Miles Brundage, Jack Clark, Amanda Askell, Ariel Herbert-Voss, Jeff Wu, Alec Radford, Gretchen Krueger, Jong Wook Kim, Sarah Kreps, et al. 2019 · 1908

Earlier work this paper cites.

Albert: A lite bert for self-supervised learning of language representations

Original

Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut. 2019 · 1909

Earlier work this paper cites.

Gaussian processes for regression

Christopher Williams and Carl Rasmussen. 1995 · 1995

Earlier work this paper cites.

Deep bayesian active learning, a brief survey on recent advances

Original

Salman Mohamadi and Hamidreza Amindavar. 2020 · 2012

Earlier work this paper cites.

Practical bayesian optimization of machine learning algorithms

Jasper Snoek, Hugo Larochelle, and Ryan P Adams. 2012 · 2012

Earlier work this paper cites.

Adam: A method for stochastic optimization

Original

Diederik P Kingma and Jimmy Ba. 2014 · 2014

Earlier work this paper cites.

Squad: 100,000+ questions for machine comprehension of text

Original

Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016 · 2016

Earlier work this paper cites.

Deep bayesian active learning with image data

Yarin Gal, Riashat Islam, and Zoubin Ghahramani. 2017 · 2017

Earlier work this paper cites.

Simple and scalable predictive uncertainty estimation using deep ensembles

Balaji Lakshminarayanan, Alexander Pritzel, and Charles Blundell. 2017 · 2017

Earlier work this paper cites.

Bert: Pre-training of deep bidirectional transformers for language understanding

Original

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018

Cited alongside, same era.

Hierarchical neural story generation

Original

Angela Fan, Mike Lewis, and Yann Dauphin. 2018 · 2018

Cited alongside, same era.

Don’t give me the details, just the summary! topic-aware convolutional neural networks for extreme summarization

Original

Shashi Narayan, Shay B Cohen, and Mirella Lapata. 2018 · 2018

Cited alongside, same era.

A simple baseline for bayesian uncertainty in deep learning

Wesley J Maddox, Pavel Izmailov, Timur Garipov, Dmitry P Vetrov, and Andrew Gordon Wilson. 2019 · 2019

Cited alongside, same era.

Language models are unsupervised multitask learners

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019 · 2019

Opt: Open pre-trained transformer language models

Original

Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, et al. 2022 · 2022

Later among the works it cites.

Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality

Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. 2023 · 2023

Closest in time.

Bayesadapter: Being bayesian, inexpensively and reliably, via bayesian fine-tuning

Zhijie Deng and Jun Zhu. 2023 · 2023

Closest in time.

How close is chatgpt to human experts? comparison corpus, evaluation, and detection

Original

Biyang Guo, Xin Zhang, Ziyuan Wang, Minqi Jiang, Jinran Nie, Yuxuan Ding, Jianwei Yue, and Yupeng Wu. 2023 · 2023

Closest in time.

MGTBench: Benchmarking Machine-Generated Text Detection