Zero-Shot Detection of LLM-Generated Text using Token Cohesiveness

Real or fake? Learning to discriminate machine from human generated text

Original

Anton Bakhtin, Sam Gross, Myle Ott, Yuntian Deng, Marc’Aurelio Ranzato, and Arthur Szlam. 2019 · 1906

Earlier work this paper cites.

RoBERTa: A robustly optimized BERT pretraining approach

Original

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907

Earlier work this paper cites.

Release strategies and the social impacts of language models

Original

Irene Solaiman, Miles Brundage, Jack Clark, Amanda Askell, Ariel Herbert-Voss, Jeff Wu, Alec Radford, Gretchen Krueger, Jong Wook Kim, Sarah Kreps, et al. 2019 · 1908

Earlier work this paper cites.

Detecting fake content with relative entropy scoring

Thomas Lavergne, Tanguy Urvoy, and François Yvon. 2008 · 2008

Earlier work this paper cites.

SQuAD: 100,000+ questions for machine comprehension of text

Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016 · 2016

Earlier work this paper cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

Hierarchical neural story generation

Angela Fan, Mike Lewis, and Yann Dauphin. 2018 · 2018

Earlier work this paper cites.

Don’t give me the details, just the summary! Topic-aware convolutional neural networks for extreme summarization

Shashi Narayan, Shay B. Cohen, and Mirella Lapata. 2018 · 2018

Earlier work this paper cites.

BERT: Pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Earlier work this paper cites.

GLTR: Statistical detection and visualization of generated text

Sebastian Gehrmann, Hendrik Strobelt, and Alexander Rush. 2019 · 2019

Earlier work this paper cites.

Unifying human and statistical evaluation for natural language generation

Tatsunori B. Hashimoto, Hugh Zhang, and Percy Liang. 2019 · 2019

Earlier work this paper cites.

PubMedQA: A dataset for biomedical research question answering

Qiao Jin, Bhuwan Dhingra, Zhengping Liu, William Cohen, and Xinghua Lu. 2019 · 2019

Earlier work this paper cites.

Language models are unsupervised multitask learners

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019

Earlier work this paper cites.

Defending against neural fake news

Rowan Zellers, Ari Holtzman, Hannah Rashkin, Yonatan Bisk, Ali Farhadi, Franziska Roesner, and Yejin Choi. 2019 · 2019

Earlier work this paper cites.

Automatic detection of generated text is easiest when humans are fooled

Daphne Ippolito, Daniel Duckworth, Chris Callison-Burch, and Douglas Eck. 2020 · 2020

Earlier work this paper cites.

BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension

Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020 · 2020

Earlier work this paper cites.

Authorship attribution for neural text generation

Adaku Uchendu, Thai Le, Kai Shu, and Dongwon Lee. 2020 · 2020

Earlier work this paper cites.

Neural deepfake detection with factual structure of text

Wanjun Zhong, Duyu Tang, Zenan Xu, Ruize Wang, Nan Duan, Ming Zhou, Jiahai Wang, and Jian Yin. 2020 · 2020

Cited alongside, same era.

GPT-Neo: Large scale autoregressive language modeling with Mesh-Tensorflow

Sid Black, Leo Gao, Phil Wang, Connor Leahy, and Stella Biderman. 2021 · 2021

Cited alongside, same era.

GPT-J-6B: A 6 billion parameter autoregressive language model

Ben Wang and Aran Komatsuzaki. 2021 · 2021

Cited alongside, same era.

BARTScore: Evaluating generated text as text generation

Weizhe Yuan, Graham Neubig, and Pengfei Liu. 2021 · 2021

Cited alongside, same era.

Beat LLMs at their own game: Zero-shot LLM-generated text detection via querying ChatGPT

Biru Zhu, Lifan Yuan, Ganqu Cui, Yangyi Chen, Chong Fu, Bingxiang He, Yangdong Deng, Zhiyuan Liu, Maosong Sun, and Ming Gu. 2023 · 2021

Cited alongside, same era.

GPT-NeoX-20B: An open-source autoregressive language model

GPT-4 technical report

Original

OpenAI. 2023 · 2023

Later among the works it cites.

Academic integrity considerations of AI large language models in the post-pandemic era: ChatGPT and beyond

Mike Perkins. 2023 · 2023

Later among the works it cites.

Deepfake text detection: Limitations and opportunities

Jiameng Pu, Zain Sarwar, Sifat Muhammad Abdullah, Abdullah Rehman, Yoonjin Kim, Parantapa Bhattacharya, Mobin Javed, and Bimal Viswanath. 2023 · 2023

Later among the works it cites.

DetectLLM: Leveraging log rank information for zero-shot detection of machine-generated text

Jinyan Su, Terry Zhuo, Di Wang, and Preslav Nakov. 2023 · 2023

Later among the works it cites.

GPTZero: Towards detection of AI-generated text using zero-shot and supervised methods

Edward Tian and Alexander Cui. 2023 · 2023

Later among the works it cites.