People who frequently use ChatGPT for writing tasks are accurate and robust detectors of AI-generated text

Language Models are Few-Shot Learners

Original

Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020 · 2005

Earlier work this paper cites.

The SAGE encyclopedia of communication research methods

Mike Allen. 2017 · 2017

Earlier work this paper cites.

The mythos of model interpretability: In machine learning, the concept of interpretability is both important and slippery

Zachary C. Lipton. 2018 · 2018

Earlier work this paper cites.

GLTR: Statistical Detection and Visualization of Generated Text

Sebastian Gehrmann, Hendrik Strobelt, and Alexander Rush. 2019 · 2019

Earlier work this paper cites.

Release Strategies and the Social Impacts of Language Models

Irene Solaiman, Miles Brundage, Jack Clark, Amanda Askell, Ariel Herbert-Voss, Jeff Wu, Alec Radford, and Jasmine Wang. 2019 · 2019

Earlier work this paper cites.

RoFT: A Tool for Evaluating Human Detection of Machine-Generated Text

Liam Dugan, Daphne Ippolito, Arun Kirubarajan, and Chris Callison-Burch. 2020 · 2020

Earlier work this paper cites.

Evaluating models’ local decision boundaries via contrast sets

Matt Gardner, Yoav Artzi, Victoria Basmov, Jonathan Berant, Ben Bogin, Sihao Chen, Pradeep Dasigi, Dheeru Dua, Yanai Elazar, Ananth Gottumukkala, Nitish Gupta, Hannaneh Hajishirzi, Gabriel Ilharco, Daniel Khashabi, Kevin Lin, Jiangming Liu, Nelson F. Liu, Phoebe Mulcaire, Qiang Ning, Sameer Singh, Noah A. Smith, Sanjay Subramanian, Reut Tsarfaty, Eric Wallace, Ally Zhang, and Ben Zhou. 2020 · 2020

Earlier work this paper cites.

Automatic detection of generated text is easiest when humans are fooled

Daphne Ippolito, Daniel Duckworth, Chris Callison-Burch, and Douglas Eck. 2020 · 2020

Earlier work this paper cites.

BLiMP: The benchmark of linguistic minimal pairs for English

Alex Warstadt, Alicia Parrish, Haokun Liu, Anhad Mohananey, Wei Peng, Sheng-Fu Wang, and Samuel R. Bowman. 2020 · 2020

Earlier work this paper cites.

All that‘s ‘human’ is not gold: Evaluating human evaluation of generated text

Elizabeth Clark, Tal August, Sofia Serrano, Nikita Haduong, Suchin Gururangan, and Noah A. Smith. 2021 · 2021

Earlier work this paper cites.

Is gpt-3 text indistinguishable from human text? scarecrow: A framework for scrutinizing machine text

Yao Dou, Maxwell Forbes, Rik Koncel-Kedziorski, Noah A. Smith, and Yejin Choi. 2021 · 2021

Earlier work this paper cites.

The perils of using Mechanical Turk to evaluate open-ended text generation

Marzena Karpinska, Nader Akoury, and Mohit Iyyer. 2021 · 2021

Earlier work this paper cites.

Real or fake text?: Investigating human ability to detect boundaries between human-written and machine-generated text

Liam Dugan, Daphne Ippolito, Arun Kirubarajan, Sherry Shi, and Chris Callison-Burch. 2022 · 2022

Earlier work this paper cites.

DEMETR: Diagnosing evaluation metrics for translation

Marzena Karpinska, Nishant Raj, Katherine Thai, Yixiao Song, Ankita Gupta, and Mohit Iyyer. 2022 · 2022

Earlier work this paper cites.

Fast-detectgpt: Efficient zero-shot detection of machine-generated text via conditional probability curvature

Guangsheng Bao, Yanbin Zhao, Zhiyang Teng, Linyi Yang, and Yue Zhang. 2023 · 2023

Earlier work this paper cites.

RADAR: robust ai-text detection via adversarial learning

Xiaomeng Hu, Pin-Yu Chen, and Tsung-Yi Ho. 2023 · 2023

Earlier work this paper cites.

A watermark for large language models

John Kirchenbauer, Jonas Geiping, Yuxin Wen, Jonathan Katz, Ian Miers, and Tom Goldstein. 2023 · 2023

Cited alongside, same era.

Paraphrasing evades detectors of ai-generated text, but retrieval is an effective defense

Kalpesh Krishna, Yixiao Song, Marzena Karpinska, John Wieting, and Mohit Iyyer. 2023 · 2023

Cited alongside, same era.

Ai vs. human – differentiation analysis of scientific content generation

Original

Yongqiang Ma, Jiawei Liu, Fan Yi, Qikai Cheng, Yong Huang, Wei Lu, and Xiaozhong Liu. 2023 · 2023

Cited alongside, same era.

Detectgpt: Zero-shot machine-generated text detection using probability curvature

Eric Mitchell, Yoonho Lee, Alexander Khazatsky, Christopher D. Manning, and Chelsea Finn. 2023 · 2023

Cited alongside, same era.

Red teaming language model detectors with language models

Zhouxing Shi, Yihan Wang, Fan Yin, Xiangning Chen, Kai-Wei Chang, and Cho-Jui Hsieh. 2023 · 2023

Cited alongside, same era.

MAGE: Machine-generated Text Detection in the Wild

Yafu Li, Qintong Li, Leyang Cui, Wei Bi, Zhilin Wang, Longyue Wang, Linyi Yang, Shuming Shi, and Yue Zhang. 2024 · 2024

Later among the works it cites.

Large language models can be guided to evade ai-generated text detection

Ning Lu, Shengcai Liu, Ruidan He, and Ke Tang. 2023 · 2024

Later among the works it cites.

OpenAI o1 System Card

Original

OpenAI. 2024 · 2024

Later among the works it cites.

Ai-generated poetry is indistinguishable from human-written poetry and is rated more favorably

B Porter and Edouard Machery. 2024 · 2024

Later among the works it cites.

AI "News" Content Farms Are Easy to Make and Hard to Detect: A Case Study in Italian

Original

Giovanni Puccetti, Anna Rogers, Chiara Alzetta, Felice Dell’Orletta, and Andrea Esuli. 2024 · 2024

Later among the works it cites.