Real or Fake Text?: Investigating Human Ability to Detect Boundaries Between Human-Written and Machine-Generated Text

Language Models are Few-Shot Learners

Brown, T.; Mann, B.; Ryder, N.; Subbiah, M.; Kaplan, J. D.; Dhariwal, P.; Neelakantan, A.; Shyam, P.; Sastry, G.; Askell, A.; Agarwal, S.; Herbert-Voss, A.; Krueger, G.; Henighan, T.; Child, R.; Ramesh, A.; Ziegler, D.; Wu, J.; Winter, C.; Hesse, C.; Chen, M.; Sigler, E.; Litwin, M.; Gray, S.; Chess, B.; Clark, J.; Berner, C.; McCandlish, S.; Radford, A.; Sutskever, I.; and Amodei, D. 2020 · 1901

Earlier work this paper cites.

Ctrl: A conditional transformer language model for controllable generation

Original

Keskar, N. S.; McCann, B.; Varshney, L. R.; Xiong, C.; and Socher, R. 2019 · 1909

Earlier work this paper cites.

Scaling Laws for Neural Language Models

Original

Kaplan, J.; McCandlish, S.; Henighan, T.; Brown, T. B.; Chess, B.; Child, R.; Gray, S.; Radford, A.; Wu, J.; and Amodei, D. 2020 · 2001

Earlier work this paper cites.

The new york times annotated corpus

Sandhaus, E. 2008 · 2008

Earlier work this paper cites.

Corpus of Presidential Speeches

Brown, D. W. 2016 · 2016

Earlier work this paper cites.

Hierarchical Neural Story Generation

Fan, A.; Lewis, M.; and Dauphin, Y. 2018 · 2018

Earlier work this paper cites.

GLTR: Statistical Detection and Visualization of Generated Text

Gehrmann, S.; Strobelt, H.; and Rush, A. M. 2019 · 2019

Earlier work this paper cites.

Recipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Images

Marin, J.; Biswas, A.; Ofli, F.; Hynes, N.; Salvador, A.; Aytar, Y.; Weber, I.; and Torralba, A. 2019 · 2019

Earlier work this paper cites.

Towards understanding and detecting fake reviews in app stores

Martens, D.; and Maalej, W. 2019 · 2019

Cited alongside, same era.

Language Models are Unsupervised Multitask Learners

Radford, A.; Wu, J.; Child, R.; Luan, D.; Amodei, D.; and Sutskever, I. 2019 · 2019

Cited alongside, same era.

Defending Against Neural Fake News

Zellers, R.; Holtzman, A.; Rashkin, H.; Bisk, Y.; Farhadi, A.; Roesner, F.; and Choi, Y. 2019 · 2019

Cited alongside, same era.

Spot The Bot: A Robust and Efficient Framework for the Evaluation of Conversational Dialogue Systems

Deriu, J.; Tuggener, D.; von Däniken, P.; Campos, J. A.; Rodrigo, A.; Belkacem, T.; Soroa, A.; Agirre, E.; and Cieliebak, M. 2020 · 2020

Cited alongside, same era.

RoFT: A Tool for Evaluating Human Detection of Machine-Generated Text

Dugan, L.; Ippolito, D.; Kirubarajan, A.; and Callison-Burch, C. 2020 · 2020

Cited alongside, same era.

The Curious Case of Neural Text Degeneration

Scarecrow: A framework for scrutinizing machine text

Original

Dou, Y.; Forbes, M.; Koncel-Kedziorski, R.; Smith, N. A.; and Choi, Y. 2021 · 2021

Later among the works it cites.

TGEA: An Error-Annotated Dataset and Benchmark Tasks for TextGeneration from Pretrained Language Models

He, J.; Peng, B.; Liao, Y.; Liu, Q.; and Xiong, D. 2021 · 2021

Later among the works it cites.

WebGPT: Browser-assisted question-answering with human feedback

Original

Nakano, R.; Hilton, J.; Balaji, S.; Wu, J.; Ouyang, L.; Kim, C.; Hesse, C.; Jain, S.; Kosaraju, V.; Saunders, W.; Jiang, X.; Cobbe, K.; Eloundou, T.; Krueger, G.; Button, K.; Knight, M.; Chess, B.; and Schulman, J. 2021 · 2021

Later among the works it cites.

Ethical and social risks of harm from Language Models

Original

Weidinger, L.; Mellor, J.; Rauh, M.; Griffin, C.; Uesato, J.; Huang, P.-S.; Cheng, M.; Glaese, M.; Balle, B.; Kasirzadeh, A.; Kenton, Z.; Brown, S.; Hawkins, W.; Stepleton, T.; Biles, C.; Birhane, A.; Haas, J.; Rimell, L.; Hendricks, L. A.; Isaac, W.; Legassick, S.; Irving, G.; and Gabriel, I. 2021 · 2021

Later among the works it cites.