Hypothesis Generation with Large Language Models

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020 · 1901

Earlier work this paper cites.

Creative cognitive processes in kekule’s discovery of the structure of the benzene molecule

Albert Rothenberg. 1995 · 1995

Earlier work this paper cites.

Engaging texts: Effects of concreteness on comprehensibility, interest, and recall in four text types

Mark Sadoski, Ernest T Goetz, and Maximo Rodriguez. 2000 · 2000

Earlier work this paper cites.

Scaling laws for neural language models

Original

Jared Kaplan, Sam McCandlish, Tom Henighan, Tom B. Brown, Benjamin Chess, Rewon Child, Scott Gray, Alec Radford, Jeffrey Wu, and Dario Amodei. 2020 · 2001

Earlier work this paper cites.

Using confidence bounds for exploitation-exploration trade-offs

Peter Auer. 2002 · 2002

Earlier work this paper cites.

Deception detection

Pär Anders Granhag and Aldert Vrij. 2005 · 2005

Earlier work this paper cites.

Experimental study of inequality and unpredictability in an artificial cultural market

Matthew J Salganik, Peter Sheridan Dodds, and Duncan J Watts. 2006 · 2006

Earlier work this paper cites.

Finding deceptive opinion spam by any stretch of the imagination

Original

Myle Ott, Yejin Choi, Claire Cardie, and Jeffrey T. Hancock. 2011 · 2011

Earlier work this paper cites.

How to grow a mind: Statistics, structure, and abstraction

Joshua B. Tenenbaum, Charles Kemp, Thomas L. Griffiths, and Noah D. Goodman. 2011 · 2011

Earlier work this paper cites.

Identifying manipulated offerings on review portals

Jiwei Li, Myle Ott, and Claire Cardie. 2013 · 2013

Earlier work this paper cites.

Reviews without a purchase: Low ratings, loyal customers, and deception

Eric T Anderson and Duncan I Simester. 2014 · 2014

Earlier work this paper cites.

Towards a general rule for identifying deceptive opinion spam

Jiwei Li, Myle Ott, Claire Cardie, and Eduard Hovy. 2014 · 2014

Earlier work this paper cites.

The effect of wording on message propagation: Topic- and author-controlled natural experiments on twitter

Chenhao Tan, Lillian Lee, and Bo Pang. 2014 · 2014

Earlier work this paper cites.

Causal effects of brevity on style and success in social media

Kristina Gligorić, Ashton Anderson, and Robert West. 2019 · 2019

Cited alongside, same era.

On human predictions with explanations and predictions of machine learning models: A case study on deception detection

Vivian Lai and Chenhao Tan. 2019 · 2019

Cited alongside, same era.

RoBERTa: A robustly optimized bert pretraining approach

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 2019

Cited alongside, same era.

DreamCoder: growing generalizable, interpretable knowledge with wake-sleep Bayesian program learning

Kevin Ellis, Catherine Wong, Maxwell Nye, Mathias Sablé-Meyer, Luc Cary, Lucas Morales, Luke Hewitt, Armando Solar-Lezama, and Joshua B. Tenenbaum. 2020 · 2020

Cited alongside, same era.

"Why is ’Chicago’ deceptive?" Towards building model-driven tutorials for humans

Vivian Lai, Han Liu, and Chenhao Tan. 2020 · 2020

Cited alongside, same era.

Large language models are zero shot hypothesis proposers

Biqing Qi, Kaiyan Zhang, Haoxiang Li, Kai Tian, Sihang Zeng, Zhang-Ren Chen, and Bowen Zhou. 2023 · 2023

Later among the works it cites.

Llama 2: Open foundation and fine-tuned chat models

Hugo Touvron, Louis Martin, Kevin R. Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Daniel M. Bikel, Lukas Blecher, Cristian Cantón Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony S. Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel M. Kloumann, A. V. Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, R. Subramanian, Xia Tan, Binh Tang, Ross Taylor, Adina Williams, Jian Xiang Kuan, Puxin Xu, Zhengxu Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurelien Rodriguez, Robert Stojnic, Sergey Edunov, and Thomas Scialom. 2023 · 2023

Later among the works it cites.

Self-consistency improves chain of thought reasoning in language models

Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V Le, Ed H. Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou. 2023 · 2023

Later among the works it cites.

Goal driven discovery of distributional differences via language descriptions