Prompt Design Matters for Computational Social Science Tasks but in Unpredictable Ways

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 · 1901

Earlier work this paper cites.

Recursive deep models for semantic compositionality over a sentiment treebank

Richard Socher, Alex Perelygin, Jean Wu, Jason Chuang, Christopher D Manning, Andrew Y Ng, and Christopher Potts. 2013 · 2013

Earlier work this paper cites.

Zero-shot learning-the good, the bad and the ugly

Yongqin Xian, Bernt Schiele, and Zeynep Akata. 2017 · 2017

Earlier work this paper cites.

Semeval-2019 task 7: Rumoureval 2019: Determining rumour veracity and support for rumours

Genevieve Gorrell, Elena Kochkina, Maria Liakata, Ahmet Aker, Arkaitz Zubiaga, Kalina Bontcheva, and Leon Derczynski. 2019 · 2019

Earlier work this paper cites.

Detecting frames in news headlines and its application to analyzing news framing trends surrounding us gun violence

Siyi Liu, Lei Guo, Kate Mays, Margrit Betke, and Derry Tanti Wijaya. 2019 · 2019

Earlier work this paper cites.

Generalizing from a few examples: A survey on few-shot learning

Yaqing Wang, Quanming Yao, James T Kwok, and Lionel M Ni. 2020 · 2020

Earlier work this paper cites.

A survey of nlp-related crowdsourcing hits: what works and what does not

Original

Jessica Huynh, Jeffrey Bigham, and Maxine Eskenazi. 2021 · 2021

Earlier work this paper cites.

Computational identification of media frames: Strengths, weaknesses, and opportunities

Tom Nicholls and Pepper D Culpepper. 2021 · 2021

Earlier work this paper cites.

Want to reduce labeling cost? gpt-3 can help

Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, and Michael Zeng. 2021 · 2021

Earlier work this paper cites.

Finetuned language models are zero-shot learners

Original

Jason Wei, Maarten Bosma, Vincent Y Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M Dai, and Quoc V Le. 2021 · 2021

Earlier work this paper cites.

Differentiable prompt makes pre-trained language models better few-shot learners

Original

Ningyu Zhang, Luoqiu Li, Xiang Chen, Shumin Deng, Zhen Bi, Chuanqi Tan, Fei Huang, and Huajun Chen. 2021 · 2021

Earlier work this paper cites.

Promptsource: An integrated development environment and repository for natural language prompts

Stephen Bach, Victor Sanh, Zheng Xin Yong, Albert Webson, Colin Raffel, Nihal V Nayak, Abheesht Sharma, Taewoon Kim, M Saiful Bari, Thibault Févry, et al. 2022 · 2022

Earlier work this paper cites.

Crowdworksheets: Accounting for individual and collective identities underlying crowdsourced dataset annotation

Mark Díaz, Ian Kivlichan, Rachel Rosen, Dylan Baker, Razvan Amironesei, Vinodkumar Prabhakaran, and Emily Denton. 2022 · 2022

Earlier work this paper cites.

Chain-of-thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022 · 2022

Cited alongside, same era.

How would stance detection techniques evolve after the launch of chatgpt?

Original

Bowen Zhang, Daijun Ding, and Liwen Jing. 2022 · 2022

Cited alongside, same era.

Elements of a prompt

DAIR. 2023 · 2023

Cited alongside, same era.

Is GPT-3 a good data annotator?

Bosheng Ding, Chengwei Qin, Linlin Liu, Yew Ken Chia, Boyang Li, Shafiq Joty, and Lidong Bing. 2023 · 2023

Cited alongside, same era.

Should chatgpt be biased? challenges and risks of bias in large language models

Emilio Ferrara. 2023 · 2023

Cited alongside, same era.

Chatgpt outperforms crowd workers for text-annotation tasks

Fabrizio Gilardi, Meysam Alizadeh, and Maël Kubli. 2023 · 2023

Challenging BIG-bench tasks and whether chain-of-thought can solve them

Mirac Suzgun, Nathan Scales, Nathanael Schärli, Sebastian Gehrmann, Yi Tay, Hyung Won Chung, Aakanksha Chowdhery, Quoc Le, Ed Chi, Denny Zhou, and Jason Wei. 2023 · 2023

Later among the works it cites.

Is chatgpt a good sentiment analyzer? a preliminary study

Original

Zengzhi Wang, Qiming Xie, Yi Feng, Zixiang Ding, Zinong Yang, and Rui Xia. 2023 · 2023

Later among the works it cites.

A prompt pattern catalog to enhance prompt engineering with chatgpt

Original

Jules White, Quchen Fu, Sam Hays, Michael Sandborn, Carlos Olea, Henry Gilbert, Ashraf Elnashar, Jesse Spencer-Smith, and Douglas C Schmidt. 2023 · 2023

Later among the works it cites.

Hot speech: Comments from political news posts and videos that were annotated for hateful, offensive, and toxic content

Siqi Wu, Angela Schöpke-Gonzalez, Sagar Kumar, Libby Hemphill, and Paul Resnick. 2023 · 2023

Later among the works it cites.

Docmath-eval: Evaluating numerical reasoning capabilities of llms in understanding long documents with tabular data