Enhancing Zero-shot Chain of Thought Prompting via Uncertainty-Guided Strategy Selection

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020 · 1901

Earlier work this paper cites.

Beyond accuracy: Behavioral testing of nlp models with checklist

Original

Marco Tulio Ribeiro, Tongshuang Wu, Carlos Guestrin, and Sameer Singh. 2020 · 2005

Earlier work this paper cites.

K-means++ the advantages of careful seeding

David Arthur and Sergei Vassilvitskii. 2007 · 2007

Earlier work this paper cites.

An analysis of active learning strategies for sequence labeling tasks

Burr Settles and Mark Craven. 2008 · 2008

Earlier work this paper cites.

Statistical machine translation

Philipp Koehn. 2009 · 2009

Earlier work this paper cites.

A survey on instance selection for active learning

Yifan Fu, Xingquan Zhu, and Bin Li. 2013 · 2013

Earlier work this paper cites.

Dropout as a bayesian approximation: Representing model uncertainty in deep learning

Yarin Gal and Zoubin Ghahramani. 2016 · 2016

Earlier work this paper cites.

A baseline for detecting misclassified and out-of-distribution examples in neural networks

Dan Hendrycks and Kevin Gimpel. 2016 · 2016

Earlier work this paper cites.

On calibration of modern neural networks

Chuan Guo, Geoff Pleiss, Yu Sun, and Kilian Q. Weinberger. 2017 · 2017

Earlier work this paper cites.

Simple and scalable predictive uncertainty estimation using deep ensembles

Balaji Lakshminarayanan, Alexander Pritzel, and Charles Blundell. 2017 · 2017

Earlier work this paper cites.

Can you trust your model’s uncertainty? evaluating predictive uncertainty under dataset shift

Yaniv Ovadia, Emily Fertig, Jie Ren, Zachary Nado, David Sculley, Sebastian Nowozin, Joshua Dillon, Balaji Lakshminarayanan, and Jasper Snoek. 2019 · 2019

Earlier work this paper cites.

Sentence-BERT: Sentence embeddings using Siamese BERT-networks

Nils Reimers and Iryna Gurevych. 2019 · 2019

Earlier work this paper cites.

Uncertainty estimation using a single deep deterministic neural network

Joost Van Amersfoort, Lewis Smith, Yee Whye Teh, and Yarin Gal. 2020 · 2020

Earlier work this paper cites.

Training verifiers to solve math word problems

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, et al. 2021 · 2021

Earlier work this paper cites.

Did aristotle use a laptop? a question answering benchmark with implicit reasoning strategies

Mor Geva, Daniel Khashabi, Elad Segal, Tushar Khot, Dan Roth, and Jonathan Berant. 2021 · 2021

Earlier work this paper cites.

Scaling language models: Methods, analysis & insights from training gopher

Original

Jack W Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, et al. 2021 · 2021

Earlier work this paper cites.

Logical fallacy detection

Zhijing Jin, Abhinav Lalwani, Tejas Vaidhya, Xiaoyu Shen, Yiwen Ding, Zhiheng Lyu, Mrinmaya Sachan, Rada Mihalcea, and Bernhard Schoelkopf. 2022 · 2022

Cited alongside, same era.

Large language models are zero-shot reasoners

Takeshi Kojima, Shixiang (Shane) Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022 · 2022

Cited alongside, same era.

” diversity and uncertainty in moderation” are the key to data selection for multilingual few-shot transfer

Shanu Kumar, Sandipan Dandapat, and Monojit Choudhury. 2022 · 2022

Cited alongside, same era.

Holistic evaluation of language models

Original

Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, et al. 2022 · 2022

Cited alongside, same era.

Multi-task active learning for pre-trained transformer-based models

Guy Rotman and Roi Reichart. 2022 · 2022

Cited alongside, same era.

Llama: Open and efficient foundation language models

Original

Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, et al. 2023 · 2023

Later among the works it cites.

Better zero-shot reasoning with self-adaptive prompting

Xingchen Wan, Ruoxi Sun, Hanjun Dai, Sercan Arik, and Tomas Pfister. 2023 · 2023

Later among the works it cites.

Unleashing cognitive synergy in large language models: A task-solving agent through multi-persona selfcollaboration

Original

Zhenhailong Wang, Shaoguang Mao, Wenshan Wu, Tao Ge, Furu Wei, and Heng Ji. 2023 · 2023

Later among the works it cites.

Tree of thoughts: Deliberate problem solving with large language models

Original

Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L Griffiths, Yuan Cao, and Karthik Narasimhan. 2023 · 2023

Later among the works it cites.