Counterfactual Debating with Preset Stances for Hallucination Elimination of LLMs

Boolq: Exploring the surprising difficulty of natural yes/no questions

Original

Christopher Clark, Kenton Lee, Ming-Wei Chang, Tom Kwiatkowski, Michael Collins, and Kristina Toutanova. 2019 · 1905

Earlier work this paper cites.

Cosmos qa: Machine reading comprehension with contextual commonsense reasoning

Original

Lifu Huang, Ronan Le Bras, Chandra Bhagavatula, and Yejin Choi. 2019 · 1909

Earlier work this paper cites.

Solving general arithmetic word problems

Original

Subhro Roy and Dan Roth. 2016 · 2016

Earlier work this paper cites.

Commonsenseqa: A question answering challenge targeting commonsense knowledge

Original

Alon Talmor, Jonathan Herzig, Nicholas Lourie, and Jonathan Berant. 2019 · 2019

Earlier work this paper cites.

The box is in the pen: Evaluating commonsense reasoning in neural machine translation

Jie He, Tao Wang, Deyi Xiong, and Qun Liu. 2020 · 2020

Earlier work this paper cites.

Hover: A dataset for many-hop fact extraction and claim verification

Yichen Jiang, Shikha Bordia, Zheng Zhong, Charles Dognin, Maneesh Singh, and Mohit Bansal. 2020 · 2020

Earlier work this paper cites.

Training verifiers to solve math word problems

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, et al. 2021 · 2021

Earlier work this paper cites.

Are nlp models really able to solve simple math word problems?

Original

Arkil Patel, Satwik Bhattamishra, and Navin Goyal. 2021 · 2021

Earlier work this paper cites.

Maieutic prompting: Logically consistent reasoning with recursive explanations

Jaehun Jung, Lianhui Qin, Sean Welleck, Faeze Brahman, Chandra Bhagavatula, Ronan Le Bras, and Yejin Choi. 2022 · 2022

Earlier work this paper cites.

Language models (mostly) know what they know

Original

Saurav Kadavath, Tom Conerly, Amanda Askell, Tom Henighan, Dawn Drain, Ethan Perez, Nicholas Schiefer, Zac Hatfield-Dodds, Nova DasSarma, Eli Tran-Johnson, et al. 2022 · 2022

Earlier work this paper cites.

Teaching models to express their uncertainty in words

Original

Stephanie Lin, Jacob Hilton, and Owain Evans. 2022 · 2022

Earlier work this paper cites.

Reducing conversational agents’ overconfidence through linguistic calibration

Sabrina J Mielke, Arthur Szlam, Emily Dinan, and Y-Lan Boureau. 2022 · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul F Christiano, Jan Leike, and Ryan Lowe. 2022 · 2022

Earlier work this paper cites.

Chain-of-thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022 · 2022

Earlier work this paper cites.

Gpt-4 technical report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023 · 2023

Earlier work this paper cites.

It’s not easy being wrong: Evaluating process of elimination reasoning in large language models

Original

Nishant Balepur, Shramay Palta, and Rachel Rudinger. 2023 · 2023

Earlier work this paper cites.

A multitask, multilingual, multimodal evaluation of chatgpt on reasoning, hallucination, and interactivity

Original

Yejin Bang, Samuel Cahyawijaya, Nayeon Lee, Wenliang Dai, Dan Su, Bryan Wilie, Holy Lovenia, Ziwei Ji, Tiezheng Yu, Willy Chung, et al. 2023 · 2023

Earlier work this paper cites.

Sparks of artificial general intelligence: Early experiments with gpt-4

Original

Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, et al. 2023 · 2023

Cited alongside, same era.

Improving factuality and reasoning in language models through multiagent debate

Original

Yilun Du, Shuang Li, Antonio Torralba, Joshua B Tenenbaum, and Igor Mordatch. 2023 · 2023

Cited alongside, same era.

Look before you leap: An exploratory study of uncertainty measurement for large language models

Yuheng Huang, Jiayang Song, Zhijie Wang, Huaming Chen, and Lei Ma. 2023 · 2023

Cited alongside, same era.

Semantic uncertainty: Linguistic invariances for uncertainty estimation in natural language generation

Lorenz Kuhn, Yarin Gal, and Sebastian Farquhar. 2023 · 2023

Cited alongside, same era.

Encouraging divergent thinking in large language models through multi-agent debate

Chain-of-thought prompting elicits reasoning in large language models

Original

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed Chi, Quoc Le, and Denny Zhou. 2023 · 2023

Later among the works it cites.

Can llms express their uncertainty? an empirical evaluation of confidence elicitation in llms

Original

Miao Xiong, Zhiyuan Hu, Xinyang Lu, Yifei Li, Jie Fu, Junxian He, and Bryan Hooi. 2023 · 2023

Later among the works it cites.

Answering questions by meta-reasoning over multiple chains of thought

Original

Ori Yoran, Tomer Wolfson, Ben Bogin, Uri Katz, Daniel Deutch, and Jonathan Berant. 2023 · 2023

Later among the works it cites.

Siren’s song in the ai ocean: a survey on hallucination in large language models

Original

Yue Zhang, Yafu Li, Leyang Cui, Deng Cai, Lemao Liu, Tingchen Fu, Xinting Huang, Enbo Zhao, Yu Zhang, Yulong Chen, et al. 2023 · 2023

Later among the works it cites.