Can Large Language Models Faithfully Express Their Intrinsic Uncertainty in Words?

Hedges: A study in meaning criteria and the logic of fuzzy concepts

George Lakoff. 1973 · 1973

Earlier work this paper cites.

The well-calibrated bayesian

A Philip Dawid. 1982 · 1982

Earlier work this paper cites.

Verbal vs. numerical processing of subjective probabilities

Alf C Zimmer. 1983 · 1983

Earlier work this paper cites.

Preferences and reasons for communicating probabilistic information in verbal or numerical terms

Thomas S Wallsten, David V Budescu, Rami Zwick, and Steven M Kemp. 1993 · 1993

Earlier work this paper cites.

Measuring psychological uncertainty: Verbal versus numeric methods

Paul D Windschitl and Gary L Wells. 1996 · 1996

Earlier work this paper cites.

Affective dependencies

Anastasia Giannakidou. 1999 · 1999

Earlier work this paper cites.

Ambigqa: Answering ambiguous open-domain questions

Original

Sewon Min, Julian Michael, Hannaneh Hajishirzi, and Luke Zettlemoyer. 2020 · 2004

Earlier work this paper cites.

Selective question answering under domain shift

Original

Amita Kamath, Robin Jia, and Percy Liang. 2020 · 2006

Earlier work this paper cites.

On the foundations of noise-free selective classification

Ran El-Yaniv et al. 2010 · 2010

Earlier work this paper cites.

Pragmatic competence: The case of hedging

Bruce Fraser. 2010 · 2010

Earlier work this paper cites.

To hedge or not to hedge: the use of epistemic modal expressions in popular science in english texts, english–german translations, and german original texts

Svenja Kranich. 2011 · 2011

Earlier work this paper cites.

Did it happen? the pragmatic complexity of veridicality assessment

Marie-Catherine De Marneffe, Christopher D Manning, and Christopher Potts. 2012 · 2012

Earlier work this paper cites.

Wikidata: a free collaborative knowledgebase

Denny Vrandečić and Markus Krötzsch. 2014 · 2014

Earlier work this paper cites.

Selective classification for deep neural networks

Yonatan Geifman and Ran El-Yaniv. 2017 · 2017

Earlier work this paper cites.

On calibration of modern neural networks

Chuan Guo, Geoff Pleiss, Yu Sun, and Kilian Q Weinberger. 2017 · 2017

Earlier work this paper cites.

Triviaqa: A large scale distantly supervised challenge dataset for reading comprehension

Original

Mandar Joshi, Eunsol Choi, Daniel S Weld, and Luke Zettlemoyer. 2017 · 2017

Earlier work this paper cites.

“i am uncertain” vs “it is uncertain”. how linguistic markers of the uncertainty source affect uncertainty communication

Marie Juanchich, Amélie Gourdon-Kanhukamwe, and Miroslav Sirota. 2017 · 2017

Earlier work this paper cites.

Natural questions: a benchmark for question answering research

Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, et al. 2019 · 2019

Earlier work this paper cites.

To trust or to think: cognitive forcing functions can reduce overreliance on ai in ai-assisted decision-making

Zana Buçinca, Maja Barbara Malaya, and Krzysztof Z Gajos. 2021 · 2021

Cited alongside, same era.

Truthfulqa: Measuring how models mimic human falsehoods

Original

Stephanie Lin, Jacob Hilton, and Owain Evans. 2021 · 2021

Cited alongside, same era.

Fantastically ordered prompts and where to find them: Overcoming few-shot prompt order sensitivity

Original

Yao Lu, Max Bartolo, Alastair Moore, Sebastian Riedel, and Pontus Stenetorp. 2021 · 2021

Cited alongside, same era.

True few-shot learning with language models

Ethan Perez, Douwe Kiela, and Kyunghyun Cho. 2021 · 2021

Cited alongside, same era.

Discovering latent knowledge in language models without supervision

Original

Collin Burns, Haotian Ye, Dan Klein, and Jacob Steinhardt. 2022 · 2022

Survey of hallucination in natural language generation

Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Ye Jin Bang, Andrea Madotto, and Pascale Fung. 2023 · 2023

Later among the works it cites.

Large language models struggle to learn long-tail knowledge

Nikhil Kandpal, Haikang Deng, Adam Roberts, Eric Wallace, and Colin Raffel. 2023 · 2023

Later among the works it cites.

Confidently wrong: Exploring the calibration and expression of (un)certainty of large language models in a multilingual setting

Lea Krause, Wondimagegnhue Tufa, Selene Baez Santamaria, Angel Daza, Urja Khurana, and Piek Vossen. 2023 · 2023

Later among the works it cites.

Semantic uncertainty: Linguistic invariances for uncertainty estimation in natural language generation

Original

Lorenz Kuhn, Yarin Gal, and Sebastian Farquhar. 2023 · 2023

Later among the works it cites.

Selfcheckgpt: Zero-resource black-box hallucination detection for generative large language models

Original