Drowzee: Metamorphic Testing for Fact-Conflicting Hallucination Detection in Large Language Models

A Philosophical Essay on Probabilities

Pierre-Simon Laplace. 1951 · 1951

Earlier work this paper cites.

Freebase: A Shared Database of Structured General Human Knowledge. In Proceedings of the 22nd National Conference on Artificial Intelligence - Volume 2 (Vancouver, British Columbia, Canada) (AAAI’07) . AAAI Press, 1962–1963

Kurt Bollacker, Robert Cook, and Patrick Tufts. 2007 · 1963

Earlier work this paper cites.

WordNet: A Lexical Database for English. In Human Language Technology: Proceedings of a Workshop held at Plainsboro, New Jersey, March 8-11, 1994

George A. Miller. 1994 · 1994

Earlier work this paper cites.

WordNet: A Lexical Database for English

George A. Miller. 1995 · 1995

Earlier work this paper cites.

DBpedia: A Nucleus for a Web of Open Data. In The Semantic Web , Karl Aberer, Key-Sun Choi, Natasha Noy, Dean Allemang, Kyung-Il Lee, Lyndon Nixon, Jennifer Golbeck, Peter Mika, Diana Maynard, Riichiro Mizoguchi, Guus Schreiber, and Philippe Cudré-Mauroux (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 722–735

Sören Auer, Christian Bizer, Georgi Kobilarov, Jens Lehmann, Richard Cyganiak, and Zachary Ives. 2007 · 2007

Earlier work this paper cites.

Yago: A Core of Semantic Knowledge. In Proceedings of the 16th International Conference on World Wide Web (Banff, Alberta, Canada) (WWW ’07) . Association for Computing Machinery, New York, NY, USA, 697–706

Fabian M. Suchanek, Gjergji Kasneci, and Gerhard Weikum. 2007 · 2007

Earlier work this paper cites.

Swi-prolog

Jan Wielemaker, Tom Schrijvers, Markus Triska, and Torbjörn Lager. 2012 · 2012

Earlier work this paper cites.

Leveraging Linguistic Structure For Open Domain Information Extraction. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) , Chengqing Zong and Michael Strube (Eds.). Association for Computational Linguistics, Beijing, China, 344–354

Gabor Angeli, Melvin Jose Johnson Premkumar, and Christopher D. Manning. 2015 · 2015

Earlier work this paper cites.

WikiExtractor

Giusepppe Attardi. 2015 · 2015

Earlier work this paper cites.

Get To The Point: Summarization with Pointer-Generator Networks. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , Regina Barzilay and Min-Yen Kan (Eds.). Association for Computational Linguistics, Vancouver, Canada, 1073–1083

Abigail See, Peter J. Liu, and Christopher D. Manning. 2017 · 2017

Earlier work this paper cites.

SPARQL Query Language for RDF - W3C recommendation

Eric Prud’hommeaux and Andy Seaborne. 2018 · 2018

Earlier work this paper cites.

HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31 - November 4, 2018 , Ellen Riloff, David Chiang, Julia Hockenmaier, and Jun’ichi Tsujii (Eds.). Association for Computational Linguistics, 2369–2380

Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William W. Cohen, Ruslan Salakhutdinov, and Christopher D. Manning. 2018 · 2018

Earlier work this paper cites.

Opendialkg: Explainable conversational reasoning with attention-based walks over knowledge graphs. In Proceedings of the 57th annual meeting of the association for computational linguistics . 845–854

Seungwhan Moon, Pararth Shah, Anuj Kumar, and Rajen Subba. 2019 · 2019

Earlier work this paper cites.

Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP 2019, Hong Kong, China, November 3-7, 2019 , Kentaro Inui, Jing Jiang, Vincent Ng, and Xiaojun Wan (Eds.). Association for Computational Linguistics, 3980–3990

Nils Reimers and Iryna Gurevych. 2019 · 2019

Earlier work this paper cites.

On completing sparse knowledge base with transitive relation embedding. In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 33. 3125–3132

Zili Zhou, Shaowu Liu, Guandong Xu, and Wu Zhang. 2019 · 2019

Earlier work this paper cites.

Boxe: A box embedding model for knowledge base completion

Ralph Abboud, Ismail Ceylan, Thomas Lukasiewicz, and Tommaso Salvatori. 2020 · 2020

Earlier work this paper cites.

Python wrapper for Stanford OpenIE

Philippe Remy. 2020 · 2020

Earlier work this paper cites.

Beta embeddings for multi-hop logical reasoning in knowledge graphs

Hongyu Ren and Jure Leskovec. 2020 · 2020

Earlier work this paper cites.

Phrase-BERT: Improved Phrase Embeddings from BERT with an Application to Corpus Exploration. In Empirical Methods in Natural Language Processing

Shufan Wang, Laure Thompson, and Mohit Iyyer. 2021 · 2021

Earlier work this paper cites.

FOLIO: Natural Language Reasoning with First-Order Logic

Original

Simeng Han, Hailey Schoelkopf, Yilun Zhao, Zhenting Qi, Martin Riddell, Luke Benson, Lucy Sun, Ekaterina Zubova, Yujie Qiao, Matthew Burtell, David Peng, Jonathan Fan, Yixin Liu, Brian Wong, Malcolm Sailor, Ansong Ni, Linyong Nan, Jungo Kasai, Tao Yu, Rui Zhang, Shafiq Joty, Alexander R. Fabbri, Wojciech Kryscinski, Xi Victoria Lin, Caiming Xiong, and Dragomir Radev. 2022 · 2022

Earlier work this paper cites.

Reasoning over different types of knowledge graphs: Static, temporal and multi-modal

Original

Ke Liang, Lingyuan Meng, Meng Liu, Yue Liu, Wenxuan Tu, Siwei Wang, Sihang Zhou, Xinwang Liu, and Fuchun Sun. 2022 · 2022

Earlier work this paper cites.

TruthfulQA: Measuring How Models Mimic Human Falsehoods. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , Smaranda Muresan, Preslav Nakov, and Aline Villavicencio (Eds.). Association for Computational Linguistics, Dublin, Ireland, 3214–3252

Stephanie Lin, Jacob Hilton, and Owain Evans. 2022 · 2022

Cited alongside, same era.

Locating and Editing Factual Associations in GPT

Kevin Meng, David Bau, Alex Andonian, and Yonatan Belinkov. 2022 · 2022

Cited alongside, same era.

Knowledge graph and knowledge reasoning: A systematic review

Ling Tian, Xue Zhou, Yan-Ping Wu, Wang-Tao Zhou, Jin-Hao Zhang, and Tian-Shu Zhang. 2022 · 2022

Cited alongside, same era.

The Internal State of an LLM Knows When It’s Lying. In Findings of the Association for Computational Linguistics: EMNLP 2023 , Houda Bouamor, Juan Pino, and Kalika Bali (Eds.). Association for Computational Linguistics, Singapore, 967–976

Amos Azaria and Tom Mitchell. 2023 · 2023

Cited alongside, same era.

Llama 2: Open foundation and fine-tuned chat models

Original

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al · 2023

Later among the works it cites.

A stitch in time saves nine: Detecting and mitigating hallucinations of llms by validating low-confidence generation

Original

Neeraj Varshney, Wenlin Yao, Hongming Zhang, Jianshu Chen, and Dong Yu. 2023 · 2023

Later among the works it cites.

SatLM: Satisfiability-Aided Language Models Using Declarative Prompting. In Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023 , Alice Oh, Tristan Naumann, Amir Globerson, Kate Saenko, Moritz Hardt, and Sergey Levine (Eds.)

Xi Ye, Qiaochu Chen, Isil Dillig, and Greg Durrett. 2023 · 2023

Later among the works it cites.

Woodpecker: Hallucination correction for multimodal large language models

Original