Unified Hallucination Detection for Multimodal Large Language Models

Microsoft coco: Common objects in context

Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick. 2014 · 2014

Earlier work this paper cites.

Towards VQA models that can read

Amanpreet Singh, Vivek Natarajan, Meet Shah, Yu Jiang, Xinlei Chen, Dhruv Batra, Devi Parikh, and Marcus Rohrbach. 2019 · 2019

Earlier work this paper cites.

Denoising diffusion probabilistic models

Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020 · 2020

Earlier work this paper cites.

Evaluating the factual consistency of abstractive text summarization

Wojciech Kryscinski, Bryan McCann, Caiming Xiong, and Richard Socher. 2020 · 2020

Earlier work this paper cites.

Asking and answering questions to evaluate the factual consistency of summaries

Alex Wang, Kyunghyun Cho, and Mike Lewis. 2020 · 2020

Earlier work this paper cites.

Hierarchical text-conditional image generation with CLIP latents

Original

Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. 2022 · 2022

Earlier work this paper cites.

Photorealistic text-to-image diffusion models with deep language understanding

Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily L. Denton, Seyed Kamyar Seyed Ghasemipour, Raphael Gontijo Lopes, Burcu Karagol Ayan, Tim Salimans, Jonathan Ho, David J. Fleet, and Mohammad Norouzi. 2022 · 2022

Earlier work this paper cites.

Chain-of-thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed H. Chi, Quoc V. Le, and Denny Zhou. 2022 · 2022

Earlier work this paper cites.

Qwen-vl: A frontier large vision-language model with versatile abilities

Original

Jinze Bai, Shuai Bai, Shusheng Yang, Shijie Wang, Sinan Tan, Peng Wang, Junyang Lin, Chang Zhou, and Jingren Zhou. 2023 · 2023

Earlier work this paper cites.

Improving image generation with better captions

James Betker, Gabriel Goh, Li Jing, TimBrooks, Jianfeng Wang, Linjie Li, LongOuyang, JuntangZhuang, JoyceLee, YufeiGuo, WesamManassra, PrafullaDhariwal, CaseyChu, YunxinJiao, and Aditya Ramesh. 2023 · 2023

Earlier work this paper cites.

Large knowledge model: Perspectives and challenges

Original

Huajun Chen. 2023 · 2023

Earlier work this paper cites.

Factchd: Benchmarking fact-conflicting hallucination detection

Original

Xiang Chen, Duanzheng Song, Honghao Gui, Chengxi Wang, Ningyu Zhang, Jiang Yong, Fei Huang, Chengfei Lv, Dan Zhang, and Huajun Chen. 2023 · 2023

Earlier work this paper cites.

Factool: Factuality detection in generative AI - A tool augmented framework for multi-task and multi-domain scenarios

Original

I-Chun Chern, Steffi Chern, Shiqi Chen, Weizhe Yuan, Kehua Feng, Chunting Zhou, Junxian He, Graham Neubig, and Pengfei Liu. 2023 · 2023

Earlier work this paper cites.

Toolkengpt: Augmenting frozen language models with massive tools via tool embeddings

Shibo Hao, Tianyang Liu, Zhen Wang, and Zhiting Hu. 2023 · 2023

Earlier work this paper cites.

Survey of hallucination in natural language generation

Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Ye Jin Bang, Andrea Madotto, and Pascale Fung. 2023 · 2023

Earlier work this paper cites.

Revisiting scene text recognition: A data perspective

Qing Jiang, Jiapeng Wang, Dezhi Peng, Chongyu Liu, and Lianwen Jin. 2023 · 2023

Earlier work this paper cites.

FAITHSCORE: evaluating hallucinations in large vision-language models

Original

Liqiang Jing, Ruosen Li, Yunmo Chen, Mengzhao Jia, and Xinya Du. 2023 · 2023

Cited alongside, same era.

Mitigating object hallucinations in large vision-language models through visual contrastive decoding

Original

Sicong Leng, Hang Zhang, Guanzheng Chen, Xin Li, Shijian Lu, Chunyan Miao, and Lidong Bing. 2023 · 2023

Cited alongside, same era.

Halueval: A large-scale hallucination evaluation benchmark for large language models

Junyi Li, Xiaoxue Cheng, Xin Zhao, Jian-Yun Nie, and Ji-Rong Wen. 2023a · 2023

Cited alongside, same era.

Taskmatrix.ai: Completing tasks by connecting foundation models with millions of apis

Original

Yaobo Liang, Chenfei Wu, Ting Song, Wenshan Wu, Yan Xia, Yu Liu, Yang Ou, Shuai Lu, Lei Ji, Shaoguang Mao, Yun Wang, Linjun Shou, Ming Gong, and Nan Duan. 2023 · 2023

Cited alongside, same era.

Woodpecker: Hallucination correction for multimodal large language models

Original

Shukang Yin, Chaoyou Fu, Sirui Zhao, Tong Xu, Hao Wang, Dianbo Sui, Yunhang Shen, Ke Li, Xing Sun, and Enhong Chen. 2023 · 2023

Later among the works it cites.

Halle-switch: Rethinking and controlling object existence hallucinations in large vision language models for detailed caption

Original

Bohan Zhai, Shijia Yang, Xiangchen Zhao, Chenfeng Xu, Sheng Shen, Dongdi Zhao, Kurt Keutzer, Manling Li, Tan Yan, and Xiangjun Fan. 2023 · 2023

Later among the works it cites.

Analyzing and mitigating object hallucination in large vision-language models

Original

Yiyang Zhou, Chenhang Cui, Jaehong Yoon, Linjun Zhang, Zhun Deng, Chelsea Finn, Mohit Bansal, and Huaxiu Yao. 2023 · 2023

Later among the works it cites.

Minigpt-4: Enhancing vision-language understanding with advanced large language models

Original

Deyao Zhu, Jun Chen, Xiaoqian Shen, Xiang Li, and Mohamed Elhoseiny. 2023 · 2023

Later among the works it cites.