CCHall: A Novel Benchmark for Joint Cross-Lingual and Cross-Modal Hallucinations Detection in Large Language Models

Evaluation of the validity of back-translation as a method of assessing the accuracy of machine translation

Mai Miyabe and Takashi Yoshino. 2015 · 2015

Earlier work this paper cites.

Xnli: Evaluating cross-lingual sentence representations

Alexis Conneau, Ruty Rinott, Guillaume Lample, Adina Williams, Samuel Bowman, Holger Schwenk, and Veselin Stoyanov. 2018 · 2018

Earlier work this paper cites.

Object hallucination in image captioning

Original

Anna Rohrbach, Lisa Anne Hendricks, Kaylee Burns, Trevor Darrell, and Kate Saenko. 2018 · 2018

Earlier work this paper cites.

Gqa: A new dataset for real-world visual reasoning and compositional question answering

Drew A Hudson and Christopher D Manning. 2019 · 2019

Earlier work this paper cites.

X-fact: A new benchmark dataset for multilingual fact checking

Original

Ashim Gupta and Vivek Srikumar. 2021 · 2021

Earlier work this paper cites.

Xl-sum: Large-scale multilingual abstractive summarization for 44 languages

Original

Tahmid Hasan, Abhik Bhattacharjee, Md Saiful Islam, Kazi Samin, Yuan-Fang Li, Yong-Bin Kang, M. Sohel Rahman, and Rifat Shahriyar. 2021 · 2021

Earlier work this paper cites.

Examining Machine Translation Systems and Translation Quality using the Back-Translation Method

Michelle A Lee. 2021 · 2021

Earlier work this paper cites.

Learning transferable visual models from natural language supervision

Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021 · 2021

Earlier work this paper cites.

Iglue: A benchmark for transfer learning across modalities, tasks, and languages

Emanuele Bugliarello, Fangyu Liu, Jonas Pfeiffer, Siva Reddy, Desmond Elliott, Edoardo Maria Ponti, and Ivan Vulić. 2022 · 2022

Earlier work this paper cites.

Large language models are zero-shot reasoners

Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022 · 2022

Earlier work this paper cites.

Crossmodal-3600: A massively multilingual multimodal evaluation dataset

Original

Ashish V Thapliyal, Jordi Pont-Tuset, Xi Chen, and Radu Soricut. 2022 · 2022

Earlier work this paper cites.

Chain-of-thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, and Dale et al. Schuurmans. 2022 · 2022

Earlier work this paper cites.

Audiolm: a language modeling approach to audio generation

Zalán Borsos et al. 2023 · 2023

Earlier work this paper cites.

Halomi: A manually annotated benchmark for multilingual hallucination and omission detection in machine translation

David Dale, Elena Voita, Janice Lam, Prangthip Hansanti, Christophe Ropers, Elahe Kalbassi, Cynthia Gao, Loic Barrault, and Marta Costa-jussa. 2023a · 2023

Earlier work this paper cites.

Hallucinations in large multilingual translation models

Nuno M Guerreiro, Duarte M Alves, Jonas Waldendorf, Barry Haddow, Alexandra Birch, Pierre Colombo, and André FT Martins. 2023 · 2023

Earlier work this paper cites.

Evaluating object hallucination in large vision-language models

Original

Yifan Li, Yifan Du, Kun Zhou, Jinpeng Wang, Wayne Xin Zhao, and Ji-Rong Wen. 2023 · 2023

Earlier work this paper cites.

Hallusionbench: You see what you think? or you think what you see? an image-context reasoning benchmark challenging for gpt-4v (ision), llava-1.5, and other multi-modality models

Original

Fuxiao Liu, Tianrui Guan, Zongxia Li, Lichang Chen, Yaser Yacoob, Dinesh Manocha, and Tianyi Zhou. 2023 · 2023

Earlier work this paper cites.

Gpt-4 technical report

Original

OpenAI. 2023 · 2023

Earlier work this paper cites.

Cross-lingual prompting: Improving zero-shot chain-of-thought reasoning across languages

Original

Libo Qin, Qiguang Chen, Fuxuan Wei, Shijue Huang, and Wanxiang Che. 2023 · 2023

Cited alongside, same era.

Detecting and mitigating hallucinations in multilingual summarisation

Yifu Qiu, Yftah Ziser, Anna Korhonen, Edoardo Ponti, and Shay B Cohen. 2023 · 2023

Cited alongside, same era.

An llm-free multi-dimensional benchmark for mllms hallucination evaluation

Original

Junyang Wang, Yuhang Wang, Guohai Xu, Jing Zhang, Yukai Gu, Haitao Jia, Ming Yan, Ji Zhang, and Jitao Sang. 2023 · 2023

Cited alongside, same era.

Pixtral 12b

Original

Pravesh Agrawal, Szymon Antoniak, Emma Bou Hanna, Baptiste Bout, Devendra Chaplot, Jessica Chudnovsky, Diogo Costa, Baudouin De Monicault, Saurabh Garg, Theophile Gervet, et al. 2024 · 2024

Cited alongside, same era.

Hallucination of multimodal large language models: A survey

The llama 3 herd of models

Original

Abhimanyu Meta, Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, et al. 2024 · 2024

Later among the works it cites.

Llama 3.2: Revolutionizing edge ai and vision with open, customizable models

AI Meta. 2024 · 2024

Later among the works it cites.

Mitigating dialogue hallucination for large multi-modal models via adversarial instruction tuning

Original

Dongmin Park, Zhaofang Qian, Guangxing Han, and Ser-Nam Lim. 2024 · 2024

Later among the works it cites.

Large language models meet nlp: A survey

Libo Qin, Qiguang Chen, Xiachong Feng, Yang Wu, Yongheng Zhang, Yinghui Li, Min Li, Wanxiang Che, and Philip S Yu. 2024 · 2024

Later among the works it cites.

Massive multilingual abstract meaning representation: A dataset and baselines for hallucination detection

Original