SafeBench: A Safety Evaluation Framework for Multimodal Large Language Models

A coefficient of agreement for nominal scales

Jacob Cohen · 1960

Earlier work this paper cites.

Realtoxicityprompts: Evaluating neural toxic degeneration in language models

Samuel Gehman, Suchin Gururangan, Maarten Sap, Yejin Choi, and Noah A. Smith · 2020

Earlier work this paper cites.

Realtoxicityprompts: Evaluating neural toxic degeneration in language models, 2020

Samuel Gehman, Suchin Gururangan, Maarten Sap, Yejin Choi, and Noah A. Smith · 2020

Earlier work this paper cites.

Image retrieval on real-life images with pre-trained vision-and-language models

Zheyuan Liu, Cristian Rodriguez Opazo, Damien Teney, and Stephen Gould · 2021

Earlier work this paper cites.

Robustart: Benchmarking robustness on architecture design and training techniques

Shiyu Tang, Ruihao Gong, Yan Wang, Aishan Liu, Jiakai Wang, Xinyun Chen, Fengwei Yu, Xianglong Liu, Dawn Song, Alan Yuille, et al · 2021

Earlier work this paper cites.

Training robust deep neural networks via adversarial noise propagation

Aishan Liu, Xianglong Liu, Hang Yu, Chongzhi Zhang, Qiang Liu, and Dacheng Tao · 2021

Earlier work this paper cites.

Visualgpt: Data-efficient adaptation of pretrained language models for image captioning

Jun Chen, Han Guo, Kai Yi, Boyang Li, and Mohamed Elhoseiny · 2022

Earlier work this paper cites.

Training a helpful and harmless assistant with reinforcement learning from human feedback

Original

Yuntao Bai, Andy Jones, Kamal Ndousse, Amanda Askell, et al · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, et al · 2022

Earlier work this paper cites.

Toxigen: A large-scale machine-generated dataset for adversarial and implicit hate speech detection

Thomas Hartvigsen, Saadia Gabriel, Hamid Palangi, Maarten Sap, Dipankar Ray, and Ece Kamar · 2022

Earlier work this paper cites.

Truthfulqa: Measuring how models mimic human falsehoods

Stephanie Lin, Jacob Hilton, and Owain Evans · 2022

Earlier work this paper cites.

On the adversarial robustness of multi-modal foundation models

Christian Schlarmann and Matthias Hein · 2023

Earlier work this paper cites.

On the robustness of large multimodal models against image adversarial attacks

Original

Xuanming Cui, Alejandro Aparcedo, Young Kyun Jang, and Ser-Nam Lim · 2023

Earlier work this paper cites.

Direct preference optimization: Your language model is secretly a reward model

Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning, Stefano Ermon, and Chelsea Finn · 2023

Earlier work this paper cites.

A comprehensive evaluation framework for deep model robustness

Jun Guo, Wei Bao, Jiakai Wang, Yuqing Ma, Xinghai Gao, Gang Xiao, Aishan Liu, Jian Dong, Xianglong Liu, and Wenjun Wu · 2023

Earlier work this paper cites.

Badclip: Dual-embedding guided backdoor attack on multimodal contrastive learning

Original

Siyuan Liang, Mingli Zhu, Aishan Liu, Baoyuan Wu, Xiaochun Cao, and Ee-Chien Chang · 2023

Earlier work this paper cites.

Pre-trained trojan attacks for visual recognition

Original

Aishan Liu, Xinwei Zhang, Yisong Xiao, Yuguang Zhou, Siyuan Liang, Jiakai Wang, Xianglong Liu, Xiaochun Cao, and Dacheng Tao · 2023

Earlier work this paper cites.

GPTFUZZER: red teaming large language models with auto-generated jailbreak prompts

Original

Jiahao Yu, Xingwei Lin, Zheng Yu, and Xinyu Xing · 2023

Earlier work this paper cites.

Jailbroken: How does LLM safety training fail?

Alexander Wei, Nika Haghtalab, and Jacob Steinhardt · 2023

Earlier work this paper cites.

Jailbreaking black box large language models in twenty queries

Original

Patrick Chao, Alexander Robey, Edgar Dobriban, Hamed Hassani, George J. Pappas, and Eric Wong · 2023

Earlier work this paper cites.

Figstep: Jailbreaking large vision-language models via typographic visual prompts

Original

Yichen Gong, Delong Ran, Jinyuan Liu, Conglei Wang, Tianshuo Cong, Anyu Wang, Sisi Duan, and Xiaoyun Wang · 2023

Earlier work this paper cites.

Universal and transferable adversarial attacks on aligned language models

Original

Andy Zou, Zifan Wang, J. Zico Kolter, and Matt Fredrikson · 2023

Earlier work this paper cites.

FFT: towards harmlessness evaluation and analysis for llms with factuality, fairness, toxicity

Original

Shiyao Cui, Zhenyu Zhang, Yilong Chen, Wenyuan Zhang, Tianyun Liu, Siqi Wang, and Tingwen Liu · 2023

Earlier work this paper cites.

How many unicorns are in this image? A safety evaluation benchmark for vision llms

Original

Haoqin Tu, Chenhang Cui, Zijun Wang, Yiyang Zhou, Bingchen Zhao, Junlin Han, Wangchunshu Zhou, Huaxiu Yao, and Cihang Xie · 2023

Earlier work this paper cites.

Visual adversarial examples jailbreak aligned large language models, 2023

Xiangyu Qi, Kaixuan Huang, Ashwinee Panda, Peter Henderson, Mengdi Wang, and Prateek Mittal · 2023

Earlier work this paper cites.

Llama guard: Llm-based input-output safeguard for human-ai conversations, 2023

Hakan Inan, Kartikeya Upasani, Jianfeng Chi, Rashi Rungta, Krithika Iyer, Yuning Mao, Michael Tontchev, Qing Hu, Brian Fuller, Davide Testuggine, and Madian Khabsa · 2023

Earlier work this paper cites.

Jailbreaking black box large language models in twenty queries

Original

Patrick Chao, Alexander Robey, Edgar Dobriban, Hamed Hassani, George J. Pappas, and Eric Wong · 2023

Earlier work this paper cites.

Tree of attacks: Jailbreaking black-box llms automatically

Original

Anay Mehrotra, Manolis Zampetakis, Paul Kassianik, Blaine Nelson, Hyrum S. Anderson, Yaron Singer, and Amin Karbasi · 2023

Earlier work this paper cites.

Judging llm-as-a-judge with mt-bench and chatbot arena

Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, and Ion Stoica · 2023

Earlier work this paper cites.

A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions

Original

Lei Huang, Weijiang Yu, Weitao Ma, Weihong Zhong, Zhangyin Feng, Haotian Wang, Qianglong Chen, Weihua Peng, Xiaocheng Feng, Bing Qin, and Ting Liu · 2023

Earlier work this paper cites.

Chain-of-thought prompting elicits reasoning in large language models, 2023

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed Chi, Quoc Le, and Denny Zhou · 2023

Earlier work this paper cites.

Cogvlm: Visual expert for pretrained language models

Weihan Wang, Qingsong Lv, Wenmeng Yu, Wenyi Hong, Ji Qi, Yan Wang, Junhui Ji, Zhuoyi Yang, Lei Zhao, Xixuan Song, Jiazheng Xu, Bin Xu, Juanzi Li, Yuxiao Dong, Ming Ding, and Jie Tang · 2023

Earlier work this paper cites.

Qwen-vl: A frontier large vision-language model with versatile abilities

Original

Jinze Bai, Shuai Bai, Shusheng Yang, Shijie Wang, Sinan Tan, Peng Wang, Junyang Lin, Chang Zhou, and Jingren Zhou · 2023

Earlier work this paper cites.

Qwen-vl: A versatile vision-language model for understanding, localization, text reading, and beyond

Original

Jinze Bai, Shuai Bai, Shusheng Yang, Shijie Wang, Sinan Tan, Peng Wang, Junyang Lin, Chang Zhou, and Jingren Zhou · 2023

Earlier work this paper cites.

Sharegpt4v: Improving large multi-modal models with better captions, 2023

Lin Chen, Jinsong Li, Xiaoyi Dong, Pan Zhang, Conghui He, Jiaqi Wang, Feng Zhao, and Dahua Lin · 2023

Cited alongside, same era.

Qwen technical report

Original

Jinze Bai, Shuai Bai, Yunfei Chu, et al · 2023

Cited alongside, same era.

A high quality sparse mixture-of-experts

Mixtral AI · 2023

Cited alongside, same era.

Qwen-audio: Advancing universal audio understanding via unified large-scale audio-language models, 2023

Yunfei Chu, Jin Xu, Xiaohuan Zhou, Qian Yang, Shiliang Zhang, Zhijie Yan, Chang Zhou, and Jingren Zhou · 2023

Cited alongside, same era.

Visual question answering instruction: Unlocking multimodal large language model to domain-specific visual multitasks

Original

Jusung Lee, Sungguk Cha, Younghyun Lee, and Cheoljong Yang · 2024

Cited alongside, same era.

Evaluating large language models at evaluating instruction following, 2024

Zhiyuan Zeng, Jiatong Yu, Tianyu Gao, Yu Meng, Tanya Goyal, and Danqi Chen · 2024

Closest in time.

Hallucination is inevitable: An innate limitation of large language models

Original

Ziwei Xu, Sanjay Jain, and Mohan S. Kankanhalli · 2024

Closest in time.

Does refusal training in llms generalize to the past tense?, 2024

Maksym Andriushchenko and Nicolas Flammarion · 2024

Closest in time.

Draw-and-understand: Leveraging visual prompts to enable mllms to comprehend what you want, 2024

Weifeng Lin, Xinyu Wei, Ruichuan An, Peng Gao, Bocheng Zou, Yulin Luo, Siyuan Huang, Shanghang Zhang, and Hongsheng Li · 2024

Closest in time.

Can large multimodal models uncover deep semantics behind images?

Yixin Yang, Zheng Li, Qingxiu Dong, Heming Xia, and Zhifang Sui · 2024

Closest in time.