SafeEraser: Enhancing Safety in Multimodal Large Language Models through Multimodal Machine Unlearning

Machine unlearning

Original

Lucas Bourtoule, Varun Chandrasekaran, Christopher A. Choquette-Choo, Hengrui Jia, Adelin Travers, Baiwu Zhang, David Lie, and Nicolas Papernot. 2020 · 1912

Earlier work this paper cites.

Rouge: A package for automatic evaluation of summaries

Chin-Yew Lin. 2004 · 2004

Earlier work this paper cites.

Vizwiz grand challenge: Answering visual questions from blind people

Danna Gurari, Qing Li, Abigale J Stangl, Anhong Guo, Chi Lin, Kristen Grauman, Jiebo Luo, and Jeffrey P Bigham. 2018 · 2018

Earlier work this paper cites.

Gqa: A new dataset for real-world visual reasoning and compositional question answering

Drew A Hudson and Christopher D Manning. 2019 · 2019

Earlier work this paper cites.

Lora: Low-rank adaptation of large language models

Original

Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021 · 2021

Earlier work this paper cites.

Flamingo: a visual language model for few-shot learning

Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katherine Millican, Malcolm Reynolds, et al. 2022 · 2022

Earlier work this paper cites.

Continual learning and private unlearning

Bo Liu, Qiang Liu, and Peter Stone. 2022 · 2022

Earlier work this paper cites.

Openflamingo: An open-source framework for training large autoregressive vision-language models

Original

Anas Awadalla, Irena Gao, Josh Gardner, Jack Hessel, Yusuf Hanafy, Wanrong Zhu, Kalyani Marathe, Yonatan Bitton, Samir Gadre, Shiori Sagawa, et al. 2023 · 2023

Earlier work this paper cites.

Qwen technical report

Original

Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, et al. 2023 · 2023

Earlier work this paper cites.

A wolf in sheep’s clothing: Generalized nested jailbreak prompts can fool large language models easily

Original

Peng Ding, Jun Kuang, Dan Ma, Xuezhi Cao, Yunsen Xian, Jiajun Chen, and Shujian Huang. 2023 · 2023

Earlier work this paper cites.

Who’s harry potter? approximate unlearning in llms

Original

Ronen Eldan and Mark Russinovich. 2023 · 2023

Earlier work this paper cites.

Not what you’ve signed up for: Compromising real-world llm-integrated applications with indirect prompt injection

Original

Kai Greshake, Sahar Abdelnabi, Shailesh Mishra, Christoph Endres, Thorsten Holz, and Mario Fritz. 2023 · 2023

Earlier work this paper cites.

Jailbreak and guard aligned language models with only few in-context demonstrations

Original

Zeming Wei, Yifei Wang, Ang Li, Yichuan Mo, and Yisen Wang. 2023 · 2023

Earlier work this paper cites.

Large language model unlearning

Original

Yuanshun Yao, Xiaojun Xu, and Yang Liu. 2023 · 2023

Earlier work this paper cites.

Mm-vet: Evaluating large multimodal models for integrated capabilities

Original

Weihao Yu, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Kevin Lin, Zicheng Liu, Xinchao Wang, and Lijuan Wang. 2023 · 2023

Earlier work this paper cites.

Judging llm-as-a-judge with mt-bench and chatbot arena

Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric Xing, et al. 2023 · 2023

Cited alongside, same era.

Machine unlearning doesn’t do what you think: Lessons for generative ai policy, research, and practice

Original

A Feder Cooper, Christopher A Choquette-Choo, Miranda Bogen, Matthew Jagielski, Katja Filippova, Ken Ziyu Liu, Alexandra Chouldechova, Jamie Hayes, Yangsibo Huang, Niloofar Mireshghallah, et al. 2024 · 2024

Cited alongside, same era.

Does unlearning truly unlearn? a black box evaluation of llm unlearning methods

Original

Jai Doshi and Asa Cooper Stickland. 2024 · 2024

Cited alongside, same era.

The llama 3 herd of models

Original

Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, et al. 2024 · 2024

Cited alongside, same era.

Jailbreak in pieces: Compositional adversarial attacks on multi-modal language models

Erfan Shayegani, Yue Dong, and Nael Abu-Ghazaleh. 2024 · 2024

Later among the works it cites.

Assessment of multimodal large language models in alignment with human values

Original

Zhelun Shi, Zhipin Wang, Hongxing Fan, Zaibin Zhang, Lijun Li, Yongting Zhang, Zhenfei Yin, Lu Sheng, Yu Qiao, and Jing Shao. 2024 · 2024

Later among the works it cites.

Urbanclip: Learning text-enhanced urban region profiling with contrastive language-image pretraining from the web

Yibo Yan, Haomin Wen, Siru Zhong, Wei Chen, Haodong Chen, Qingsong Wen, Roger Zimmermann, and Yuxuan Liang. 2024c · 2024

Later among the works it cites.

Machine unlearning of pre-trained large language models

Jin Yao, Eli Chien, Minxin Du, Xinyao Niu, Tianhao Wang, Zezhou Cheng, and Xiang Yue. 2024 · 2024

Later among the works it cites.

Jailbreak attacks and defenses against large language models: A survey

Original