STShield: Single-Token Sentinel for Real-Time Jailbreak Detection in Large Language Models

Towards deep learning models resistant to adversarial attacks

Aleksander Madry. 2018 · 2018

Earlier work this paper cites.

Decoupled weight decay regularization

I Loshchilov. 2019 · 2019

Earlier work this paper cites.

LoRA: Low-rank adaptation of large language models

Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2022 · 2022

Earlier work this paper cites.

Red teaming language models with language models

Ethan Perez, Saffron Huang, H. Francis Song, Trevor Cai, Roman Ring, John Aslanides, Amelia Glaese, Nat McAleese, and Geoffrey Irving. 2022 · 2022

Earlier work this paper cites.

Detecting language model attacks with perplexity

Original

Gabriel Alon and Michael Kamfonas. 2023 · 2023

Earlier work this paper cites.

Defending against alignment-breaking attacks via robustly aligned LLM

Original

Bochuan Cao, Yuanpu Cao, Lu Lin, and Jinghui Chen. 2023 · 2023

Earlier work this paper cites.

Jailbreaking black box large language models in twenty queries

Original

Patrick Chao, Alexander Robey, Edgar Dobriban, Hamed Hassani, George J. Pappas, and Eric Wong. 2023 · 2023

Earlier work this paper cites.

Vicuna: An open-source chatbot impressing GPT-4 with 90%* ChatGPT quality

Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. 2023 · 2023

Earlier work this paper cites.

Enhancing chat language models by scaling high-quality instructional conversations

Ning Ding, Yulin Chen, Bokai Xu, Yujia Qin, Zhi Zheng, Shengding Hu, Zhiyuan Liu, Maosong Sun, and Bowen Zhou. 2023 · 2023

Earlier work this paper cites.

Llama Guard: LLM-based input-output safeguard for human-AI conversations

Original

Hakan Inan, Kartikeya Upasani, Jianfeng Chi, Rashi Rungta, Krithika Iyer, Yuning Mao, Michael Tontchev, Qing Hu, Brian Fuller, Davide Testuggine, and Madian Khabsa. 2023 · 2023

Earlier work this paper cites.

Baseline defenses for adversarial attacks against aligned language models

Original

Neel Jain, Avi Schwarzschild, Yuxin Wen, Gowthami Somepalli, John Kirchenbauer, Ping-yeh Chiang, Micah Goldblum, Aniruddha Saha, Jonas Geiping, and Tom Goldstein. 2023 · 2023

Earlier work this paper cites.

Certifying LLM safety against adversarial prompting

Original

Aounon Kumar, Chirag Agarwal, Suraj Srinivas, Soheil Feizi, and Hima Lakkaraju. 2023 · 2023

Earlier work this paper cites.

AlpacaEval: An automatic evaluator of instruction-following models

Xuechen Li, Tianyi Zhang, Yann Dubois, Rohan Taori, Ishaan Gulrajani, Carlos Guestrin, Percy Liang, and Tatsunori B. Hashimoto. 2023 · 2023

Earlier work this paper cites.

Jailbreaking ChatGPT via prompt engineering: An empirical study

Original

Yi Liu, Gelei Deng, Zhengzi Xu, Yuekang Li, Yaowen Zheng, Ying Zhang, Lida Zhao, Tianwei Zhang, and Yang Liu. 2023 · 2023

Earlier work this paper cites.

LLM Self Defense: By self examination, LLMs know they are being tricked

Original

Mansi Phute, Alec Helbling, Matthew Hull, ShengYun Peng, Sebastian Szyller, Cory Cornelius, and Duen Horng Chau. 2023 · 2023

Earlier work this paper cites.

SmoothLLM: defending large language models against jailbreaking attacks

Original

Alexander Robey, Eric Wong, Hamed Hassani, and George J. Pappas. 2023 · 2023

Earlier work this paper cites.

Understanding hidden context in preference learning: Consequences for rlhf

Anand Siththaranjan, Cassidy Laidlaw, and Dylan Hadfield-Menell. 2023 · 2023

Cited alongside, same era.

Llama 2: Open foundation and fine-tuned chat models

Original

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. 2023 · 2023

Cited alongside, same era.

Defending chatgpt against jailbreak attack via self-reminders

Yueqi Xie, Jingwei Yi, Jiawei Shao, Justin Curl, Lingjuan Lyu, Qifeng Chen, Xing Xie, and Fangzhao Wu. 2023 · 2023

Cited alongside, same era.

Low-resource languages jailbreak GPT-4

Original

Zheng-Xin Yong, Cristina Menghini, and Stephen H Bach. 2023 · 2023

Cited alongside, same era.

A survey of large language models

Original

Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, Yifan Du, Chen Yang, Yushuo Chen, Zhipeng Chen, Jinhao Jiang, Ruiyang Ren, Yifan Li, Xinyu Tang, Zikang Liu, Peiyu Liu, Jian-Yun Nie, and Ji-Rong Wen. 2023 · 2023

Fight back against jailbreaking via prompt adversarial tuning

Original

Yichuan Mo, Yuji Wang, Zeming Wei, and Yisen Wang. 2024 · 2024

Later among the works it cites.

AdvPrompter: Fast adaptive adversarial prompting for LLMs

Original

Anselm Paulus, Arman Zharmagambetov, Chuan Guo, Brandon Amos, and Yuandong Tian. 2024 · 2024

Later among the works it cites.

Hsf: Defending against jailbreak attacks with hidden state filtering

Original

Cheng Qian, Hainan Zhang, Lei Sha, and Zhiming Zheng. 2024 · 2024

Later among the works it cites.

PAL: Proxy-guided black-box attack on large language models

Original

Chawin Sitawarin, Norman Mu, David Wagner, and Alexandre Araujo. 2024 · 2024

Later among the works it cites.

Efficient adversarial training in LLMs with continuous attacks