Multi-Turn Context Jailbreak Attack on Large Language Models From First Principles

Ignore previous prompt: Attack techniques for language models

Fábio Perez and Ian Ribeiro. 2022 · 2022

Earlier work this paper cites.

Qwen technical report

Original

Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, et al. 2023 · 2023

Earlier work this paper cites.

Red-teaming large language models using chain of utterances for safety-alignment

Original

Rishabh Bhardwaj and Soujanya Poria. 2023 · 2023

Earlier work this paper cites.

Jailbreaking black box large language models in twenty queries

Original

Patrick Chao, Alexander Robey, Edgar Dobriban, Hamed Hassani, George J Pappas, and Eric Wong. 2023 · 2023

Earlier work this paper cites.

Multilingual jailbreak challenges in large language models

Original

Yue Deng, Wenxuan Zhang, Sinno Jialin Pan, and Lidong Bing. 2023 · 2023

Earlier work this paper cites.

Baseline defenses for adversarial attacks against aligned language models

Original

Neel Jain, Avi Schwarzschild, Yuxin Wen, Gowthami Somepalli, John Kirchenbauer, Ping-yeh Chiang, Micah Goldblum, Aniruddha Saha, Jonas Geiping, and Tom Goldstein. 2023 · 2023

Earlier work this paper cites.

Beavertails: Towards improved safety alignment of llm via a human-preference dataset

Original

Jiaming Ji, Mickel Liu, Juntao Dai, Xuehai Pan, Chi Zhang, Ce Bian, Chi Zhang, Ruiyang Sun, Yizhou Wang, and Yaodong Yang. 2023 · 2023

Earlier work this paper cites.

Multi-step jailbreaking privacy attacks on chatgpt

Original

Haoran Li, Dadi Guo, Wei Fan, Mingshi Xu, Jie Huang, Fanpu Meng, and Yangqiu Song. 2023 · 2023

Earlier work this paper cites.

Autodan: Generating stealthy jailbreak prompts on aligned large language models

Original

Xiaogeng Liu, Nan Xu, Muhao Chen, and Chaowei Xiao. 2023 · 2023

Earlier work this paper cites.

" do anything now": Characterizing and evaluating in-the-wild jailbreak prompts on large language models

Original

Xinyue Shen, Zeyuan Chen, Michael Backes, Yun Shen, and Yang Zhang. 2023 · 2023

Earlier work this paper cites.

Llama 2: Open foundation and fine-tuned chat models

Original

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. 2023 · 2023

Earlier work this paper cites.

Jailbroken: How does LLM safety training fail?

Alexander Wei, Nika Haghtalab, and Jacob Steinhardt. 2023 · 2023

Earlier work this paper cites.

Gptfuzzer: Red teaming large language models with auto-generated jailbreak prompts

Original

Jiahao Yu, Xingwei Lin, and Xinyu Xing. 2023 · 2023

Earlier work this paper cites.

Jade: A linguistic-based safety evaluation platform for llm

Original

Mi Zhang, Xudong Pan, and Min Yang. 2023 · 2023

Cited alongside, same era.

Universal and transferable adversarial attacks on aligned language models

Original

Andy Zou, Zifan Wang, J Zico Kolter, and Matt Fredrikson. 2023 · 2023

Cited alongside, same era.

Jailbreakbench: An open robustness benchmark for jailbreaking large language models

Original

Patrick Chao, Edoardo Debenedetti, Alexander Robey, Maksym Andriushchenko, Francesco Croce, Vikash Sehwag, Edgar Dobriban, Nicolas Flammarion, George J Pappas, Florian Tramer, et al. 2024 · 2024

Cited alongside, same era.

Masterkey: Automated jailbreaking of large language model chatbots

Gelei Deng, Yi Liu, Yuekang Li, Kailong Wang, Ying Zhang, Zefeng Li, Haoyu Wang, Tianwei Zhang, and Yang Liu. 2024 · 2024

Cited alongside, same era.

Chatglm: A family of large language models from glm-130b to glm-4 all tools

Microsoft Bing Chat

Microsoft. 2023 · 2024

Closest in time.

Content Moderation Overview

OpenAI Moderation. 2023 · 2024

Closest in time.

Fine-tuning aligned language models compromises safety, even when users do not intend to!

Xiangyu Qi, Yi Zeng, Tinghao Xie, Pin-Yu Chen, Ruoxi Jia, Prateek Mittal, and Peter Henderson. 2024 · 2024

Closest in time.

Jailbreakeval: An integrated toolkit for evaluating jailbreak attempts against large language models

Original

Delong Ran, Jinyuan Liu, Yichen Gong, Jingyi Zheng, Xinlei He, Tianshuo Cong, and Anyu Wang. 2024 · 2024

Closest in time.

Great, now write an article about that: The crescendo multi-turn llm jailbreak attack

Original

Mark Russinovich, Ahmed Salem, and Ronen Eldan. 2024 · 2024

Closest in time.