Playing Language Game with LLMs Leads to Jailbreaking

Deep reinforcement learning from human preferences

Paul F Christiano, Jan Leike, Tom Brown, Miljan Martic, Shane Legg, and Dario Amodei · 2017

Earlier work this paper cites.

Lora: Low-rank adaptation of large language models

Original

Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen · 2021

Earlier work this paper cites.

Red teaming language models to reduce harms: Methods, scaling behaviors, and lessons learned

Original

Deep Ganguli, Liane Lovitt, Jackson Kernion, Amanda Askell, Yuntao Bai, Saurav Kadavath, Ben Mann, Ethan Perez, Nicholas Schiefer, Kamal Ndousse, et al · 2022

Earlier work this paper cites.

Training language models to follow instructions with human feedback

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al · 2022

Earlier work this paper cites.

Red teaming language models with language models, february 2022a

Original

Ethan Perez, Saffron Huang, Francis Song, Trevor Cai, Roman Ring, John Aslanides, Amelia Glaese, Nat McAleese, and Geoffrey Irving · 2022

Earlier work this paper cites.

Gpt-4 technical report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al · 2023

Earlier work this paper cites.

Model card and evaluations for claude models

Anthropic · 2023

Earlier work this paper cites.

Another jailbreak for gpt4: Talk to it in morse code

Boaz Barak · 2023

Earlier work this paper cites.

Safety-tuned llamas: Lessons from improving the safety of large language models that follow instructions

Original

Federico Bianchi, Mirac Suzgun, Giuseppe Attanasio, Paul Röttger, Dan Jurafsky, Tatsunori Hashimoto, and James Zou · 2023

Earlier work this paper cites.

Claude2-alpaca: Instruction tuning datasets distilled from claude

Lichang Chen, Khalid Saifullah, Ming Li, Tianyi Zhou, and Heng Huang · 2023

Cited alongside, same era.

Safe rlhf: Safe reinforcement learning from human feedback

Original

Josef Dai, Xuehai Pan, Ruiyang Sun, Jiaming Ji, Xinbo Xu, Mickel Liu, Yizhou Wang, and Yaodong Yang · 2023

Cited alongside, same era.

Multilingual jailbreak challenges in large language models

Original

Yue Deng, Wenxuan Zhang, Sinno Jialin Pan, and Lidong Bing · 2023

Cited alongside, same era.

Pretraining language models with human preferences

Tomasz Korbak, Kejian Shi, Angelica Chen, Rasika Vinayak Bhalerao, Christopher Buckley, Jason Phang, Samuel R Bowman, and Ethan Perez · 2023

Cited alongside, same era.

Multi-step jailbreaking privacy attacks on chatgpt

Original

Haoran Li, Dadi Guo, Wei Fan, Mingshi Xu, Jie Huang, Fanpu Meng, and Yangqiu Song · 2023

Play guessing game with llm: Indirect jailbreak attack with implicit clues

Original

Zhiyuan Chang, Mingyang Li, Yi Liu, Junjie Wang, Qing Wang, and Yang Liu · 2024

Closest in time.

Chatbot arena: An open platform for evaluating llms by human preference

Original

Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anastasios Nikolas Angelopoulos, Tianle Li, Dacheng Li, Hao Zhang, Banghua Zhu, Michael Jordan, Joseph E Gonzalez, et al · 2024

Closest in time.

Cold-attack: Jailbreaking llms with stealthiness and controllability

Original

Xingang Guo, Fangxu Yu, Huan Zhang, Lianhui Qin, and Bin Hu · 2024

Closest in time.

Pku-saferlhf: A safety alignment preference dataset for llama family models

Original

Jiaming Ji, Donghai Hong, Borong Zhang, Boyuan Chen, Josef Dai, Boren Zheng, Tianyi Qiu, Boxun Li, and Yaodong Yang · 2024

Closest in time.