Shaping the Safety Boundaries: Understanding and Defending Against Jailbreaks in Large Language Models

Divergence measures based on the shannon entropy

Jianhua Lin. 1991 · 1991

Earlier work this paper cites.

Multidimensional scaling

J Douglas Carroll and Phipps Arabie. 1998 · 1998

Earlier work this paper cites.

Efficient global optimization of expensive black-box functions

Donald R Jones, Matthias Schonlau, and William J Welch. 1998 · 1998

Earlier work this paper cites.

A taxonomy of global optimization methods based on response surfaces

Donald R. Jones. 2001 · 2001

Earlier work this paper cites.

Visualizing data using t-sne

Laurens Van der Maaten and Geoffrey Hinton. 2008 · 2008

Earlier work this paper cites.

Algorithms for hyper-parameter optimization

James Bergstra, Rémi Bardenet, Yoshua Bengio, and Balázs Kégl. 2011 · 2011

Earlier work this paper cites.

Optuna: A next-generation hyperparameter optimization framework

Takuya Akiba, Shotaro Sano, Toshihiko Yanase, Takeru Ohta, and Masanori Koyama. 2019 · 2019

Earlier work this paper cites.

Language models are unsupervised multitask learners

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019 · 2019

Earlier work this paper cites.

Conceptual and empirical comparison of dimensionality reduction algorithms (pca, kpca, lda, mds, svd, lle, isomap, le, ica, t-sne)

Farzana Anowar, Samira Sadaoui, and Bassant Selim. 2021 · 2021

Earlier work this paper cites.

Detecting language model attacks with perplexity

Original

Gabriel Alon and Michael Kamfonas. 2023 · 2023

Earlier work this paper cites.

Qwen technical report

Original

Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, Binyuan Hui, Luo Ji, Mei Li, Junyang Lin, Runji Lin, Dayiheng Liu, Gao Liu, Chengqiang Lu, Keming Lu, Jianxin Ma, Rui Men, Xingzhang Ren, Xuancheng Ren, Chuanqi Tan, Sinan Tan, Jianhong Tu, Peng Wang, Shijie Wang, Wei Wang, Shengguang Wu, Benfeng Xu, Jin Xu, An Yang, Hao Yang, Jian Yang, Shusheng Yang, Yang Yao, Bowen Yu, Hongyi Yuan, Zheng Yuan, Jianwei Zhang, Xingxuan Zhang, Yichang Zhang, Zhenru Zhang, Chang Zhou, Jingren Zhou, Xiaohuan Zhou, and Tianhang Zhu. 2023 · 2023

Earlier work this paper cites.

Red-teaming large language models using chain of utterances for safety-alignment

Original

Rishabh Bhardwaj and Soujanya Poria. 2023 · 2023

Earlier work this paper cites.

Jailbreaking black box large language models in twenty queries

Original

Patrick Chao, Alexander Robey, Edgar Dobriban, Hamed Hassani, George J. Pappas, and Eric Wong. 2023 · 2023

Earlier work this paper cites.

Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality

Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. 2023 · 2023

Earlier work this paper cites.

Baseline defenses for adversarial attacks against aligned language models

Original

Neel Jain, Avi Schwarzschild, Yuxin Wen, Gowthami Somepalli, John Kirchenbauer, Ping-yeh Chiang, Micah Goldblum, Aniruddha Saha, Jonas Geiping, and Tom Goldstein. 2023 · 2023

Earlier work this paper cites.

Challenges and applications of large language models

Original

Jean Kaddour, Joshua Harris, Maximilian Mozes, Herbie Bradley, Roberta Raileanu, and Robert McHardy. 2023 · 2023

Earlier work this paper cites.

Deepinception: Hypnotize large language model to be jailbreaker

Original

Xuan Li, Zhanke Zhou, Jianing Zhu, Jiangchao Yao, Tongliang Liu, and Bo Han. 2023 · 2023

Earlier work this paper cites.

The unlocking spell on base llms: Rethinking alignment via in-context learning

Original

Bill Yuchen Lin, Abhilasha Ravichander, Ximing Lu, Nouha Dziri, Melanie Sclar, Khyathi Chandu, Chandra Bhagavatula, and Yejin Choi. 2023 · 2023

Cited alongside, same era.

Llm self defense: By self examination, llms know they are being tricked

Original

Mansi Phute, Alec Helbling, Matthew Hull, ShengYun Peng, Sebastian Szyller, Cory Cornelius, and Duen Horng Chau. 2023 · 2023

Cited alongside, same era.

Smoothllm: Defending large language models against jailbreaking attacks

Original

Alexander Robey, Eric Wong, Hamed Hassani, and George J Pappas. 2023 · 2023

Cited alongside, same era.

" do anything now": Characterizing and evaluating in-the-wild jailbreak prompts on large language models

Original

Xinyue Shen, Zeyuan Chen, Michael Backes, Yun Shen, and Yang Zhang. 2023 · 2023

Cited alongside, same era.

Alignment-enhanced decoding: Defending jailbreaks via token-level adaptive refining of probability distributions

Quan Liu, Zhenhong Zhou, Longzhu He, Yi Liu, Wei Zhang, and Sen Su. 2024a · 2024

Closest in time.

Gpt-4o mini: Advancing cost-efficient intelligence

OpenAI. 2024 · 2024

Closest in time.

Advprompter: Fast adaptive adversarial prompting for llms

Original

Anselm Paulus, Arman Zharmagambetov, Chuan Guo, Brandon Amos, and Yuandong Tian. 2024 · 2024

Closest in time.

Jailbreak antidote: Runtime safety-utility balance via sparse representation adjustment in large language models

Original

Guobin Shen, Dongcheng Zhao, Yiting Dong, Xiang He, and Yi Zeng. 2024 · 2024

Closest in time.

Multi-turn context jailbreak attack on large language models from first principles

Original

Xiongtao Sun, Deyue Zhang, Dongdong Yang, Quanchen Zou, and Hui Li. 2024 · 2024