Dynamic Guided and Domain Applicable Safeguards for Enhanced Security in Large Language Models

Detecting language model attacks with perplexity

Original

Gabriel Alon and Michael Kamfonas. 2023 · 2023

Earlier work this paper cites.

Safety-tuned llamas: Lessons from improving the safety of large language models that follow instructions

Original

Federico Bianchi, Mirac Suzgun, Giuseppe Attanasio, Paul Röttger, Dan Jurafsky, Tatsunori Hashimoto, and James Zou. 2023 · 2023

Earlier work this paper cites.

Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality

Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. 2023 · 2023

Earlier work this paper cites.

Baseline defenses for adversarial attacks against aligned language models

Original

Neel Jain, Avi Schwarzschild, Yuxin Wen, Gowthami Somepalli, John Kirchenbauer, Ping yeh Chiang, Micah Goldblum, Aniruddha Saha, Jonas Geiping, and Tom Goldstein. 2023 · 2023

Earlier work this paper cites.

Alpacaeval: An automatic evaluator of instruction-following models

Xuechen Li, Tianyi Zhang, Yann Dubois, Rohan Taori, Ishaan Gulrajani, Carlos Guestrin, Percy Liang, and Tatsunori B. Hashimoto. 2023 · 2023

Earlier work this paper cites.

The unlocking spell on base llms: Rethinking alignment via in-context learning

Bill Yuchen Lin, Abhilasha Ravichander, Ximing Lu, Nouha Dziri, Melanie Sclar, Khyathi Chandu, Chandra Bhagavatula, and Yejin Choi. 2023 · 2023

Earlier work this paper cites.

Is chatgpt a general-purpose natural language processing task solver?

Original

Chengwei Qin, Aston Zhang, Zhuosheng Zhang, Jiaao Chen, Michihiro Yasunaga, and Diyi Yang. 2023 · 2023

Earlier work this paper cites.

Smoothllm: Defending large language models against jailbreaking attacks

Original

Alexander Robey, Eric Wong, Hamed Hassani, and George J Pappas. 2023 · 2023

Earlier work this paper cites.

The art of defending: A systematic evaluation and analysis of llm defense strategies on safety and over-defensiveness

Original

Neeraj Varshney, Pavel Dolin, Agastya Seth, and Chitta Baral. 2023 · 2023

Earlier work this paper cites.

Defending chatgpt against jailbreak attack via self-reminders

Yueqi Xie, Jingwei Yi, Jiawei Shao, Justin Curl, Lingjuan Lyu, Qifeng Chen, Xing Xie, and Fangzhao Wu. 2023 · 2023

Earlier work this paper cites.

Kola: Carefully benchmarking world knowledge of large language models

Original

Jifan Yu, Xiaozhi Wang, Shangqing Tu, Shulin Cao, Daniel Zhang-Li, Xin Lv, Hao Peng, Zijun Yao, Xiaohan Zhang, Hanming Li, et al. 2023 · 2023

Earlier work this paper cites.

Judging llm-as-a-judge with mt-bench and chatbot arena

Original

Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, and Ion Stoica. 2023 · 2023

Earlier work this paper cites.

Can chatgpt understand too? a comparative study on chatgpt and fine-tuned bert

Original

Qihuang Zhong, Liang Ding, Juhua Liu, Bo Du, and Dacheng Tao. 2023 · 2023

Cited alongside, same era.

Universal and transferable adversarial attacks on aligned language models

Original

Andy Zou, Zifan Wang, Nicholas Carlini, Milad Nasr, J. Zico Kolter, and Matt Fredrikson. 2023 · 2023

Cited alongside, same era.

Llama 3 model card

AI@Meta. 2024 · 2024

Cited alongside, same era.

Jailbreaking leading safety-aligned llms with simple adaptive attacks

Original

Maksym Andriushchenko, Francesco Croce, and Nicolas Flammarion. 2024 · 2024

Cited alongside, same era.

Defending against alignment-breaking attacks via robustly aligned LLM

Bochuan Cao, Yuanpu Cao, Lu Lin, and Jinghui Chen. 2024 · 2024

Cited alongside, same era.

Hello GPT-4O

OpenAI. 2024 · 2024

Closest in time.

Llm self defense: By self examination, llms know they are being tricked

Original

Mansi Phute, Alec Helbling, Matthew Hull, ShengYun Peng, Sebastian Szyller, Cory Cornelius, and Duen Horng Chau. 2024 · 2024

Closest in time.

PubChem Laboratory Chemical Safety Summary (LCSS)

PubChem. 2024 · 2024

Closest in time.

Fine-tuning aligned language models compromises safety, even when users do not intend to!

Xiangyu Qi, Yi Zeng, Tinghao Xie, Pin-Yu Chen, Ruoxi Jia, Prateek Mittal, and Peter Henderson. 2024 · 2024

Closest in time.

"do anything now": Characterizing and evaluating in-the-wild jailbreak prompts on large language models

Original

Xinyue Shen, Zeyuan Chen, Michael Backes, Yun Shen, and Yang Zhang. 2024 · 2024

Closest in time.