Dialogue Injection Attack: Jailbreaking LLMs through Context Manipulation

S. Ge, C. Zhou, R. Hou, M. Khabsa, Y.-C. Wang, Q. Wang, J. Han, and Y. Mao, “Mart: Improving llm safety with multi-round automatic red-teaming,” arXiv preprint arXiv:2311.07689 , 2023

Original

2023

Cited alongside, same era.

M. Phute, A. Helbling, M. Hull, S. Peng, S. Szyller, C. Cornelius, and D. H. Chau, “Llm self defense: By self examination, llms know they are being tricked,” arXiv preprint arXiv:2308.07308 , 2023

Original

2023

Cited alongside, same era.

Y. Li, F. Wei, J. Zhao, C. Zhang, and H. Zhang, “Rain: Your language models can align themselves without finetuning,” arXiv preprint arXiv:2309.07124 , 2023

Original

2023

Cited alongside, same era.

R. Koshkin, K. Sudoh, and S. Nakamura, “Transllama: Llm-based simultaneous translation system,” arXiv preprint arXiv:2402.04636 , 2024

Original

2024

Cited alongside, same era.

X. Lin, W. Wang, Y. Li, S. Yang, F. Feng, Y. Wei, and T.-S. Chua, “Data-efficient fine-tuning for llm-based recommendation,” in Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval , 2024, pp. 365–374

2024

Cited alongside, same era.

S. Dai, C. Xu, S. Xu, L. Pang, Z. Dong, and J. Xu, “Bias and unfairness in information retrieval systems: New challenges in the llm era,” in Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining , 2024, pp. 6437–6447

2024

Cited alongside, same era.

W. Xu, G. Zhu, X. Zhao, L. Pan, L. Li, and W. Wang, “Pride and prejudice: Llm amplifies self-bias in self-refinement,” in Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2024, pp. 15 474–15 492

2024

Cited alongside, same era.

Z. Yu, X. Liu, S. Liang, Z. Cameron, C. Xiao, and N. Zhang, “Don’t listen to me: Understanding and exploring jailbreak prompts of large language models,” arXiv preprint arXiv:2403.17336 , 2024

Original

2024

Cited alongside, same era.

P. Chao, E. Debenedetti, A. Robey, M. Andriushchenko, F. Croce, V. Sehwag, E. Dobriban, N. Flammarion, G. J. Pappas, F. Tramer et al. , “Jailbreakbench: An open robustness benchmark for jailbreaking large language models,” arXiv preprint arXiv:2404.01318 , 2024

Original

2024

Later among the works it cites.

“Hugging face datasets,” https://huggingface.co/datasets , 2024, accessed: 2024-11-09

2024

Later among the works it cites.

C. Xiong, X. Qi, P.-Y. Chen, and T.-Y. Ho, “Defensive prompt patch: A robust and interpretable defense of llms against jailbreak attacks,” arXiv preprint arXiv:2405.20099 , 2024

Original

2024

Later among the works it cites.

G. Deng, Y. Liu, Y. Li, K. Wang, Y. Zhang, Z. Li, H. Wang, T. Zhang, and Y. Liu, “Masterkey: Automated jailbreaking of large language model chatbots,” in Proc. ISOC NDSS , 2024

2024

Later among the works it cites.

Z. Chang, M. Li, Y. Liu, J. Wang, Q. Wang, and Y. Liu, “Play guessing game with llm: Indirect jailbreak attack with implicit clues,” arXiv preprint arXiv:2402.09091 , 2024

Original

2024

Later among the works it cites.

Y. Zeng, Y. Wu, X. Zhang, H. Wang, and Q. Wu, “Autodefense: Multi-agent llm defense against jailbreak attacks,” arXiv preprint arXiv:2403.04783 , 2024

Original

2024

Later among the works it cites.

L. Team, “Meta llama guard 2,” https://github.com/meta-llama/PurpleLlama/blob/main/Llama-Guard2/MODEL_CARD.md , 2024

2024

Later among the works it cites.

A. . M. Llama Team, “The llama 3 herd of models,” 2024. [Online]. Available: https://arxiv.org/abs/2407.21783

Original

2024

Later among the works it cites.

Y. Fu, Y. Li, W. Xiao, C. Liu, and Y. Dong, “Safety alignment in NLP tasks: Weakly aligned summarization as an in-context attack,” in Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , L.-W. Ku, A. Martins, and V. Srikumar, Eds. Bangkok, Thailand: Association for Computational Linguistics, Aug. 2024, pp. 8483–8502. [Online]. Available: https://aclanthology.org/2024.acl-long.461

2024

Later among the works it cites.

J. Ji, M. Liu, J. Dai, X. Pan, C. Zhang, C. Bian, B. Chen, R. Sun, Y. Wang, and Y. Yang, “Beavertails: Towards improved safety alignment of llm via a human-preference dataset,” Advances in Neural Information Processing Systems , vol. 36, 2024

2024

Later among the works it cites.

A. Dubey, A. Jauhri, A. Pandey, A. Kadian, A. Al-Dahle, A. Letman, A. Mathur, A. Schelten, A. Yang, A. Fan et al. , “The llama 3 herd of models,” arXiv preprint arXiv:2407.21783 , 2024

Original

2024

Later among the works it cites.

AI@Meta, “Llama 3 model card,” 2024. [Online]. Available: https://github.com/meta-llama/llama3/blob/main/MODEL_CARD.md

2024

Later among the works it cites.

“Openai moderation api,” https://platform.openai.com/docs/guides/moderation , 2024, accessed: 2024-11-10

2024

Later among the works it cites.

C. Zheng, F. Yin, H. Zhou, F. Meng, J. Zhou, K.-W. Chang, M. Huang, and N. Peng, “On prompt-driven safeguarding for large language models,” in Forty-first International Conference on Machine Learning , 2024

2024

Later among the works it cites.

W. Zeng, Y. Liu, R. Mullins, L. Peran, J. Fernandez, H. Harkous, K. Narasimhan, D. Proud, P. Kumar, B. Radharapu et al. , “Shieldgemma: Generative ai content moderation based on gemma,” arXiv preprint arXiv:2407.21772 , 2024

Original

2024

Later among the works it cites.

Z. Xu, Y. Liu, G. Deng, Y. Li, and S. Picek, “A comprehensive study of jailbreak attack versus defense for large language models,” in Findings of the Association for Computational Linguistics ACL 2024 , 2024, pp. 7432–7449

2024

Later among the works it cites.

M. Ren, B. Cao, H. Lin, C. Liu, X. Han, K. Zeng, G. Wan, X. Cai, and L. Sun, “Learning or self-aligning? rethinking instruction fine-tuning,” arXiv preprint arXiv:2402.18243 , 2024

Original

2024

Later among the works it cites.

H. Zhao, M. Andriushchenko, F. Croce, and N. Flammarion, “Long is more for alignment: A simple but tough-to-beat baseline for instruction fine-tuning,” arXiv preprint arXiv:2402.04833 , 2024

Original

2024

Later among the works it cites.

K. Ethayarajh, W. Xu, N. Muennighoff, D. Jurafsky, and D. Kiela, “Kto: Model alignment as prospect theoretic optimization,” arXiv preprint arXiv:2402.01306 , 2024

Original

2024

Later among the works it cites.

J. Yu, X. Lin, Z. Yu, and X. Xing, “ { \{ LLM-Fuzzer } \} : Scaling assessment of large language model jailbreaks,” in 33rd USENIX Security Symposium (USENIX Security 24) , 2024, pp. 4657–4674

2024

Later among the works it cites.