Characterizing and Evaluating the Reliability of LLMs against Jailbreak Attacks

Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding (2019)

2019

Earlier work this paper cites.

Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., Sutskever, I.: Language models are unsupervised multitask learners (2019), https://api.semanticscholar.org/CorpusID:160025533

2019

Earlier work this paper cites.

Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A.: Language models are few-shot learners (2020)

2020

Earlier work this paper cites.

Paluri, S.: Human computer interaction (12 2020)

2020

Earlier work this paper cites.

Askell, A., Bai, Y., Chen, A., Drain, D., Ganguli, D., Henighan, T., Jones, A., Joseph, N., Mann, B., DasSarma, N., Elhage, N., Hatfield-Dodds, Z., Hernandez, D., Kernion, J., Ndousse, K., Olsson, C., Amodei, D., Brown, T., Clark, J., McCandlish, S., Olah, C., Kaplan, J.: A general language assistant as a laboratory for alignment (2021)

2021

Earlier work this paper cites.

Dasigi, P., Lo, K., Beltagy, I., Cohan, A., Smith, N.A., Gardner, M.: A dataset of information-seeking questions and answers anchored in research papers (2021)

2021

Earlier work this paper cites.

Apruzzese, G., Anderson, H.S., Dambra, S., Freeman, D., Pierazzi, F., Roundy, K.A.: "real attackers don’t compute gradients": Bridging the gap between adversarial ml research and practice (2022)

2022

Earlier work this paper cites.

Lees, A., Tran, V.Q., Tay, Y., Sorensen, J., Gupta, J., Metzler, D., Vasserman, L.: A new generation of perspective api: Efficient multilingual character-level transformers (2022)

2022

Earlier work this paper cites.

Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al.: Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems 35

2022

Earlier work this paper cites.

Wei, J., Wang, X., Schuurmans, D., Bosma, M., Xia, F., Chi, E., Le, Q.V., Zhou, D., et al.: Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems 35

2022

Earlier work this paper cites.

Openai says a bug leaked sensitive chatgpt user data. https://www.engadget.com/chatgpt-briefly-went-offline-after-a-bug-revealed-user-chat-histories-115632504.html , engadget. Accessed:2023-8-20

2023

Earlier work this paper cites.

Chatgpt: Us lawyer admits using ai for case research (2023), https://www.bbc.co.uk/news/world-us-canada-65735769 , accessed: 2023-08-23

2023

Earlier work this paper cites.

’he would still be here’: Man dies by suicide after talking with ai chatbot, widow says (2023), https://www.vice.com/en/article/pkadgm/man-dies-by-suicide-after-talking-with-ai-chatbot-widow-says , accessed: 2023-08-23

2023

Earlier work this paper cites.

Bano, M., Zowghi, D., Shea, P., Ibarra, G.: Investigating responsible ai for scientific research: An empirical study (2023)

2023

Earlier work this paper cites.

Bhardwaj, R., Poria, S.: Red-teaming large language models using chain of utterances for safety-alignment (2023)

2023

Earlier work this paper cites.

Bhatt, M., Chennabasappa, S., Nikolaidis, C., Wan, S., Evtimov, I., Gabi, D., Song, D., Ahmad, F., Aschermann, C., Fontana, L., Frolov, S., Giri, R.P., Kapil, D., Kozyrakis, Y., LeBlanc, D., Milazzo, J., Straumann, A., Synnaeve, G., Vontimitta, V., Whitman, S., Saxe, J.: Purple llama cyberseceval: A secure coding benchmark for language models (2023)

2023

Earlier work this paper cites.

Chao, P., Robey, A., Dobriban, E., Hassani, H., Pappas, G., Wong, E.: Jailbreaking black box large language models in twenty queries (Oct 2023)

2023

Earlier work this paper cites.

Cinà, A.E., Grosse, K., Demontis, A., Vascon, S., Zellinger, W., Moser, B.A., Oprea, A., Biggio, B., Pelillo, M., Roli, F.: Wild patterns reloaded: A survey of machine learning security against training data poisoning. ACM Computing Surveys 55

2023

Earlier work this paper cites.

Deng, G., Liu, Y., Li, Y., Wang, K., Zhang, Y., Li, Z., Wang, H., Zhang, T., Liu, Y.: Jailbreaker: Automated jailbreak across multiple large language model chatbots. arXiv preprint arXiv:2307.08715 (2023)

Original

2023

Earlier work this paper cites.

Deng, Y., Zhang, W., Pan, S.J., Bing, L.: Multilingual jailbreak challenges in large language models. arXiv preprint arXiv:2310.06474 (2023)

Original

2023

Earlier work this paper cites.

Ding, P., Kuang, J., Ma, D., Cao, X., Xian, Y., Chen, J., Huang, S.: A wolf in sheep’s clothing: Generalized nested jailbreak prompts can fool large language models easily (Nov 2023)

2023

Earlier work this paper cites.

Dong, Q., Li, L., Dai, D., Zheng, C., Wu, Z., Chang, B., Sun, X., Xu, J., Li, L., Sui, Z.: A survey on in-context learning (2023)

2023

Earlier work this paper cites.

Frieder, S., Pinchetti, L., Chevalier, A., Griffiths, R.R., Salvatori, T., Lukasiewicz, T., Petersen, P.C., Berner, J.: Mathematical capabilities of chatgpt (2023)

2023

Earlier work this paper cites.

Gopal, A., Helm-Burger, N., Justen, L., Soice, E.H., Tzeng, T., Jeyapragasan, G., Grimm, S., Mueller, B., Esvelt, K.M.: Will releasing the weights of future large language models grant widespread access to pandemic agents? (2023)

2023

Earlier work this paper cites.

Greshake, K., Abdelnabi, S., Mishra, S., Endres, C., Holz, T., Fritz, M.: Not what you’ve signed up for: Compromising real-world llm-integrated applications with indirect prompt injection (2023)

2023

Earlier work this paper cites.

Huang, X., Ruan, W., Huang, W., Jin, G., Dong, Y., Wu, C., Bensalem, S., Mu, R., Qi, Y., Zhao, X., Cai, K., Zhang, Y., Wu, S., Xu, P., Wu, D., Freitas, A., Mustafa, M.A.: A survey of safety and trustworthiness of large language models through the lens of verification and validation (2023)

2023

Earlier work this paper cites.

Inan, H., Upasani, K., Chi, J., Rungta, R., Iyer, K., Mao, Y., Tontchev, M., Hu, Q., Fuller, B., Testuggine, D., Khabsa, M.: Llama guard: Llm-based input-output safeguard for human-ai conversations (2023)

2023

Earlier work this paper cites.

Jiang, A.Q., Sablayrolles, A., Mensch, A., Bamford, C., Chaplot, D.S., Casas, D.d.l., Bressand, F., Lengyel, G., Lample, G., Saulnier, L., et al.: Mistral 7b. arXiv preprint arXiv:2310.06825 (2023)

Original

2023

Earlier work this paper cites.

Kang, D., Li, X., Stoica, I., Guestrin, C., Zaharia, M., Hashimoto, T.: Exploiting programmatic behavior of llms: Dual-use through standard security attacks. arXiv preprint arXiv:2302.05733 (2023)

Original

2023

Cited alongside, same era.

Lee, P.: Learning from tay’s introduction. https://blogs.microsoft.com/blog/2016/03/25/learning-tays-introduction/ , accessed: 2023-08-20

2023

Cited alongside, same era.

Li, H., Guo, D., Fan, W., Xu, M., Huang, J., Meng, F., Song, Y.: Multi-step jailbreaking privacy attacks on chatgpt (2023)

2023

Cited alongside, same era.

Li, J., Cheng, X., Zhao, W.X., Nie, J., rong Wen, J.: Halueval: A large-scale hallucination evaluation benchmark for large language models. ArXiv abs/2305.11747

Original

2023

Cited alongside, same era.

Li, X., Zhou, Z., Zhu, J., Yao, J., Liu, T., Han, B.: Deepinception: Hypnotize large language model to be jailbreaker. arXiv preprint arXiv:2311.03191 (2023)

Zheng, L., Chiang, W.L., Sheng, Y., Zhuang, S., Wu, Z., Zhuang, Y., Lin, Z., Li, Z., Li, D., Xing, E., et al.: Judging llm-as-a-judge with mt-bench and chatbot arena. arXiv preprint arXiv:2306.05685 (2023)

Original

2023

Later among the works it cites.

Zou, A., Wang, Z., Kolter, J.Z., Fredrikson, M.: Universal and transferable adversarial attacks on aligned language models. arXiv preprint arXiv:2307.15043 (2023)

Original

2023

Later among the works it cites.

Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F.L., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, S., et al.: Gpt-4 technical report (2024)

2024

Closest in time.

Anthropic: Introducing the next generation of claude. https://www.anthropic.com/news/claude-3-family (2023), accessed: 2024-06-05

2024

Closest in time.