Jailbreaking ChatGPT via Prompt Engineering: An Empirical Study

K. Stol, P. Ralph, and B. Fitzgerald, “Grounded theory in software engineering research: a critical review and guidelines,” in Proceedings of the 38th International Conference on Software Engineering, ICSE 2016, Austin, TX, USA, May 14-22, 2016 , L. K. Dillon, W. Visser, and L. A. Williams, Eds. ACM, 2016, pp. 120–131. [Online]. Available: https://doi.org/10.1145/2884781.2884833

2016

Earlier work this paper cites.

L. Reynolds and K. McDonell, “Prompt programming for large language models: Beyond the few-shot paradigm,” 2021

2021

Earlier work this paper cites.

B. Zhang, B. Haddow, and A. Birch, “Prompting large language model for machine translation: A case study,” CoRR , vol. abs/2301.07069, 2023. [Online]. Available: https://doi.org/10.48550/arXiv.2301.07069

Original

2023

Earlier work this paper cites.

C. Zhang, C. Zhang, S. Zheng, Y. Qiao, C. Li, M. Zhang, S. K. Dam, C. M. Thwal, Y. L. Tun, L. L. Huy, D. U. Kim, S. Bae, L. Lee, Y. Yang, H. T. Shen, I. S. Kweon, and C. S. Hong, “A complete survey on generative AI (AIGC): is chatgpt from GPT-4 to GPT-5 all you need?” CoRR , vol. abs/2303.11717, 2023. [Online]. Available: https://doi.org/10.48550/arXiv.2303.11717

Original

2023

Earlier work this paper cites.

J. Ni, T. Young, V. Pandelea, F. Xue, and E. Cambria, “Recent advances in deep learning based dialogue systems: a systematic survey,” Artif. Intell. Rev. , vol. 56, no. 4, pp. 3055–3155, 2023. [Online]. Available: https://doi.org/10.1007/s10462-022-10248-8

2023

Earlier work this paper cites.

“New chat,” https://chat.openai.com/ , (Accessed on 02/02/2023)

2023

Earlier work this paper cites.

“Models - openai api,” https://platform.openai.com/docs/models/ , (Accessed on 02/02/2023)

2023

Earlier work this paper cites.

“Openai,” https://openai.com/ , (Accessed on 02/02/2023)

2023

Earlier work this paper cites.

H. Li, D. Guo, W. Fan, M. Xu, and Y. Song, “Multi-step jailbreaking privacy attacks on chatgpt,” 2023

2023

Earlier work this paper cites.

J. White, Q. Fu, S. Hays, M. Sandborn, C. Olea, H. Gilbert, A. Elnashar, J. Spencer-Smith, and D. C. Schmidt, “A prompt pattern catalog to enhance prompt engineering with chatgpt,” 2023

2023

Cited alongside, same era.

“Meet dan — the ‘jailbreak’ version of chatgpt and how to use it — ai unchained and unfiltered | by michael king | medium,” https://medium.com/@neonforge/meet-dan-the-jailbreak-version-of-chatgpt-and-how-to-use-it-ai-unchained-and-unfiltered-f91bfa679024 , (Accessed on 02/02/2023)

2023

Cited alongside, same era.

“Moderation - openai api,” https://platform.openai.com/docs/guides/moderation , (Accessed on 02/02/2023)

2023

Cited alongside, same era.

“Llm jailbreak study,” https://sites.google.com/view/llm-jailbreak-study , (Accessed on 05/06/2023)

2023

Cited alongside, same era.

“Alex albert,” https://alexalbert.me/ , (Accessed on 05/06/2023)

“TITLE 47—TELECOMMUNICATIONS,” https://www.govinfo.gov/content/pkg/USCODE-2021-title47/pdf/USCODE-2021-title47-chap5-subchapII-partI-sec224.pdf , accessed: 2023-5-5

2023

Closest in time.

“18 U.S.C. 2516 - Authorization for interception of wire, oral, or electronic communications.” https://www.govinfo.gov/app/details/USCODE-2021-title18/USCODE-2021-title18-partI-chap119-sec2516 , accessed: 2023-5-6

2023

Closest in time.

“18 U.S.C. 2251 - Sexual exploitation of children.” https://www.govinfo.gov/app/details/USCODE-2021-title18/USCODE-2021-title18-partI-chap119-sec2516 , accessed: 2023-5-6

2023

Closest in time.

“52 U.S.C. 30116 - Limitations on contributions and expenditures,” https://www.govinfo.gov/app/details/USCODE-2014-title52/USCODE-2014-title52-subtitleIII-chap301-subchapI-sec30116 , accessed: 2023-5-6

2023

Closest in time.