Jailbreaking Large Language Models Through Alignment Vulnerabilities in Out-of-Distribution Settings

Language Models are Unsupervised Multitask Learners

Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019

Earlier work this paper cites.

Detecting Language Model Attacks with Perplexity

Original

Gabriel Alon and Michael Kamfonas. 2023 · 2023

Earlier work this paper cites.

A Group Fairness Lens for Large Language Models

Original

Guanqun Bi, Lei Shen, Yuqiang Xie, Yanan Cao, Tiangang Zhu, and Xiaodong He. 2023 · 2023

Earlier work this paper cites.

Jailbreaking Black Box Large Language Models in Twenty Queries

Original

Patrick Chao, Alexander Robey, Edgar Dobriban, Hamed Hassani, George J. Pappas, and Eric Wong. 2023 · 2023

Earlier work this paper cites.

Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality

Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. 2023 · 2023

Earlier work this paper cites.

Deep reinforcement learning from human preferences

Original

Paul Christiano, Jan Leike, Tom B. Brown, Miljan Martic, Shane Legg, and Dario Amodei. 2023 · 2023

Earlier work this paper cites.

What can Large Language Models do in chemistry? A comprehensive benchmark on eight tasks. In Advances in Neural Information Processing Systems , A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine (Eds.), Vol. 36. Curran Associates, Inc., 59662–59688

Taicheng Guo, kehan Guo, Bozhao Nan, Zhenwen Liang, Zhichun Guo, Nitesh Chawla, Olaf Wiest, and Xiangliang Zhang. 2023 · 2023

Earlier work this paper cites.

Metatool benchmark for large language models: Deciding whether to use tools and which to use

Original

Yue Huang, Jiawen Shi, Yuan Li, Chenrui Fan, Siyuan Wu, Qihui Zhang, Yixin Liu, Pan Zhou, Yao Wan, Neil Zhenqiang Gong, et al · 2023

Earlier work this paper cites.

Harnessing the power of chatgpt in fake news: An in-depth exploration in generation, detection and explanation

Original

Yue Huang and Lichao Sun. 2023 · 2023

Earlier work this paper cites.

Trustgpt: A benchmark for trustworthy and responsible large language models

Original

Yue Huang, Qihui Zhang, Lichao Sun, et al · 2023

Earlier work this paper cites.

Baseline Defenses for Adversarial Attacks Against Aligned Language Models

Original

Neel Jain, Avi Schwarzschild, Yuxin Wen, Gowthami Somepalli, John Kirchenbauer, Ping yeh Chiang, Micah Goldblum, Aniruddha Saha, Jonas Geiping, and Tom Goldstein. 2023 · 2023

Earlier work this paper cites.

10 Security and Privacy Problems in Large Foundation Models

Jinyuan Jia, Hongbin Liu, and Neil Zhenqiang Gong. 2023 · 2023

Earlier work this paper cites.

UniMath: A Foundational and Multimodal Mathematical Reasoner. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing , Houda Bouamor, Juan Pino, and Kalika Bali (Eds.). Association for Computational Linguistics, Singapore, 7126–7133

Zhenwen Liang, Tianyu Yang, Jipeng Zhang, and Xiangliang Zhang. 2023 · 2023

Earlier work this paper cites.

Alignbench: Benchmarking chinese alignment of large language models

Original

Xiao Liu, Xuanyu Lei, Shengyuan Wang, Yue Huang, Zhuoer Feng, Bosi Wen, Jiale Cheng, Pei Ke, Yifan Xu, Weng Lam Tam, et al · 2023

Earlier work this paper cites.

LLM Self Defense: By Self Examination, LLMs Know They Are Being Tricked

Original

Mansi Phute, Alec Helbling, Matthew Hull, ShengYun Peng, Sebastian Szyller, Cory Cornelius, and Duen Horng Chau. 2023 · 2023

Earlier work this paper cites.

A survey of hallucination in large foundation models

Original

Vipula Rawte, Amit Sheth, and Amitava Das. 2023 · 2023

Earlier work this paper cites.

SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks

Original

Alexander Robey, Eric Wong, Hamed Hassani, and George J. Pappas. 2023 · 2023

Earlier work this paper cites.

Badgpt: Exploring security vulnerabilities of chatgpt via backdoor attacks to instructgpt

Original

Jiawen Shi, Yixin Liu, Pan Zhou, and Lichao Sun. 2023b · 2023

Earlier work this paper cites.

Detecting pretraining data from large language models

Original

Weijia Shi, Anirudh Ajith, Mengzhou Xia, Yangsibo Huang, Daogao Liu, Terra Blevins, Danqi Chen, and Luke Zettlemoyer. 2023a · 2023

Cited alongside, same era.

Llama 2: Open Foundation and Fine-Tuned Chat Models

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Jian Xiang Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurelien Rodriguez, Robert Stojnic, Sergey Edunov, and Thomas Scialom. 2023 · 2023

Cited alongside, same era.

Poisoning Language Models During Instruction Tuning

Original

Alexander Wan, Eric Wallace, Sheng Shen, and Dan Klein. 2023 · 2023

Cited alongside, same era.

I Think, Therefore I am: Awareness in Large Language Models

Original

Yuan Li, Yue Huang, Yuli Lin, Siyuan Wu, Yao Wan, and Lichao Sun. 2024a · 2024

Closest in time.

Quantifying AI Psychology: A Psychometrics Benchmark for Large Language Models

Original

Yuan Li, Yue Huang, Hongyi Wang, Xiangliang Zhang, James Zou, and Lichao Sun. 2024b · 2024

Closest in time.

Build the future of AI with Meta Llama 3

Meta. 2024 · 2024

Closest in time.

Optimization-based Prompt Injection Attack to LLM-as-a-Judge

Original

Jiawen Shi, Zenghui Yuan, Yinuo Liu, Yue Huang, Pan Zhou, Lichao Sun, and Neil Zhenqiang Gong. 2024 · 2024

Closest in time.

Trustllm: Trustworthiness in large language models

Original

Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, et al · 2024