RED QUEEN: Safeguarding Large Language Models against Concealed Multi-Turn Jailbreaking

Does the chimpanzee have a theory of mind?

David Premack and Guy Woodruff. 1978 · 1978

Earlier work this paper cites.

Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children’s understanding of deception

Heinz Wimmer and Josef Perner. 1983 · 1983

Earlier work this paper cites.

Development and neurophysiology of mentalizing

Uta Frith and Christopher D Frith. 2003 · 2003

Earlier work this paper cites.

Mindreaders: the cognitive basis of" theory of mind"

Ian Apperly. 2010 · 2010

Earlier work this paper cites.

A study of social intelligence & academic achievement of college students of district srinagar, j&k, india

MY Ganaie and Hafiz Mudasir. 2015 · 2015

Earlier work this paper cites.

Evaluating theory of mind in question answering

Original

Aida Nematzadeh, Kaylee Burns, Erin Grant, Alison Gopnik, and Thomas L Griffiths. 2018 · 2018

Earlier work this paper cites.

A general language assistant as a laboratory for alignment

Original

Amanda Askell, Yuntao Bai, Anna Chen, Dawn Drain, Deep Ganguli, Tom Henighan, Andy Jones, Nicholas Joseph, Ben Mann, Nova DasSarma, et al. 2021 · 2021

Earlier work this paper cites.

Training verifiers to solve math word problems

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, et al. 2021 · 2021

Earlier work this paper cites.

Iot-enabled social relationships meet artificial social intelligence

Sahraoui Dhelim, Huansheng Ning, Fadi Farha, Liming Chen, Luigi Atzori, and Mahmoud Daneshmand. 2021 · 2021

Earlier work this paper cites.

Measuring massive multitask language understanding

Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2021 · 2021

Earlier work this paper cites.

Training a helpful and harmless assistant with reinforcement learning from human feedback

Original

Yuntao Bai, Andy Jones, Kamal Ndousse, Amanda Askell, Anna Chen, Nova DasSarma, Dawn Drain, Stanislav Fort, Deep Ganguli, Tom Henighan, et al. 2022 · 2022

Earlier work this paper cites.

Red teaming language models to reduce harms: Methods, scaling behaviors, and lessons learned

Original

Deep Ganguli, Liane Lovitt, Jackson Kernion, Amanda Askell, Yuntao Bai, Saurav Kadavath, Ben Mann, Ethan Perez, Nicholas Schiefer, Kamal Ndousse, et al. 2022 · 2022

Earlier work this paper cites.

Theory of mind and preference learning at the interface of cognitive science, neuroscience, and ai: A review

Christelle Langley, Bogdan Ionut Cirstea, Fabio Cuzzolin, and Barbara J Sahakian. 2022 · 2022

Earlier work this paper cites.

Sentence-t5: Scalable sentence encoders from pre-trained text-to-text models

Jianmo Ni, Gustavo Hernandez Abrego, Noah Constant, Ji Ma, Keith Hall, Daniel Cer, and Yinfei Yang. 2022 · 2022

Earlier work this paper cites.

Red teaming language models with language models

Ethan Perez, Saffron Huang, Francis Song, Trevor Cai, Roman Ring, John Aslanides, Amelia Glaese, Nat McAleese, and Geoffrey Irving. 2022 · 2022

Earlier work this paper cites.

A study of zero-shot adaptation with commonsense knowledge

Jiarui Zhang, Filip Ilievski, Kaixin Ma, Jonathan Francis, and Alessandro Oltramari. 2022 · 2022

Earlier work this paper cites.

Gpt-4 technical report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023 · 2023

Earlier work this paper cites.

Gqa: Training generalized multi-query transformer models from multi-head checkpoints

Joshua Ainslie, James Lee-Thorp, Michiel de Jong, Yury Zemlyanskiy, Federico Lebron, and Sumit Sanghai. 2023 · 2023

Earlier work this paper cites.

Jailbreak chat

Albert Alex. 2023 · 2023

Earlier work this paper cites.

Red-teaming large language models using chain of utterances for safety-alignment

Original

Rishabh Bhardwaj and Soujanya Poria. 2023 · 2023

Earlier work this paper cites.

Jailbreaking black box large language models in twenty queries

Patrick Chao, Alexander Robey, Edgar Dobriban, Hamed Hassani, George J Pappas, and Eric Wong. 2023 · 2023

Earlier work this paper cites.

Hallucination detection: Robustly discerning reliable answers in large language models

Yuyan Chen, Qiang Fu, Yichen Yuan, Zhihao Wen, Ge Fan, Dayiheng Liu, Dongmei Zhang, Zhixu Li, and Yanghua Xiao. 2023 · 2023

Cited alongside, same era.

Llama guard: Llm-based input-output safeguard for human-ai conversations

Original

Hakan Inan, Kartikeya Upasani, Jianfeng Chi, Rashi Rungta, Krithika Iyer, Yuning Mao, Michael Tontchev, Qing Hu, Brian Fuller, Davide Testuggine, et al. 2023 · 2023

Cited alongside, same era.

Survey of hallucination in natural language generation

Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Ye Jin Bang, Andrea Madotto, and Pascale Fung. 2023 · 2023

Cited alongside, same era.

Transferring procedural knowledge across commonsense tasks

Yifan Jiang, Filip Ilievski, and Kaixin Ma. 2023a · 2023

Cited alongside, same era.

Brainteaser: Lateral thinking puzzles for large language models

Yifan Jiang, Filip Ilievski, Kaixin Ma, and Zhivar Sourati. 2023b · 2023

Cited alongside, same era.

Beavertails: Towards improved safety alignment of llm via a human-preference dataset

Jiaming Ji, Mickel Liu, Josef Dai, Xuehai Pan, Chi Zhang, Ce Bian, Boyuan Chen, Ruiyang Sun, Yizhou Wang, and Yaodong Yang. 2024 · 2024

Closest in time.

Artprompt: Ascii art-based jailbreak attacks against aligned llms

Fengqing Jiang, Zhangchen Xu, Luyao Niu, Zhen Xiang, Bhaskar Ramasubramanian, Bo Li, and Radha Poovendran. 2024b · 2024

Closest in time.

Images are achilles’ heel of alignment: Exploiting visual vulnerabilities for jailbreaking multimodal large language models

Original

Yifan Li, Hangyu Guo, Kun Zhou, Wayne Xin Zhao, and Ji-Rong Wen. 2024 · 2024

Closest in time.

Against the achilles’ heel: A survey on red teaming for generative models

Original

Lizhi Lin, Honglin Mu, Zenan Zhai, Minghan Wang, Yuxia Wang, Renxi Wang, Junjie Gao, Yixuan Zhang, Wanxiang Che, Timothy Baldwin, et al. 2024 · 2024

Closest in time.

Gpt-4o system card

OpenAI. 2024 · 2024