STAR: SocioTechnical Approach to Red Teaming Language Models

Scikit-learn: Machine learning in python

Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, Jake Vanderplas, Alexandre Passos, David Cournapeau, Matthieu Brucher, Matthieu Perrot, and Édouard Duchesnay. 2011 · 2011

Earlier work this paper cites.

Notional supply chain risk management practices for federal information systems

Jon Boyens, Celia Paulsen, Nadya Bartol, Rama Moorthy, and Stephanie Shankles. 2012 · 2012

Earlier work this paper cites.

Truth is a lie: Crowd truth and the seven myths of human annotation

Lora Aroyo and Chris Welty. 2015 · 2015

Earlier work this paper cites.

Beat the machine: Challenging humans to find a predictive model’s “unknown unknowns”

Joshua Attenberg, Panos Ipeirotis, and Foster Provost. 2015 · 2015

Earlier work this paper cites.

Fairness and Abstraction in Sociotechnical Systems

Andrew D. Selbst, Danah Boyd, Sorelle A. Friedler, Suresh Venkatasubramanian, and Janet Vertesi. 2019 · 2019

Earlier work this paper cites.

UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction

Original

Leland McInnes, John Healy, and James Melville. 2020 · 2020

Earlier work this paper cites.

The Disagreement Deconvolution: Bringing Machine Learning Performance Metrics In Line With Reality

Mitchell L. Gordon, Kaitlyn Zhou, Kayur Patel, Tatsunori Hashimoto, and Michael S. Bernstein. 2021 · 2021

Earlier work this paper cites.

Understanding international perceptions of the severity of harmful content online

Jialun Aaron Jiang, Morgan Klaus Scheuerman, Casey Fiesler, and Jed R. Brubaker. 2021 · 2021

Earlier work this paper cites.

Bot-Adversarial Dialogue for safe conversational agents

Jing Xu, Da Ju, Margaret Li, Y-Lan Boureau, Jason Weston, and Emily Dinan. 2021 · 2021

Earlier work this paper cites.

Toward user-driven algorithm auditing: Investigating users’ strategies for uncovering harmful algorithmic behavior

Alicia DeVos, Aditi Dhabalia, Hong Shen, Kenneth Holstein, and Motahhare Eslami. 2022 · 2022

Earlier work this paper cites.

Red teaming language models to reduce harms: Methods, scaling behaviors, and lessons learned

Original

Deep Ganguli, Liane Lovitt, Jackson Kernion, Amanda Askell, Yuntao Bai, Saurav Kadavath, Ben Mann, Ethan Perez, Nicholas Schiefer, Kamal Ndousse, Andy Jones, Sam Bowman, Anna Chen, Tom Conerly, Nova DasSarma, Dawn Drain, Nelson Elhage, Sheer El-Showk, Stanislav Fort, Zac Hatfield-Dodds, Tom Henighan, Danny Hernandez, Tristan Hume, Josh Jacobson, Scott Johnston, Shauna Kravec, Catherine Olsson, Sam Ringer, Eli Tran-Johnson, Dario Amodei, Tom Brown, Nicholas Joseph, Sam McCandlish, Chris Olah, Jared Kaplan, and Jack Clark. 2022 · 2022

Earlier work this paper cites.

Is your toxicity my toxicity? Exploring the impact of rater identity on toxicity annotation

Nitesh Goyal, Ian D. Kivlichan, Rachel Rosen, and Lucy Vasserman. 2022 · 2022

Earlier work this paper cites.

Red Teaming Language Models with Language Models

Original

Ethan Perez, Saffron Huang, Francis Song, Trevor Cai, Roman Ring, John Aslanides, Amelia Glaese, Nat McAleese, and Geoffrey Irving. 2022 · 2022

Cited alongside, same era.

The “problem” of human label variation: On ground truth in data, modeling and evaluation

Barbara Plank. 2022 · 2022

Cited alongside, same era.

LaMDA: Language Models for Dialog Applications

Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, YaGuang Li, Hongrae Lee, Huaixiu Steven Zheng, Amin Ghafouri, Marcelo Menegali, Yanping Huang, Maxim Krikun, Dmitry Lepikhin, James Qin, Dehao Chen, Yuanzhong Xu, Zhifeng Chen, Adam Roberts, Maarten Bosma, Vincent Zhao, Yanqi Zhou, Chung-Ching Chang, Igor Krivokon, Will Rusch, Marc Pickett, Pranesh Srinivasan, Laichee Man, Kathleen Meier-Hellstern, Meredith Ringel Morris, Tulsee Doshi, Renelito Delos Santos, Toju Duke, Johnny Soraker, Ben Zevenbergen, Vinodkumar Prabhakaran, Mark Diaz, Ben Hutchinson, Kristen Olson, Alejandra Molina, Erin Hoffman-John, Josh Lee, Lora Aroyo, Ravi Rajakumar, Alena Butryna, Matthew Lamm, Viktoriya Kuzmina, Joe Fenton, Aaron Cohen, Rachel Bernstein, Ray Kurzweil, Blaise Aguera-Arcas, Claire Cui, Marian Croak, Ed Chi, and Quoc Le. 2022 · 2022

Cited alongside, same era.

Challenges in evaluating AI systems

Anthropic. 2023 · 2023

Cited alongside, same era.

Generative ai prohibited use policy

Google Privacy & Terms. 2023 · 2023

Later among the works it cites.

Fact sheet: Biden-Harris administration announces new actions to promote responsible AI innovation that protects Americans’ rights and safety

White House. 2023 · 2023

Later among the works it cites.

Red teaming ChatGPT via jailbreaking: Bias, robustness, reliability and toxicity

Original

Terry Yue Zhuo, Yujin Huang, Chunyang Chen, and Zhenchang Xing. 2023 · 2023

Later among the works it cites.

Universal and transferable adversarial attacks on aligned language models

Original

Andy Zou, Zifan Wang, Nicholas Carlini, Milad Nasr, J. Zico Kolter, and Matt Fredrikson. 2023 · 2023

Later among the works it cites.

Stela: a community-centred approach to norm elicitation for ai alignment

Stevie Bergman, Nahema Marchal, John Mellor, Shakir Mohamed, Iason Gabriel, and William Isaac. 2024 · 2024