Investigating Bias Representations in Llama 2 Chat via Activation Steering

The woman worked as a babysitter: On biases in language generation, 2019

Emily Sheng, Kai-Wei Chang, Premkumar Natarajan, and Nanyun Peng · 2019

Earlier work this paper cites.

Stereoset: Measuring stereotypical bias in pretrained language models, 2020

Moin Nadeem, Anna Bethke, and Siva Reddy · 2020

Earlier work this paper cites.

Steering llama 2 via contrastive activation addition, 2023

Nina Rimsky, Nick Gabrieli, Julian Schulz, Meg Tong, Evan Hubinger, and Alexander Matt Turner · 2023

Earlier work this paper cites.

Representation engineering: A top-down approach to ai transparency, 2023

Andy Zou, Long Phan, Sarah Chen, James Campbell, Phillip Guo, Richard Ren, Alexander Pan, Xuwang Yin, Mantas Mazeika, Ann-Kathrin Dombrowski, Shashwat Goel, Nathaniel Li, Michael J. Byun, Zifan Wang, Alex Mallen, Steven Basart, Sanmi Koyejo, Dawn Song, Matt Fredrikson, J. Zico Kolter, and Dan Hendrycks · 2023

Cited alongside, same era.

Gpt-4 technical report, 2023

OpenAI · 2023

Cited alongside, same era.

gender_stereotypes_augmented_A_B.json

Dawn Lu · 2023

Cited alongside, same era.

Llama 2: Open foundation and fine-tuned chat models, 2023

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Jian Xiang Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurelien Rodriguez, Robert Stojnic, Sergey Edunov, and Thomas Scialom

Cited in the paper.

stereotype_data_A_B_subset.json

Dawn Lu · 2023

Later among the works it cites.

Red-teaming language models via activation engineering

Nina Rimsky · 2023

Later among the works it cites.