Rejected Dialects: Biases Against African American Language in Reward Models

Value-sensitive design

Batya Friedman. 1996 · 1996

Earlier work this paper cites.

African-American Language Use: Ideology and So-called Obscenity , pages 226–250

Arthur Spears. 1998 · 1998

Earlier work this paper cites.

African American English: a linguistic introduction

Lisa J Green. 2002 · 2002

Earlier work this paper cites.

Social varieties of American English , page 58–75. Cambridge University Press

Walt Wolfram. 2004 · 2004

Earlier work this paper cites.

Articulate While Black: Barack Obama, Language, and Race in the U. S

H. Samy Alim, Geneva Smitherman, and Michael Eric Dyson. 2012 · 2012

Earlier work this paper cites.

Challenges of studying and processing dialects in social media

Anna Jørgensen, Dirk Hovy, and Anders Søgaard. 2015 · 2015

Earlier work this paper cites.

1language use in african american communities: An introduction

Sonja L. Lanehart, Jennifer Bloomquist, and Ayesha M. Malik. 2015 · 2015

Earlier work this paper cites.

Raciolinguistics: How Language Shapes Our Ideas About Race

H. Samy Alim, John R. Rickford, and Arnetha F. Ball. 2016 · 2016

Earlier work this paper cites.

Demographic Dialectal Variation in Social Media: A Case Study of African-American English

Su Lin Blodgett, Lisa Green, and Brendan O’Connor. 2016 · 2016

Earlier work this paper cites.

Racial Disparity in Natural Language Processing: A Case Study of Social Media African-American English

Su Lin Blodgett and Brendan T. O’Connor. 2017 · 2017

Earlier work this paper cites.

Deep Reinforcement Learning from Human Preferences

P. Christiano, J. Leike, Tom B. Brown, Miljan Martic, S. Legg, and Dario Amodei. 2017 · 2017

Earlier work this paper cites.

Unsettling race and language: Toward a raciolinguistic perspective

Jonathan Rosa and Nelson Flores. 2017 · 2017

Earlier work this paper cites.

Proximal Policy Optimization Algorithms

John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017 · 2017

Earlier work this paper cites.

Chapter 10. Black Is, Black Isn’t: Perceptions of Language and Blackness

Walt Wolfram, Karissa Wojcik, Eric Wilbanks, and Jeffrey Reaser. 2018 · 2018

Earlier work this paper cites.

Racial bias in hate speech and abusive language detection datasets

Thomas Davidson, Debasmita Bhattacharya, and Ingmar Weber. 2019 · 2019

Earlier work this paper cites.

Articulating language oppression: colonialism, coloniality and the erasure of Tibet’s minority languages

Gerald Roche. 2019 · 2019

Earlier work this paper cites.

The Risk of Racial Bias in Hate Speech Detection

Maarten Sap, Dallas Card, Saadia Gabriel, Yejin Choi, and Noah A. Smith. 2019 · 2019

Earlier work this paper cites.

Linguistic justice: Black language, literacy, identity, and pedagogy

April Baker-Bell. 2020 · 2020

Earlier work this paper cites.

Language (Technology) is Power: A Critical Survey of “Bias” in NLP

Su Lin Blodgett, Solon Barocas, Hal Daumé III, and Hanna Wallach. 2020 · 2020

Earlier work this paper cites.

Investigating African-American Vernacular English in transformer-based text generation

Sophie Groenwold, Lily Ou, Aesha Parekh, Samhita Honnavalli, Sharon Levy, Diba Mirza, and William Yang Wang. 2020 · 2020

Earlier work this paper cites.

Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overview

Deven Santosh Shah, H. Andrew Schwartz, and Dirk Hovy. 2020 · 2020

Earlier work this paper cites.

Sociolinguistically driven approaches for just natural language processing

Su Lin Blodgett. 2021 · 2021

Earlier work this paper cites.

“I don’t Think These Devices are Very Culturally Sensitive.”—Impact of Automated Speech Recognition Errors on African Americans

Zion Mengesha, Courtney Heldreth, Michal Lahav, Juliana Sublewski, and Elyse Tuennerman. 2021 · 2021

Earlier work this paper cites.

Detoxifying Language Models Risks Marginalizing Minority Voices

Albert Xu, Eshaan Pathak, Eric Wallace, Suchin Gururangan, Maarten Sap, and Dan Klein. 2021 · 2021

Earlier work this paper cites.

Challenges in Automated Debiasing for Toxic Language Detection

Xuhui Zhou, Maarten Sap, Swabha Swayamdipta, Yejin Choi, and Noah Smith. 2021 · 2021

Earlier work this paper cites.

Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback

Yuntao Bai, Andy Jones, Kamal Ndousse, Amanda Askell, Anna Chen, Nova DasSarma, Dawn Drain, Stanislav Fort, Deep Ganguli, Tom Henighan, Nicholas Joseph, Saurav Kadavath, Jackson Kernion, Tom Conerly, Sheer El-Showk, Nelson Elhage, Zac Hatfield-Dodds, Danny Hernandez, Tristan Hume, Scott Johnston, Shauna Kravec, Liane Lovitt, Neel Nanda, Catherine Olsson, Dario Amodei, Tom Brown, Jack Clark, Sam McCandlish, Chris Olah, Ben Mann, and Jared Kaplan. 2022 · 2022

Cited alongside, same era.

Towards a deep multi-layered dialectal language analysis: A case study of African-American English

Jamell Dacon. 2022 · 2022

Cited alongside, same era.

The Black side of the river: Race, language, and belonging in Washington, DC

Jessica A Grieser. 2022 · 2022

Cited alongside, same era.

Exploring the Role of Grammar and Word Choice in Bias Toward African American English (AAE) in Hate Speech Classification

Camille Harris, Matan Halevy, Ayanna Howard, Amy Bruckman, and Diyi Yang. 2022 · 2022

Cited alongside, same era.

Training language models to follow instructions with human feedback

HelpSteer: Multi-attribute Helpfulness Dataset for SteerLM

Zhilin Wang, Yi Dong, Jiaqi Zeng, Virginia Adams, Makesh Narsimhan Sreedhar, Daniel Egert, Olivier Delalleau, Jane Polak Scowcroft, Neel Kant, Aidan Swope, and Oleksii Kuchaiev. 2023 · 2023

Later among the works it cites.

Can voice assistants be microaggressors? cross-race psychological responses to failures of automatic speech recognition

Kimi Wenzel, Nitya Devireddy, Cam Davison, and Geoff Kaufman. 2023 · 2023

Later among the works it cites.

Gibbs sampling from human feedback: A provable kl-constrained framework for rlhf

Original

Wei Xiong, Hanze Dong, Chenlu Ye, Han Zhong, Nan Jiang, and Tong Zhang. 2023 · 2023

Later among the works it cites.

Qwen2 technical report

2024 · 2024

Later among the works it cites.

Internlm2 technical report

Original

Zheng Cai, Maosong Cao, Haojiong Chen, Kai Chen, Keyu Chen, Xin Chen, Xun Chen, Zehui Chen, Zhi Chen, Pei Chu, Xiaoyi Dong, Haodong Duan, Qi Fan, Zhaoye Fei, Yang Gao, Jiaye Ge, Chenya Gu, Yuzhe Gu, Tao Gui, Aijia Guo, Qipeng Guo, Conghui He, Yingfan Hu, Ting Huang, Tao Jiang, Penglong Jiao, Zhenjiang Jin, Zhikai Lei, Jiaxing Li, Jingwen Li, Linyang Li, Shuaibin Li, Wei Li, Yining Li, Hongwei Liu, Jiangning Liu, Jiawei Hong, Kaiwen Liu, Kuikun Liu, Xiaoran Liu, Chengqi Lv, Haijun Lv, Kai Lv, Li Ma, Runyuan Ma, Zerun Ma, Wenchang Ning, Linke Ouyang, Jiantao Qiu, Yuan Qu, Fukai Shang, Yunfan Shao, Demin Song, Zifan Song, Zhihao Sui, Peng Sun, Yu Sun, Huanze Tang, Bin Wang, Guoteng Wang, Jiaqi Wang, Jiayu Wang, Rui Wang, Yudong Wang, Ziyi Wang, Xingjian Wei, Qizhen Weng, Fan Wu, Yingtong Xiong, Chao Xu, Ruiliang Xu, Hang Yan, Yirong Yan, Xiaogui Yang, Haochen Ye, Huaiyuan Ying, Jia Yu, Jing Yu, Yuhang Zang, Chuyu Zhang, Li Zhang, Pan Zhang, Peng Zhang, Ruijie Zhang, Shuo Zhang, Songyang Zhang, Wenjian Zhang, Wenwei Zhang, Xingcheng Zhang, Xinyue Zhang, Hui Zhao, Qian Zhao, Xiaomeng Zhao, Fengzhe Zhou, Zaida Zhou, Jingming Zhuo, Yicheng Zou, Xipeng Qiu, Yu Qiao, and Dahua Lin. 2024 · 2024