Gender bias and stereotypes in Large Language Models

Evaluating the Underlying Gender Bias in Contextualized Word Embeddings

Original

Christine Basta, Marta R. Costa-jussà, and Noe Casas. 2019 · 1904

Earlier work this paper cites.

Release Strategies and the Social Impacts of Language Models

Original

Irene Solaiman, Miles Brundage, Jack Clark, Amanda Askell, Ariel Herbert-Voss, Jeff Wu, Alec Radford, Gretchen Krueger, Jong Wook Kim, Sarah Kreps, Miles McCain, Alex Newhouse, Jason Blazakis, Kris McGuffie, and Jasmine Wang. 2019 · 1908

Earlier work this paper cites.

A computer method for calculating Kendall’s tau with ungrouped data

William R Knight. 1966 · 1966

Earlier work this paper cites.

On so-called pronouns in English

Paul M. Postal. 1966 · 1966

Earlier work this paper cites.

Remarks on Coreference

Howard Lasnik. 1976 · 1976

Earlier work this paper cites.

Lectures on government and binding: the Pisa lectures

Noam Chomsky. 1981 · 1981

Earlier work this paper cites.

Providing a Unified Account of Definite Noun Phrases in Discourse. In 21st Annual Meeting of the Association for Computational Linguistics . Association for Computational Linguistics, Cambridge, Massachusetts, USA, 44–50

Barbara J. Grosz, Aravind K. Joshi, and Scott Weinstein. 1983 · 1983

Earlier work this paper cites.

Gentlemen prefer blondes: A study of gender bias in example sentences

Monica Macaulay and Colleen Brice. 1994 · 1994

Earlier work this paper cites.

Pronominalization and discourse coherence, discourse structure and pronoun interpretation

Peter C. Gordon and Kimberly A. Scearce. 1995 · 1995

Earlier work this paper cites.

The Use of Stereotypical Gender Information in Constructing a Mental Model: Evidence from English and Spanish

Manuel Carreiras, Alan Garnham, Jane Oakhill, and Kate Cains. 1996 · 1996

Earlier work this paper cites.

Storytellers and gatekeepers in economics

Livia Polanyi and Diana Strassmann. 1996 · 1996

Earlier work this paper cites.

Evidence of immediate activation of gender information from a social role name

David Reynolds, Alan Garnham, , and Jane Oakhill. 1996 · 1996

Earlier work this paper cites.

Don’t touch my projectile: gender bias and stereotyping in syntactic examples

Monica Macaulay and Colleen Brice. 1997 · 1997

Earlier work this paper cites.

Who women are, who women should be: Descriptive and prescriptive gender stereotyping in sex discrimination

Diana Burgess and Eugene Borgida. 1999 · 1999

Earlier work this paper cites.

The rapid use of gender information: Evidence of the time course of pronoun resolution from eyetracking

Jennifer E. Arnold, Janet G. Eisenband, Sarah Brown-Schmidt, and John C. Trueswell. 2000 · 2000

Earlier work this paper cites.

The processing of Italian subject pronouns

Maria Nella Carminati. 2002 · 2002

Earlier work this paper cites.

Math = male, me = female, therefore math != me

Brian Nosek, Mahzarin Banaji, and Anthony Greenwald. 2002 · 2002

Earlier work this paper cites.

Gender Bias in Coreference Resolution. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) . Association for Computational Linguistics, New Orleans, Louisiana, 8–14

Rachel Rudinger, Jason Naradowsky, Brian Leonard, and Benjamin Van Durme. 2018 · 2002

Earlier work this paper cites.

Centering: A Framework for Modeling the Local Coherence of Discourse

Barbara J. Grosz, Aravind K. Joshi, and Scott Weinstein. 1995 · 2003

Earlier work this paper cites.

Comprehending pronouns: A role for word-specific gender stereotype information

S.M. Kennison and J.L. Trofe. 2003 · 2003

Earlier work this paper cites.

Gender Bias in Coreference Resolution: Evaluation and Debiasing Methods. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) . Association for Computational Linguistics, New Orleans, Louisiana, 15–20

Jieyu Zhao, Tianlu Wang, Mark Yatskar, Vicente Ordonez, and Kai-Wei Chang. 2018a · 2003

Earlier work this paper cites.

Big Data’s Disparate Impact

Melissa Hart. 2005 · 2005

Earlier work this paper cites.

Processing definitional and stereotypical gender in reference resolution: Evidence from eye-movements

Hamutal Kreiner, Patrick Sturt, and Simon Garrod. 2008 · 2007

Earlier work this paper cites.

Gender stereotyping and prejudice in young children: A developmental intergroup perspective

Andrea E Arthur, Rebecca S Bigler, Lynn S Liben, Susan A Gelman, and Diane N Ruble. 2008 · 2008

Earlier work this paper cites.

Au pairs are rarely male: Norms on the gender perception of role names across English, French, and German

Ute Gabriel, Pascal Mark Gygax, Oriane Sarrasin, Alan Garnham, and J. V. Oakhill. 2008 · 2008

Earlier work this paper cites.

WP:Clubhouse? An Exploration of Wikipedia’s Gender Imbalance. In Proceedings of the 7th International Symposium on Wikis and Open Collaboration (Mountain View, California) (WikiSym ’11) . Association for Computing Machinery, New York, NY, USA, 1–10

Shyong (Tony) K. Lam, Anuradha Uduwage, Zhenhua Dong, Shilad Sen, David R. Musicant, Loren Terveen, and John Riedl. 2011 · 2011

Earlier work this paper cites.

The Winograd schema challenge. (2011)

Hector J. Levesque, Ernest Davis, and Leora Morgenstern. 2011 · 2011

Earlier work this paper cites.

Influences of grammatical and stereotypical gender during reading: eye movements in pronominal and noun phrase anaphor resolution

Yulia Esaulova, Chiara Reali, and Lisa von Stockhausen. 2014 · 2013

Earlier work this paper cites.

Wikipedia, sociology, and the promise and pitfalls of Big Data

Julia Adams and Hannah Brückner. 2015 · 2015

Earlier work this paper cites.

Expectations of brilliance underlie gender distributions across academic disciplines

Sarah-Jane Leslie, Andrei Cimpian, Meredith Meyer, and Edward Freeland. 2015 · 2015

Earlier work this paper cites.

Women are underrepresented in fields where success is believed to require brilliance

Meredith Meyer, Andrei Cimpian, and Sarah-Jane Leslie. 2015 · 2015

Earlier work this paper cites.

Gender representation in learning materials: Internatioal perspectives

Abolaji S. Mustapha and Sara Mills. 2015 · 2015

Earlier work this paper cites.

Pragmatic relativity: Gender and context affect the use of personal pronouns in discourse differentially across languages

Zeynep Azar, Ad Backus, and Asli Özyürek. 2016 · 2016

Earlier work this paper cites.

Big Data’s Disparate Impact

Solon Barocas and Andrew D. Selbst. 2016 · 2016

Earlier work this paper cites.

Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings

Original

Tolga Bolukbasi, Kai-Wei Chang, James Zou, Venkatesh Saligrama, and Adam Kalai. 2016 · 2016

Earlier work this paper cites.

Stereotypical Gender Effects in 2016

Margaret Grant, Hadas Kotek, Jayun Bae, and Jeffrey Lamontagne. 2016 · 2016

Cited alongside, same era.

Twenty years of stereotype threat research: A review of psychological mediators

Charlotte R Pennington, Derek Heim, Andrew R Levy, and Derek T Larkin. 2016 · 2016

Cited alongside, same era.

Can gender-fair language reduce gender stereotyping and discrimination?

Sabine Sczesny, Magda Formanowicz, and Franziska Moser. 2016 · 2016

Cited alongside, same era.

Stereotype threat

Steven J Spencer, Christine Logel, and Paul G Davies. 2016 · 2016

Cited alongside, same era.

Gender stereotypes about intellectual ability emerge early and influence children’s interests

Lin Bian, Sarah-Jane Leslie, and Andrei Cimpian. 2017 · 2017

Cited alongside, same era.

Semantics derived automatically from language corpora contain human-like biases

Aylin Caliskan, Joanna J. Bryson, and Arvind Narayanan. 2017 · 2017

Gender stereotypes and biases in early childhood: A systematic review

Tania L King, Anna J Scovelle, Anneke Meehl, Allison J Milner, and Naomi Priest. 2021 · 2021

Later among the works it cites.

Bias Out-of-the-Box: An Empirical Analysis of Intersectional Occupational Biases in Popular Generative Language Models

Original

Hannah Kirk, Yennie Jun, Haider Iqbal, Elias Benussi, Filippo Volpin, Frederic A. Dreyer, Aleksandar Shtedritski, and Yuki M. Asano. 2021 · 2021

Later among the works it cites.

Gender bias and stereotypes in linguistic example sentences

Hadas Kotek, Rikker Dockum, Sarah Babinski, and Christopher Geissler. 2021 · 2021

Later among the works it cites.

StereoSet: Measuring stereotypical bias in pretrained language models. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) . Association for Computational Linguistics, Online, 5356–5371

Moin Nadeem, Anna Bethke, and Siva Reddy. 2021 · 2021

Later among the works it cites.