Fetching the paper…
Reading the bibliography…
To examine whether intersectional bias can be observed in language generation, we examine \emph{GPT-2} and \emph{GPT-NEO} models, ranging in size from 124 million to ~2.7 billion parameters.
“Evaluating the Underlying Gender Bias in Contextualized Word Embeddings”, 2019
Christine Basta, Marta. Costa-jussà and Noe Casas · 1904
Earlier work this paper cites.
“Gender Bias in Contextualized Word Embeddings”, 2019
Jieyu Zhao et al · 1904
Earlier work this paper cites.
“The Curious Case of Neural Text Degeneration”, 2020
Ari Holtzman et al · 1904
Earlier work this paper cites.
“Gender-preserving Debiasing for Pre-trained Word Embeddings”, 2019
Masahiro Kaneko and Danushka Bollegala · 1906
Earlier work this paper cites.
“Evaluating Gender Bias in Machine Translation”, 2019
Gabriel Stanovsky, Noah. Smith and Luke Zettlemoyer · 1906
Earlier work this paper cites.
“Mitigating Gender Bias in Natural Language Processing: Literature Review”, 2019
Tony Sun et al · 1906
Earlier work this paper cites.
“Toward Fairness in AI for People with Disabilities: A Research Roadmap”, 2019
Anhong Guo et al · 1907
Earlier work this paper cites.
“Fine-grained Sentiment Classification using BERT”, 2019
Manish Munikar, Sushil Shakya and Aakash Shrestha · 1910
Earlier work this paper cites.
“DistilBERT, a Distilled Version of BERT: Smaller, Faster, Cheaper and Lighter”, 2020
Victor Sanh, Lysandre Debut, Julien Chaumond and Thomas Wolf · 1910
Earlier work this paper cites.
“Reducing Sentiment Bias in Language Models via Counterfactual Evaluation”, 2020
Po-Sen Huang et al · 1911
Earlier work this paper cites.
“Mapping the Margins: Intersectionality, Identity Politics, and Violence against Women of Color”
Kimberle Crenshaw · 1990
Earlier work this paper cites.
“NLTK: The Natural Language Toolkit”
Steven Bird and Edward Loper · 2004
Earlier work this paper cites.
“Language Models are Few-Shot Learners”, 2020
Tom. Brown et al · 2005
Earlier work this paper cites.
“Intersectional Bias in Hate Speech and Abusive Language Datasets”, 2020
Jae Kim et al · 2005
Earlier work this paper cites.
“Beyond Accuracy: Behavioral Testing of NLP models with CheckList”, 2020
Marco Ribeiro, Tongshuang Wu, Carlos Guestrin and Sameer Singh · 2005
Earlier work this paper cites.
“Convention on the Rights of Persons with Disabilities”
The United Nations · 2006
Earlier work this paper cites.
Wei Guo and Aylin Caliskan · 2006
Earlier work this paper cites.
“On Transferability of Bias Mitigation Effects in Language Model Fine-Tuning”, 2021
Xisen Jin et al · 2010
Earlier work this paper cites.
“The World Religions Paradigm: Time for a Change”
Suzanne Owen · 2011
Cited alongside, same era.
“Fairness through Awareness”
Cynthia Dwork et al · 2012
Cited alongside, same era.
“Efficient Estimation of Word Representations in Vector Space”, 2013
Tomas Mikolov, Kai Chen, Greg Corrado and Jeffrey Dean · 2013
Cited alongside, same era.
“Glove: Global Vectors for Word Representation”
Jeffrey Pennington, Richard Socher and Christopher Manning · 2014
Cited alongside, same era.
“The Black Box Society”
Frank Pasquale · 2015
Cited alongside, same era.
“Postcolonial Reproductions: Disability, Indigeneity and the Formation of the White Masculine Settler State of Australia”
Karen Soldatic · 2015
Cited alongside, same era.
“AI Fairness for People with Disabilities: Point of View”, 2018
Shari Trewin · 2018
Later among the works it cites.
“Gender Bias in Coreference Resolution: Evaluation and Debiasing Methods”, 2018
Jieyu Zhao et al · 2018
Later among the works it cites.
“Race After Technology: Abolitionist Tools for the New Jim Code”
Ruha Benjamin · 2019
Later among the works it cites.
“Identifying and Reducing Gender Bias in Word-Level Language Models”
Shikha Bordia and Samuel. Bowman · 2019
Later among the works it cites.
“My Algorithms Have Determined You’re Not Human: AI-ML, Reverse Turing-Tests, and the Disability Experience”
Karen Nakamura · 2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
“Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings”, 2016
Tolga Bolukbasi et al · 2016
Cited alongside, same era.
“The Social Impact of Natural Language Processing”
Dirk Hovy and Shannon Spruit · 2016
Cited alongside, same era.
“Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy”
Cathy O’Neil · 2016
Cited alongside, same era.
“The Trouble with Bias”
Kate Crawford · 2017
Cited alongside, same era.
“Attention Is All You Need”, 2017
Ashish Vaswani et al · 2017
Cited alongside, same era.
“Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification”
Joy Buolamwini and Timnit Gebru · 2018
Cited alongside, same era.
“Language Models are Unsupervised Multitask Learners”
Alec Radford et al · 2019
Later among the works it cites.
“Disability, Bias, and AI”
Meredith Whittaker et al · 2019
Later among the works it cites.
“The Pile: An 800GB Dataset of Diverse Text for Language Modeling”, 2020
Leo Gao et al · 2020
Later among the works it cites.
“A Robot Wrote this Entire Article. Are You Scared Yet, Human?”, 2020
GPT-3 · 2020
Later among the works it cites.
“Unintended Machine Learning Biases as Social Barriers for Persons with Disabilities”
Ben Hutchinson et al · 2020
Later among the works it cites.
“Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AI” CHI 2020 Best Paper Award
Michael Madaio, Luke Stark, Jennifer Wortman and Hanna Wallach · 2020
Later among the works it cites.
“Towards Improved Deep Contextual Embedding for the Identification of Irony and Sarcasm”
Usman Naseem, Imran Razzak, Peter Eklund and Katarzyna Musial · 2020
Later among the works it cites.
“How to Generate Text: Using Different Decoding Methods for Language Generation with Transformers” (Accessed on 04/27/2021), https://huggingface.co/blog/how-to-generate , 2020
Patrick von Platen · 2020
Later among the works it cites.
“Persistent Anti-Muslim Bias in Large Language Models”, 2021
Abubakar Abid, Maheen Farooqi and James Zou · 2021
Closest in time.
“On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?”
Emily. Bender, Timnit Gebru, Angelina McMillan-Major and Shmargaret Shmitchell · 2021
Closest in time.
“Automatically Neutralizing Ableist Language in Text”, 2021
T. Liu and Tyler Shibata · 2021
Closest in time.
“Calibrate Before Use: Improving Few-Shot Performance of Language Models”, 2021
Tony. Zhao et al · 2021
Closest in time.