Fetching the paper…
Reading the bibliography…
Design biases in NLP systems, such as performance differences for different populations, often stem from their creator's positionality, i.e., views and lived experiences shaped by identity and background.
Experiences using cooperative interactive storyboard prototyping
Kim Halskov Madsen and Peter H. Aiken. 1993 · 1993
Earlier work this paper cites.
Harms of gender exclusivity and challenges in non-binary representation in language technologies
Sunipa Dev, Masoud Monajatipoor, Anaelia Ovalle, Arjun Subramonian, Jeff Phillips, and Kai-Wei Chang. 2021 · 1994
Earlier work this paper cites.
Value-sensitive design
Batya Friedman. 1996 · 1996
Earlier work this paper cites.
Bias in computer systems
Batya Friedman and Helen Nissenbaum. 1996 · 1996
Earlier work this paper cites.
Design and Analysis: A Researcher’s Handbook
Thomas D Wickens and Geoffrey Keppel. 2004 · 2004
Earlier work this paper cites.
The methodology of participatory design
Clay Spinuzzi. 2005 · 2005
Earlier work this paper cites.
Reliability in content analysis: Some common misconceptions and recommendations
Klaus Krippendorff. 2006 · 2006
Earlier work this paper cites.
The weirdest people in the world?
Joseph Henrich, Steven J Heine, and Ara Norenzayan. 2010 · 2010
Earlier work this paper cites.
Demographics of Mechanical Turk
Panagiotis G Ipeirotis. 2010 · 2010
Earlier work this paper cites.
Postcolonial computing: A lens on design and development
Lilly Irani, Janet Vertesi, Paul Dourish, Kavita Philip, and Rebecca E. Grinter. 2010 · 2010
Earlier work this paper cites.
Pathways to equity in mathematics education: How life experiences impact researcher positionality
Mary Q Foote and Tonya Gau Bartell. 2011 · 2011
Earlier work this paper cites.
Improving performance, perceived usability, and aesthetics with culturally adaptive user interfaces
Katharina Reinecke and Abraham Bernstein. 2011 · 2011
Earlier work this paper cites.
The world values survey
Christian W Haerpfer and Kseniya Kizilova. 2012 · 2012
Earlier work this paper cites.
Detecting hate speech on the world wide web
William Warner and Julia Hirschberg. 2012 · 2012
Earlier work this paper cites.
Digital language death
András Kornai. 2013 · 2013
Earlier work this paper cites.
Knowing what a user likes: A design science approach to interfaces that automatically adapt to culture
Katharina Reinecke and Abraham Bernstein. 2013 · 2013
Earlier work this paper cites.
Qualititative research: The essential guide to theory and practice
Maggi Savin-Baden and Claire Howell-Major. 2013 · 2013
Earlier work this paper cites.
Online harassment
Maeve Duggan, L Rainie, A Smith, C Funk, A Lenhart, and M Madden. 2014 · 2014
Earlier work this paper cites.
Positionality
Wendy E Rowe. 2014 · 2014
Earlier work this paper cites.
Truth is a lie: Crowd truth and the seven myths of human annotation
Lora Aroyo and Chris Welty. 2015 · 2015
Earlier work this paper cites.
Social Constructionism
Vivien Burr. 2015 · 2015
Earlier work this paper cites.
Tagging performance correlates with author age
Dirk Hovy and Anders Søgaard. 2015 · 2015
Earlier work this paper cites.
Cross-lingual syntactic variation over age and gender
Anders Johannsen, Dirk Hovy, and Anders Søgaard. 2015 · 2015
Earlier work this paper cites.
Challenges of studying and processing dialects in social media
Anna Jørgensen, Dirk Hovy, and Anders Søgaard. 2015 · 2015
Earlier work this paper cites.
LabInTheWild: Conducting large-scale online experiments with uncompensated samples
Katharina Reinecke and Krzysztof Z. Gajos. 2015 · 2015
Earlier work this paper cites.
Man is to computer programmer as woman is to homemaker? Debiasing word embeddings
Tolga Bolukbasi, Kai-Wei Chang, James Y Zou, Venkatesh Saligrama, and Adam T Kalai. 2016 · 2016
Earlier work this paper cites.
Designing culture-based persuasive technology to promote physical activity among university students
Kiemute Oyibo. 2016 · 2016
Earlier work this paper cites.
ACL Diversity Statistics
ACL. 2017 · 2017
Earlier work this paper cites.
Citizen science opportunities in volunteer-based online experiments
Nigini Oliveira, Eunice Jun, and Katharina Reinecke. 2017 · 2017
Earlier work this paper cites.
Gender and dialect bias in YouTube’s automatic captions
Rachael Tatman. 2017 · 2017
Earlier work this paper cites.
Do artifacts have politics?
Langdon Winner. 2017 · 2017
Cited alongside, same era.
The moral machine experiment
Edmond Awad, Sohan Dsouza, Richard Kim, Jonathan Schulz, Joseph Henrich, Azim Shariff, Jean-François Bonnefon, and Iyad Rahwan. 2018 · 2018
Cited alongside, same era.
Data statements for natural language processing: Toward mitigating system bias and enabling better science
Emily M. Bender and Batya Friedman. 2018 · 2018
Cited alongside, same era.
Design justice, AI, and escape from the matrix of domination
Sasha Costanza-Chock. 2018 · 2018
Cited alongside, same era.
Demographics and dynamics of mechanical turk workers
Djellel Difallah, Elena Filatova, and Panos Ipeirotis. 2018 · 2018
Cited alongside, same era.
Challenges of language technologies for the indigenous languages of the Americas
Manuel Mager, Ximena Gutierrez-Vasques, Gerardo Sierra, and Ivan Meza-Ruiz. 2018 · 2018
Toward deconfounding the effect of entity demographics for question answering accuracy
Maharshi Gor, Kellie Webster, and Jordan Boyd-Graber. 2021 · 2021
Later among the works it cites.
Can machines learn morality? the delphi experiment
Liwei Jiang, Jena D Hwang, Chandra Bhagavatula, Ronan Le Bras, Jenny Liang, Jesse Dodge, Keisuke Sakaguchi, Maxwell Forbes, Jon Borchardt, Saadia Gabriel, et al. 2021 · 2021
Later among the works it cites.
Reproducibility checklist
NAACL. 2021 · 2021
Later among the works it cites.
Scaling language models: Methods, analysis & insights from training Gopher
Jack W Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, et al. 2021 · 2021
Later among the works it cites.
Changing the world by changing the data
Anna Rogers. 2021 · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Pay attention, please: Formal language improves attention in volunteer and paid online experiments
Tal August and Katharina Reinecke. 2019 · 2019
Cited alongside, same era.
The# benderrule: On naming the languages we study and why it matters
Emily Bender. 2019 · 2019
Cited alongside, same era.
Racial bias in hate speech and abusive language detection datasets
Thomas Davidson, Debasmita Bhattacharya, and Ingmar Weber. 2019 · 2019
Cited alongside, same era.
Women’s syntactic resilience and men’s grammatical luck: Gender-bias in part-of-speech tagging and dependency parsing
Aparna Garimella, Carmen Banea, Dirk Hovy, and Rada Mihalcea. 2019 · 2019
Cited alongside, same era.
A mulching proposal: Analysing and improving an algorithmic system for turning the elderly into high-nutrient slurry
Os Keyes, Jevan Hutson, and Meredith Durbin. 2019 · 2019
Cited alongside, same era.
Model cards for model reporting
Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. 2019 · 2019
Cited alongside, same era.
Learning from the worst: Dynamically generated datasets to improve online hate detection
Bertie Vidgen, Tristan Thrush, Zeerak Waseem, and Douwe Kiela. 2021 · 2021
Later among the works it cites.
Disembodied machine learning: On the illusion of objectivity in NLP
Zeerak Waseem, Smarika Lulz, Joachim Bingel, and Isabelle Augenstein. 2021 · 2021
Later among the works it cites.
Detoxifying language models risks marginalizing minority voices
Albert Xu, Eshaan Pathak, Eric Wallace, Suchin Gururangan, Maarten Sap, and Dan Klein. 2021 · 2021
Later among the works it cites.
Morality beyond the WEIRD: How the nomological network of morality varies across cultures
Mohammad Atari, Jonathan Haidt, Jesse Graham, Sena Koleva, Sean T Stevens, and Morteza Dehghani. 2022 · 2022
Later among the works it cites.
The values encoded in machine learning research
Abeba Birhane, Pratyusha Kalluri, Dallas Card, William Agnew, Ravit Dotan, and Michelle Bao. 2022 · 2022
Later among the works it cites.
Systematic inequalities in language technology performance across the world’s languages
Damian Blasi, Antonios Anastasopoulos, and Graham Neubig. 2022 · 2022
Later among the works it cites.
Model positionality and computational reflexivity: Promoting reflexivity in data science
Scott Allen Cambo and Darren Gergle. 2022 · 2022
Later among the works it cites.
Dealing with disagreements: Looking beyond the majority vote in subjective annotations
Aida Mostafazadeh Davani, Mark Díaz, and Vinodkumar Prabhakaran. 2022 · 2022
Later among the works it cites.
Afrolm: A self-active learning-based multilingual pretrained language model for 23 African languages
Bonaventure F.P. Dossou, Atnafu Lambebo Tonja, Oreen Yousuf, Salomey Osei, Abigail Oppong, Iyanuoluwa Shode, Oluwabusayo Olufunke Awoyomi, and Chris Emezue. 2022 · 2022
Later among the works it cites.
Whose language counts as high quality? measuring language ideologies in text data selection
Suchin Gururangan, Dallas Card, Sarah K Drier, Emily K Gade, Leroy Z Wang, Zeyu Wang, Luke Zettlemoyer, and Noah A Smith. 2022 · 2022
Later among the works it cites.
A systematic study of bias amplification
Melissa Hall, Laurens van der Maaten, Laura Gustafson, and Aaron Adcock. 2022 · 2022
Later among the works it cites.
Speaking multiple languages affects the moral bias of language models
Katharina Hämmerl, Björn Deiseroth, Patrick Schramowski, Jindřich Libovickỳ, Constantin A Rothkopf, Alexander Fraser, and Kristian Kersting. 2022 · 2022
Later among the works it cites.
Toxigen: Controlling language models to generate implied and adversarial toxicity
Thomas Hartvigsen, Saadia Gabriel, Hamid Palangi, Maarten Sap, Dipankar Ray, and Ece Kamar. 2022 · 2022
Later among the works it cites.
Challenges and strategies in cross-cultural NLP
Daniel Hershcovich, Stella Frank, Heather Lent, Miryam de Lhoneux, Mostafa Abdou, Stephanie Brandl, Emanuele Bugliarello, Laura Cabello Piqueras, Ilias Chalkidis, Ruixiang Cui, Constanza Fierro, Katerina Margatina, Phillip Rust, and Anders Søgaard. 2022 · 2022
Later among the works it cites.
Artelingo: A million emotion annotations of WikiArt with emphasis on diversity over language and culture
Youssef Mohamed, Mohamed Abdelfattah, Shyma Alhuwaider, Feifan Li, Xiangliang Zhang, Kenneth Ward Church, and Mohamed Elhoseiny. 2022 · 2022
Later among the works it cites.
The ’problem’ of human label variation: On ground truth in data, modeling and evaluation
Barbara Plank. 2022 · 2022
Later among the works it cites.
Annotators with attitudes: How annotator beliefs and identities bias toxic language detection
Maarten Sap, Swabha Swayamdipta, Laura Vianna, Xuhui Zhou, Yejin Choi, and Noah A. Smith. 2022 · 2022
Later among the works it cites.
Good night at 4 pm?! time expressions in different cultures
Vered Shwartz. 2022 · 2022
Later among the works it cites.
Beyond the imitation game: Quantifying and extrapolating the capabilities of language models
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, et al. 2022 · 2022
Later among the works it cites.
On the machine learning of ethical judgments from natural language
Zeerak Talat, Hagen Blix, Josef Valvoda, Maya Indira Ganesh, Ryan Cotterell, and Adina Williams. 2022 · 2022
Later among the works it cites.
Reproducibility checklist
AAAI. 2023 · 2023
Closest in time.
Probing pre-trained language models for cross-cultural differences in values
Arnav Arora, Lucie-Aimée Kaffee, and Isabelle Augenstein. 2023 · 2023
Closest in time.
Gpt-4 technical report
OpenAI. 2023 · 2023
Closest in time.
ChatGPT is multilingual but monocultural, and it’s learning your values
Jill Walker Rettberg. 2022 · 2023
Closest in time.
Everyone’s voice matters: Quantifying annotation disagreement using demographic information
Ruyuan Wan, Jaehyung Kim, and Dongyeop Kang. 2023 · 2023
Closest in time.