2019

This Thing Called Fairness: Disciplinary Confusion Realizing a Value in Technology

Mulligan, Deirdre K., Kroll, Joshua A., Kohli, Nitin et al.

Understand

The explosion in the use of software in important sociotechnical systems has renewed focus on the study of the way technical constructs reflect policies, norms, and human values.

This effort requires the engagement of scholars and practitioners from many disciplines.
And yet, these disciplines often conceptualize the operative values very differently while referring to them using the same vocabulary.
The resulting conflation of ideas confuses discussions about values in technology at disciplinary boundaries.

Built on

Science on the run: Information management and industrial geophysics at Schlumberger, 1920-1940
Geoffrey C Bowker, C Geoffrey, W Bernard Carlson, et al · 1940
Earlier work this paper cites.
A difficulty in the concept of social welfare
Kenneth J Arrow. 1950 · 1950
Earlier work this paper cites.
A set of independent necessary and sufficient conditions for simple majority decision
Kenneth O May. 1952 · 1952
Earlier work this paper cites.
Essentially contested concepts. In Proceedings of the Aristotelian society , Vol. 56. 167–198
Walter Bryce Gallie. 1955 · 1955
Earlier work this paper cites.
The concept of law
Herbert Lionel Adolphus Hart. 1961 · 1961
Earlier work this paper cites.
The art of computer programming: fundamental algorithms . Vol. 1
Donald Ervin Knuth. 1968 · 1968
Earlier work this paper cites.
Manipulation of voting schemes: a general result
Allan Gibbard. 1973 · 1973
Earlier work this paper cites.
Strategy-proofness and Arrow’s conditions: Existence and correspondence theorems for voting procedures and social welfare functions
Mark Allen Satterthwaite. 1975 · 1975
Earlier work this paper cites.
On strategy-proofness and single peakedness
Hervé Moulin. 1980 · 1980
Earlier work this paper cites.
Do Artifacts Have Politics?
Langdon Winner. 1980 · 1980
Earlier work this paper cites.
Problems of monetary management: the UK experience
Charles AE Goodhart. 1984 · 1984
Earlier work this paper cites.
The fragility of goodness: Luck and ethics in Greek tragedy and philosophy
Martha C Nussbaum. 1986 · 1986
Earlier work this paper cites.
Validity
Samuel Messick. 1987 · 1987
Earlier work this paper cites.
Political equality: An essay in democratic theory
Charles R Beitz. 1989 · 1989
Earlier work this paper cites.
The moral dilemmas of a safety belt
Bruno Latour. 1989 · 1989
Earlier work this paper cites.
Fairness. In Proceedings of the Aristotelian Society , Vol. 91. JSTOR, 87–101
John Broome. 1990 · 1990
Earlier work this paper cites.
Mapping the margins: Intersectionality, identity politics, and violence against women of color
Kimberle Crenshaw. 1990 · 1990
Earlier work this paper cites.
Where Are the Missing Masses? The Sociology of a Few Mundane Artifacts
Bruno Latour. 1992 · 1992
Earlier work this paper cites.
Steps towards an ecology of infrastructure: complex problems in design and access for large-scale collaborative systems. In Proceedings of the 1994 ACM conference on Computer supported cooperative work . ACM, 253–264
Susan Leigh Star and Karen Ruhleder. 1994 · 1994
Earlier work this paper cites.
Value-sensitive design
Batya Friedman. 1996 · 1996
Earlier work this paper cites.
Bias in computer systems
Batya Friedman and Helen Nissenbaum. 1996 · 1996
Earlier work this paper cites.
Creating the kingdom of ends
Christine M Korsgaard. 1996 · 1996
Earlier work this paper cites.
The sources of normativity
Christine M Korsgaard, Christine Marion Korsgaard, Gerald Allan Cohen, Raymond Geuss, Thomas Nagel, and Bernard Williams. 1996 · 1996
Earlier work this paper cites.
Discrimination comes in many forms: Individual, institutional, and structural
Fred L Pincus. 1996 · 1996
Earlier work this paper cites.
Steps toward an ecology of infrastructure: Design and access for large information spaces
Susan Leigh Star and Karen Ruhleder. 1996 · 1996
Earlier work this paper cites.
Lex informatica: The formulation of information policy rules through technology
Joel R Reidenberg. 1997 · 1997
Earlier work this paper cites.
What we owe to each other
Thomas Scanlon. 1998 · 1998
Earlier work this paper cites.
What is the Point of Equality?
Elizabeth S Anderson. 1999 · 1999
Earlier work this paper cites.
Code: And other laws of cyberspace
Lawrence Lessig. 1999 · 1999
Earlier work this paper cites.
Virtue ethics: a misleading category?
Martha C Nussbaum. 1999 · 1999
Earlier work this paper cites.
Sorting things out: Classification and its consequences
Geoffrey C Bowker and Susan Leigh Star. 2000 · 2000
Earlier work this paper cites.
White privilege and male privilege: A personal account of coming to see correspondences through work in Women’s studies (1988)
Peggy McIntosh. 2001 · 2001
Earlier work this paper cites.
How computer systems embody values
Helen Nissenbaum. 2001 · 2001
Earlier work this paper cites.
Justice as fairness: A restatement
John Rawls. 2001 · 2001
Earlier work this paper cites.
Tussle in cyberspace: defining tomorrow’s internet. In ACM SIGCOMM Computer Communication Review , Vol. 32:4. ACM, 347–356
David D Clark, John Wroclawski, Karen R Sollins, and Robert Braden. 2002 · 2002
Earlier work this paper cites.
Smoothing the waters: Observations on the process of cross-disciplinary research collaboration
Paul Jeffrey. 2003 · 2003
Earlier work this paper cites.
Consequentialism
Walter Sinnott-Armstrong. 2003 · 2003
Earlier work this paper cites.
Network neutrality, broadband discrimination
Tim Wu. 2003 · 2003
Earlier work this paper cites.
The Color of Supremacy: Beyond the discourse of ’white privilege’
Zeus Leonardo. 2004 · 2004
Earlier work this paper cites.
When does equality matter?
Thomas Scanlon. 2004 · 2004
Earlier work this paper cites.
Values at Play: Design Tradeoffs in Socially-oriented Game Design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’05) . ACM, New York, NY, USA, 751–760
Mary Flanagan, Daniel C. Howe, and Helen Nissenbaum. 2005 · 2005
Earlier work this paper cites.
Between chaos and routine: Boundary negotiating artifacts in collaboration. In ECSCW 2005 . Springer, 387–406
Charlotte P Lee. 2005 · 2005
Earlier work this paper cites.
Values in technical design
Helen Nissenbaum. 2005 · 2005
Earlier work this paper cites.
Fairness and philosophy
Alan Ryan. 2006 · 2006
Earlier work this paper cites.
Embodying values in technology: Theory and practice
Mary Flanagan, Daniel C Howe, and Helen Nissenbaum. 2008 · 2008
Earlier work this paper cites.
Value Sensitive Design and Information Systems
Batya Friedman, Peter H. Kahn, and Alan Borning. 2008 · 2008
Earlier work this paper cites.
When is discrimination wrong?
Deborah Hellman. 2008 · 2008
Earlier work this paper cites.
Does unconscious racial bias affect trial judges
Jeffrey J Rachlinski, Sheri Lynn Johnson, Andrew J Wistrich, and Chris Guthrie. 2008 · 2008
Earlier work this paper cites.
Collaboration in metagenomics: Sequence databases and the organization of scientific work
Matthew J Bietz and Charlotte P Lee. 2009 · 2009
Earlier work this paper cites.
Toward information infrastructure studies: Ways of knowing in a networked environment
Geoffrey C Bowker, Karen Baker, Florence Millerand, and David Ribes. 2009 · 2009
Earlier work this paper cites.

Similar

Introduction to algorithms
Thomas H Cormen, Charles E Leiserson, Ronald L Rivest, and Clifford Stein. 2009 · 2009
Cited alongside, same era.
Values as lived experience: Evolving value sensitive design in support of value discovery. In Proceedings of the 27th international conference on Human factors in computing systems - CHI 09 . ACM Press, New York, New York, USA, 1141
Christopher A. Le Dantec, Erika Shehan Poole, and Susan P. Wyche. 2009 · 2009
Cited alongside, same era.
A theory of justice
John Rawls. 2009 · 2009
Cited alongside, same era.
International handbook of internet research
Jeremy Hunsinger, Lisbeth Klastrup, and Matthew Allen. 2010 · 2010
Cited alongside, same era.
How to analyze political attention with minimal assumptions and costs
Kevin M Quinn, Burt L Monroe, Michael Colaresi, Michael H Crespin, and Dragomir R Radev. 2010 · 2010
Cited alongside, same era.
Values in design
Cory Knobel and Geoffrey C. Bowker. 2011 · 2011
Cited alongside, same era.
Fairness through awareness. In Proceedings of the 3rd innovations in theoretical computer science conference . ACM, 214–226
Cynthia Dwork, Moritz Hardt, Toniann Pitassi, Omer Reingold, and Richard Zemel. 2012 · 2012
Cited alongside, same era.
Can I be a Luck Egalitarian and a Rawlsian?
Patrick Tomlin. 2012 · 2012
Cited alongside, same era.
RFC 6973: Privacy considerations for Internet protocols
Alissa Cooper, Hannes Tschofenig, Bernard Aboba, Jon Peterson, J. Morris, Marit Hansen, and Rhys Smith. 2013 · 2013
Cited alongside, same era.
Taking rights seriously
Ronald Dworkin. 2013 · 2013
Cited alongside, same era.
The Workshop on Fairness, Accountability, and Transparency in Machine Learning (FAT/ML)
fatml Since 2014 · 2014
Cited alongside, same era.
From critical design to critical infrastructure
Lilly Irani and M. Six Silberman. 2014 · 2014
Cited alongside, same era.

Then

State v. Loomis
Law Review Editors. 2017 · 2017
Later among the works it cites.
Algorithmic Mediation in Group Decisions: Fairness Perceptions of Algorithmically Mediated vs. Discussion-Based Social Division. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW ’17) . ACM, New York, NY, USA, 1035–1048
Min Kyung Lee and Su Baykal. 2017 · 2017
Later among the works it cites.
Does mitigating ML’s impact disparity require treatment disparity?
Original
Zachary C Lipton, Alexandra Chouldechova, and Julian McAuley. 2017 · 2017
Later among the works it cites.
Data Vision: Learning to See Through Algorithmic Abstraction. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW ’17 . ACM Press, New York, New York, USA, 2436–2447
Samir Passi and Steven Jackson. 2017 · 2017
Later among the works it cites.
Algorithms as culture: Some tactics for the ethnography of algorithmic systems
Nick Seaver. 2017 · 2017
Later among the works it cites.
A not quite random walk: Experimenting with the ethnomethods of the algorithm
Malte Ziewitz. 2017 · 2017
Later among the works it cites.
Interventions over predictions: Reframing the ethical debate for actuarial risk assessment
Chelsea Barabas, Karthik Dinakar, Joichi Ito Virza, Jonathan Zittrain, et al · 2018
Later among the works it cites.
Fairness in criminal justice risk assessments: The state of the art
Richard Berk, Hoda Heidari, Shahin Jabbari, Michael Kearns, and Aaron Roth. 2018 · 2018
Later among the works it cites.
’It’s Reducing a Human Being to a Percentage’: Perceptions of Justice in Algorithmic Decisions. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems . ACM, 377
Reuben Binns, Max Van Kleek, Michael Veale, Ulrik Lyngs, Jun Zhao, and Nigel Shadbolt. 2018 · 2018
Later among the works it cites.
Automated decision-making on the basis of personal data that has been transferred from the EU to companies certified under the EU-U.S. Privacy Shield: Fact-finding and assessment of safeguards provided by U.S. law
Gabriela Bodea, Kristina Karanikolova, Deirdre K. Mulligan, and Jael Makagon. 2018 · 2018
Later among the works it cites.
Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on Fairness, Accountability and Transparency . 77–91
Joy Buolamwini and Timnit Gebru. 2018 · 2018
Later among the works it cites.
A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions. In Conference on Fairness, Accountability and Transparency . 134–148
Alexandra Chouldechova, Diana Benavides-Prado, Oleksandr Fialko, and Rhema Vaithianathan. 2018 · 2018
Later among the works it cites.
Using Behavioral Science to Improve Criminal Justice Outcomes
Brice Cooke, Binta Zahra Diop, Alissa Fishbane, Jonathan Hayes, Aurelie Ouss, and Anuj Shah. 2018 · 2018
Later among the works it cites.
The measure and mismeasure of fairness: A critical review of fair machine learning
Original
Sam Corbett-Davies and Sharad Goel. 2018 · 2018
Later among the works it cites.
The impact of algorithms on judicial discretion: Evidence from regression discontinuities
Bo Cowgill. 2018 · 2018
Later among the works it cites.
The accuracy, fairness, and limits of predicting recidivism
Julia Dressel and Hany Farid. 2018 · 2018
Later among the works it cites.
Automating inequality: How high-tech tools profile, police, and punish the poor
Virginia Eubanks. 2018 · 2018
Later among the works it cites.
The ACM Conference on Fairness, Accountability, and Transparency (FAT ∗ )
fat Since 2018 · 2018
Later among the works it cites.
Fairness in Machine Learning: Limitations and Opportunities
Moritz Hardt, Solon Barocas, and Arvind Narayanan. 2018 · 2018
Later among the works it cites.
The Disparate Effects of Strategic Manipulation
Original
Lily Hu, Nicole Immorlica, and Jennifer Wortman Vaughan. 2018 · 2018
Later among the works it cites.
Measurement and Fairness
Abigail Z. Jacobs and Hanna Wallach. 2018 · 2018
Later among the works it cites.
The Misgendering Machines: Trans/HCI Implications of Automatic Gender Recognition
Os Keyes. 2018 · 2018
Later among the works it cites.
Report from the First AFOG Summer Workshop
Daniel Kluttz, Jenna Burrell, Deirdre Mulligan, Joshua A. Kroll, Amit Elazari, and Andrew Smart. 2018 · 2018
Later among the works it cites.
Eddie Murphy and the Dangers of Counterfactual Causal Thinking About Detecting Racial Discrimination
Issa Kohler-Hausmann. 2018 · 2018
Later among the works it cites.
Epsilon Voting: Mechanism Design for Parameter Selection in Differential Privacy. In 2018 IEEE Symposium on Privacy-Aware Computing (PAC) . IEEE, 19–30
Nitin Kohli and Paul Laskowski. 2018 · 2018
Later among the works it cites.
Common Pitfalls for Studying the Human Side of Machine Learning
Joshua A. Kroll, Nitin Kohli, and Deirdre Mulligan. 2018 · 2018
Later among the works it cites.
The Social Cost of Strategic Classification
Original
Smitha Milli, John Miller, Anca D Dragan, and Moritz Hardt. 2018 · 2018
Later among the works it cites.
Prediction-Based Decisions and Fairness: A Catalogue of Choices, Assumptions, and Definitions
Shira Mitchell, Eric Potash, and Solon Barocas. 2018 · 2018
Later among the works it cites.
Mirror, Mirror: Reflections on Quantitative Fairness
Shira Mitchell and Jackie Shadlen. 2018 · 2018
Later among the works it cites.
Saving Governance-by-Design
Deirdre K Mulligan and Kenneth A Bamberger. 2018 · 2018
Later among the works it cites.
21 Definitions of Fairness and Their Politics
Arvind Narayanan. 2018 · 2018
Later among the works it cites.
Mayor de Blasio Announces First-In-Nation Task Force To Examine Automated Decision Systems Used By The City
New York City Press Office. 2018 · 2018
Later among the works it cites.
Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science Projects
Samir Passi and Steven J Jackson. 2018 · 2018
Later among the works it cites.
A systematic review of provenance systems
Beatriz Pérez, Julio Rubio, and Carlos Sáenz-Adán. 2018 · 2018
Later among the works it cites.
Values and Ethics in Human-Computer Interaction
Katie Shilton. 2018 · 2018
Later among the works it cites.
Assessing risk assessment in action
Megan Stevenson. 2018 · 2018
Later among the works it cites.
Fairness definitions explained. In 2018 IEEE/ACM International Workshop on Software Fairness (FairWare) . IEEE, 1–7
Sahil Verma and Julia Rubin. 2018 · 2018
Later among the works it cites.
The Changing Contours of "Participation" in Data-driven, Algorithmic Ecosystems: Challenges, Tactics, and an Agenda. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW ’18 . ACM Press, New York, New York, USA, 377–384
Christine T Wolf, Haiyi Zhu, Julia Bullard, Min Kyung Lee, and Jed R Brubaker. 2018 · 2018
Later among the works it cites.
Value-Sensitive Algorithm Design: Method, Case Study, and Lessons
Haiyi Zhu, Bowen Yu, Aaron Halfaker, and Loren Terveen. 2018 · 2018
Later among the works it cites.
Machine Learning Risk Assessments in Criminal Justice Settings
Richard Berk. 2019 · 2019
Closest in time.
Judicial Council Funds 16 Pretrial Pilot Programs
California Judicial Council. 2019 · 2019
Closest in time.
The Accuracy, Equity, and Jurisprudence of Criminal Risk Assessment
Sharad Goel, Ravi Shroff, Jennifer L Skeem, and Christopher Slobogin. 2019 · 2019
Closest in time.
Disparate interactions: An algorithm-in-the-loop analysis of fairness in risk assessments. In Proceedings of the Conference on Fairness, Accountability, and Transparency . ACM, 90–99
Ben Green and Yiling Chen. 2019 · 2019
Closest in time.
Improving fairness in machine learning systems: What do industry practitioners need?. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems . ACM, 600
Kenneth Holstein, Jennifer Wortman Vaughan, Hal Daumé III, Miro Dudik, and Hanna Wallach. 2019 · 2019
Closest in time.
Conceptions, Definitions, and Practices of Fair, Transparent, and Accountable AI
Joshua A. Kroll and Emmanuel Moss. 2019 · 2019
Closest in time.
Report on Algorithmic Risk Assessment Tools in the U.S. Criminal Justice System
Partnership on AI. 2019 · 2019
Closest in time.
Fairness and abstraction in sociotechnical systems. In Proceedings of the Conference on Fairness, Accountability, and Transparency . ACM, 59–68
Andrew D Selbst, Danah Boyd, Sorelle A Friedler, Suresh Venkatasubramanian, and Janet Vertesi. 2019 · 2019
Closest in time.
The Institutional Life of Algorithmic Risk Assessment
Alicia Solow-Niederman, YooJung Choi, and Guy Van den Broeck. 2019 · 2019
Closest in time.
A right to reasonable inferences: re-thinking data protection law in the age of big data and AI
Sandra Wachter and Brent Mittelstadt. 2019 · 2019
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…