Fetching the paper…
Reading the bibliography…
AI audits are an increasingly popular mechanism for algorithmic accountability; however, they remain poorly defined.
Proposal for a Regulation of the European Parliament and of the Council on a Single Market For Digital Services (Digital Services Act) and amending Directive 2000/31/EC
European Commission. 2020 · 2000
Earlier work this paper cites.
Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditing
Inioluwa Deborah Raji, Timnit Gebru, Margaret Mitchell, Joy Buolamwini, Joonseok Lee, and Emily Denton. 2020 · 2001
Earlier work this paper cites.
Auditing Algorithms : Research Methods for Detecting Discrimination on Internet Platforms. In “Data and Discrimination: Converting Critical Concerns into Productive Inquiry,” a preconference at the 64th Annual Meeting of the International Communication Association (Seattle, WA, USA)
Christian Sandvig, Kevin Hamilton, Karrie Karahalios, and Cédric Langbort. 2014 · 2014
Earlier work this paper cites.
Big Data’s Disparate Impact
Solon Barocas and Andrew D. Selbst. 2016 · 2016
Earlier work this paper cites.
Accountability in Algorithmic Decision Making
Nicholas Diakopoulos. 2016 · 2016
Earlier work this paper cites.
How We Analyzed the COMPAS Recidivism Algorithm
Jeff Larson, Surya Mattu, Lauren Kirchner, and Julia Angwin. 2016 · 2016
Earlier work this paper cites.
Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation)
European Parliament. 2016 · 2016
Earlier work this paper cites.
The Sharing Economy in Computing: A Systematic Literature Review
Tawanna R. Dillahunt, Xinyi Wang, Earnest Wheeler, Hao Fei Cheng, Brent Hecht, and Haiyi Zhu. 2017 · 2017
Earlier work this paper cites.
Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency (Proceedings of Machine Learning Research, Vol. 81) , Sorelle A. Friedler and Christo Wilson (Eds.). PMLR, 77–91
Joy Buolamwini and Timnit Gebru. 2018 · 2018
Earlier work this paper cites.
Amazon scraps secret AI recruiting tool that showed bias against women
Jeffrey Dastin. 2018 · 2018
Earlier work this paper cites.
Just 35 Percent of Responding Organizations Are GDPR-compliant With EU Data Privacy Rules
Deloitte. 2018 · 2018
Earlier work this paper cites.
Social Media Monitoring in Boston: Free Speech in the Crosshairs
Nasser Eledroos and Kade Crockford. 2018 · 2018
Earlier work this paper cites.
Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor
Virginia Eubanks. 2018 · 2018
Earlier work this paper cites.
Algorithmic Impact Assessments: A Practical Framework for Public Agency
Dillon Reisman, Jason Schultz, Kate Crawford, and Meredith Whittaker. 2018 · 2018
Earlier work this paper cites.
Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Making
Michael Veale, Max Van Kleek, and Reuben Binns. 2018 · 2018
Earlier work this paper cites.
A bill to direct the Federal Trade Commission to require entities that use, store, or share personal information to conduct automated decision system impact assessments and data protection impact assessments
Congress.gov. 2019 · 2019
Earlier work this paper cites.
Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need?
Kenneth Holstein, Jennifer Wortman Vaughan, Hal Daumé, Miro Dudik, and Hanna Wallach. 2019 · 2019
Earlier work this paper cites.
NYC’s algorithm task force was ‘a waste,’ member says
Colin Lecher. 2019 · 2019
Earlier work this paper cites.
Dissecting racial bias in an algorithm used to manage the health of populations
Ziad Obermeyer, Brian Powers, Christine Vogeli, and Sendhil Mullainathan. 2019 · 2019
Earlier work this paper cites.
Actionable Auditing: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society (Honolulu, HI, USA) (AIES ’19) . Association for Computing Machinery, New York, NY, USA, 429–435
Inioluwa Deborah Raji and Joy Buolamwini. 2019 · 2019
Earlier work this paper cites.
The Role and Limits of Principles in AI Ethics: Towards a Focus on Tensions. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society (Honolulu, HI, USA) (AIES ’19) . Association for Computing Machinery, New York, NY, USA, 195–200
Jess Whittlestone, Rune Nyrup, Anna Alexandrova, and Stephen Cave. 2019 · 2019
Earlier work this paper cites.
Federal court rules ‘big data’ discrimination studies do not violate federal anti-hacking law
ACLU. 2020 · 2020
Earlier work this paper cites.
Controversial Detroit facial recognition got him arrested for a crime he didn’t commit
Elisha Anderson. 2020 · 2020
Earlier work this paper cites.
Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims
Miles Brundage, Shahar Avin, Jasmine Wang, Haydn Belfield, Gretchen Krueger, Gillian Hadfield, Heidy Khlaaf, Jingying Yang, Helen Toner, Ruth Fong, Tegan Maharaj, Pang Wei Koh, Sara Hooker, Jade Leung, Andrew Trask, Emma Bluemke, Jonathan Lebensold, Cullen O’Keefe, Mark Koren, Théo Ryffel, JB Rubinovitz, Tamay Besiroglu, Federica Carugati, Jack Clark, Peter Eckersley, Sarah de Haas, Maritza Johnson, Ben Laurie, Alex Ingerman, Igor Krawczuk, Amanda Askell, Rosario Cammarota, Andrew Lohn, David Krueger, Charlotte Stix, Peter Henderson, Logan Graham, Carina Prunkl, Bianca Martin, Elizabeth Seger, Noa Zilberman, Seán Ó hÉigeartaigh, Frens Kroeger, Girish Sastry, Rebecca Kagan, Adrian Weller, Brian Tse, Elizabeth Barnes, Allan Dafoe, Paul Scharre, Ariel Herbert-Voss, Martijn Rasser, Shagun Sodhani, Carrick Flynn, Thomas Krendl Gilbert, Lisa Dyer, Saif Khan, Yoshua Bengio, and Markus Anderljung. 2020 · 2020
Cited alongside, same era.
Design Justice: Community-Led Practices to Build the Worlds We Need
Sasha Costanza-Chock. 2020 · 2020
Cited alongside, same era.
Home Office says it will abandon its racist visa algorithm - after we sued them
Foxglove. 2020 · 2020
Cited alongside, same era.
Defining AI in Policy versus Practice
P. M. Krafft, Meg Young, Michael Katell, Karen Huang, and Ghislain Bugingo. 2020 · 2020
Cited alongside, same era.
The Secret Bias Hidden in Mortgage-Approval Algorithms
Emmanuel Martinez and Lauren Kirchner. 2021 · 2021
Later among the works it cites.
Algorithmic Impact Assessments and Accountability: The Co-Construction of Impacts. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (Virtual Event, Canada) (FAccT ’21) . Association for Computing Machinery, New York, NY, USA, 735–746
Jacob Metcalf, Emanuel Moss, Elizabeth Anne Watkins, Ranjit Singh, and Madeleine Clare Elish. 2021 · 2021
Later among the works it cites.
NIST Evaluates Face Recognition Software’s Accuracy for Flight Boarding
NIST. 2021 · 2021
Later among the works it cites.
Facebook’s five pillars of Responsible AI
Jerome Pesenti. 2021 · 2021
Later among the works it cites.
Essential Work: Analyzing the Hiring Technologies of Large Hourly Employers
Aaron Rieke, Urmila Janardan, Mingwei Hsu, and Natasha Duarte. 2021 · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Access Now resigns from the Partnership on AI
Access Now. 2020 · 2020
Cited alongside, same era.
Europe’s Privacy Law Hasn’t Shown Its Teeth, Frustrating Advocates
Adam Satariano. 2020 · 2020
Cited alongside, same era.
How an Algorithm Blocked Kidney Transplants to Black Patients
Tim Simonite. 2020 · 2020
Cited alongside, same era.
An update on our work on AI and responsible innovation
Kent Walker and Jeff Dean. 2020 · 2020
Cited alongside, same era.
Putting AI ethics to work: are the tools fit for purpose?
Jacqui Ayling and Adriane Chapman. 2021 · 2021
Cited alongside, same era.
Problematic Machine Behavior: A Systematic Literature Review of Algorithm Audits
Jack Bandy. 2021 · 2021
Cited alongside, same era.
Designing Disaggregated Evaluations of AI Systems: Choices, Considerations, and Tradeoffs
Solon Barocas, Anhong Guo, Ece Kamar, Jacquelyn Krones, Meredith Ringel Morris, Jennifer Wortman Vaughan, W. Duncan Wadsworth, and Hanna Wallach. 2021 · 2021
Cited alongside, same era.
The algorithm audit: Scoring the algorithms that score us
Shea Brown, Jovana Davidovic, and Ali Hasan. 2021 · 2021
Cited alongside, same era.
Facebook’s WhatsApp is fined for breaking the E.U.’s data privacy law
Adam Satariano. 2021 · 2021
Later among the works it cites.
Auditors are testing hiring algorithms for bias, but there’s no easy fix
Hilke Schellmann. 2021 · 2021
Later among the works it cites.
Algorithmic Auditing and Social Justice: Lessons from the History of Audit Studies
Briana Vecchione, Karen Levy, and Solon Barocas. 2021 · 2021
Later among the works it cites.
Introducing our Responsible Machine Learning Initiative
Jutta Williams and Rumman Chowdhury. 2021 · 2021
Later among the works it cites.
Building and Auditing Fair Algorithms: A Case Study in Candidate Screening (FAccT ’21) . Association for Computing Machinery, New York, NY, USA, 666–677
Christo Wilson, Avijit Ghosh, Shan Jiang, Alan Mislove, Lewis Baker, Janelle Szary, Kelly Trindel, and Frida Polli. 2021 · 2021
Later among the works it cites.
Image Cropping on Twitter: Fairness Metrics, Their Limitations, and the Importance of Representation, Design, and Agency
Kyra Yee, Uthaipon Tantipongpipat, and Shubhanshu Mishra. 2021 · 2021
Later among the works it cites.
Facing the Coded Gaze with Evocative Audits and Algorithmic Audits
Joy Buolamwini. 2022 · 2022
Later among the works it cites.
College Prep Software Naviance Is Selling Advertising Access to Millions of Students
Todd Feathers. 2022 · 2022
Later among the works it cites.
IATA Operational Safety Audit (IOSA)
IATA. [n. d.] · 2022
Later among the works it cites.
Dodd–Frank Wall Street Reform and Consumer Protection Act
Cornell Law School Legal Information Institute. [n. d.]a · 2022
Later among the works it cites.
Sarbanes-Oxley Act
Cornell Law School Legal Information Institute. [n. d.]b · 2022
Later among the works it cites.
Securities Act of 1933
Cornell Law School Legal Information Institute. [n. d.]c · 2022
Later among the works it cites.
Bug Bounties For Algorithmic Harms? Lessons from Cybersecurity Vulnerability Disclosure for Algorithmic Harms Discovery, Disclosure, and Redress
Josh Kenway, Camille François, Sasha Costanza-Chock, Inioluwa Deborah Raji, and Joy Buolamwini. 2022 · 2022
Later among the works it cites.
FATE: Fairness, Accountability, Transparency, and Ethics in AI
Microsoft. [n. d.] · 2022
Later among the works it cites.
Food Service Establishment: Last Inspection
New York State Department of Health. 2022 · 2022
Later among the works it cites.
Change From the Outside: Towards Credible Third-Party Audits of AI Systems
Inioluwa Deborah Raji, Sasha Costanza-Chock, and Joy Buolamwini. 2022 · 2022
Later among the works it cites.
Open letter to FAccT steering committee
FAccT Researchers. 2022 · 2022
Later among the works it cites.