Fetching the paper…
Reading the bibliography…
The potential for machine learning (ML) systems to amplify social inequities and unfairness is receiving increasing popular and academic attention.
Contextual inquiry: A participatory technique for system design
Karen Holtzblatt and Sandra Jones. 1993 · 1993
Earlier work this paper cites.
Bias in computer systems
Batya Friedman and Helen Nissenbaum. 1996 · 1996
Earlier work this paper cites.
Pasteur’s quadrant: Basic science and technological innovation
Donald E Stokes. 1997 · 1997
Earlier work this paper cites.
MAKEBELIEVE: Using commonsense knowledge to generate stories. In Proceedings of the Fourteenth Innovative Applications of Artificial Intelligence Conference (IAAI 2002) . 957–958
Hugo Liu and Push Singh. 2002 · 2002
Earlier work this paper cites.
Test-driven development concepts, taxonomy, and future direction
David Janzen and Hossein Saiedian. 2005 · 2005
Earlier work this paper cites.
Developing a generalizable detector of when students game the system
Ryan SJd Baker, Albert T Corbett, Ido Roll, and Kenneth R Koedinger. 2008 · 2008
Earlier work this paper cites.
Beat the machine: Challenging workers to find the unknown unknowns
Josh Attenberg, Panagiotis G Ipeirotis, and Foster J Provost. 2011 · 2011
Earlier work this paper cites.
Fairness through awareness. In Proceedings of the Third Innovations in Theoretical Computer Science Conference (ITCS 2012) . ACM, 214–226
Cynthia Dwork, Moritz Hardt, Toniann Pitassi, Omer Reingold, and Richard Zemel. 2012 · 2012
Earlier work this paper cites.
Universal methods of design: 100 ways to research complex problems, develop innovative ideas, and design effective solutions
Bruce Hanington and Bella Martin. 2012 · 2012
Earlier work this paper cites.
Personality-targeted gamification: A survey study on personality traits and motivational affordances. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI 2016) . ACM, 2001–2013
Yuan Jia, Bin Xu, Yamini Karanam, and Stephen Voida. 2016 · 2013
Earlier work this paper cites.
Qualtrics
Qualtrics. 2013 · 2013
Earlier work this paper cites.
Structured labeling for facilitating concept evolution in machine learning. In Proceedings of the 2014 CHI Conference on Human Factors in Computing Systems (CHI 2014) . ACM, 3075–3084
Todd Kulesza, Saleema Amershi, Rich Caruana, Danyel Fisher, and Denis Charles. 2014 · 2014
Earlier work this paper cites.
ModelTracker: Redesigning performance analysis tools for machine learning. In Proceedings of the 2015 CHI Conference on Human Factors in Computing Systems (CHI 2015) . ACM, 337–346
Saleema Amershi, Max Chickering, Steven M Drucker, Bongshin Lee, Patrice Simard, and Jina Suh. 2015 · 2015
Earlier work this paper cites.
Test-driven machine learning
Justin Bozonier. 2015 · 2015
Earlier work this paper cites.
Identifying and accounting for task-dependent bias in crowdsourcing. In Third AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2015)
Ece Kamar, Ashish Kapoor, and Eric Horvitz. 2015 · 2015
Earlier work this paper cites.
Unequal representation and gender stereotypes in image search results for occupations. In Proceedings of the 2015 CHI Conference on Human Factors in Computing Systems (CHI 2015) . ACM, 3819–3828
Matthew Kay, Cynthia Matuszek, and Sean A Munson. 2015 · 2015
Earlier work this paper cites.
Principles of explanatory debugging to personalize interactive machine learning. In Proceedings of the 20th International Conference on Intelligent User Interfaces (IUI 2015) . ACM, 126–137
Todd Kulesza, Margaret Burnett, Weng-Keen Wong, and Simone Stumpf. 2015 · 2015
Earlier work this paper cites.
Shift-pessimistic active learning using robust bias-aware prediction. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2015) . 2764–2770
Anqi Liu, Lev Reyzin, and Brian D Ziebart. 2015 · 2015
Earlier work this paper cites.
Understanding user beliefs about algorithmic curation in the Facebook news feed. In Proceedings of the 2015 CHI Conference on Human Factors in Computing Systems (CHI 2015) . ACM, 173–182
Emilee Rader and Rebecca Gray. 2015 · 2015
Earlier work this paper cites.
Hidden technical debt in machine learning systems. In Advances in Neural Information Processing Systems (NeurIPS 2015) . 2503–2511
D. Sculley, Gary Holt, Daniel Golovin, Eugene Davydov, Todd Phillips, Dietmar Ebner, Vinay Chaudhary, Michael Young, Jean-Francois Crespo, and Dan Dennison. 2015 · 2015
Earlier work this paper cites.
Machine bias: There’s software used across the country to predict future criminals, and it’s biased against blacks
Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016 · 2016
Earlier work this paper cites.
Big data’s disparate impact
Solon Barocas and Andrew D Selbst. 2016 · 2016
Earlier work this paper cites.
Man is to computer programmer as woman is to homemaker? Debiasing word embeddings. In Advances in Neural Information Processing Systems (NeurIPS 2016) . 4349–4357
Tolga Bolukbasi, Kai-Wei Chang, James Y Zou, Venkatesh Saligrama, and Adam T Kalai. 2016 · 2016
Earlier work this paper cites.
Detecting student emotions in computer-enabled classrooms. In Proceedings of the 2016 International Joint Conference on Artificial Intelligence (IJCAI 2016) . 4125–4129
Nigel Bosch, Sidney K D’Mello, Ryan S Baker, Jaclyn Ocumpaugh, Valerie Shute, Matthew Ventura, Lubin Wang, and Weinan Zhao. 2016 · 2016
Earlier work this paper cites.
Equality of opportunity in supervised learning. In Advances in Neural Information Processing Systems (NeurIPS 2016) . 3315–3323
Moritz Hardt, Eric Price, Nati Srebro, et al · 2016
Earlier work this paper cites.
Directions in hybrid intelligence: Complementing AI systems with human intelligence.. In Proceedings of the 2016 International Joint Conference on Artificial Intelligence (IJCAI 2016) . 4070–4073
Ece Kamar. 2016 · 2016
Earlier work this paper cites.
Inherent trade-offs in the fair determination of risk scores
Jon Kleinberg, Sendhil Mullainathan, and Manish Raghavan. 2016 · 2016
Earlier work this paper cites.
How we analyzed the COMPAS recidivism algorithm
Jeff Larson, Surya Mattu, Lauren Kirchner, and Julia Angwin. 2016 · 2016
Earlier work this paper cites.
To predict and serve?
Kristian Lum and William Isaac. 2016 · 2016
Earlier work this paper cites.
The Apprentice Learner architecture: Closing the loop between learning theory and educational data.. In Proceedings of the 2016 International Conference on Educational Data Mining (EDM 2016) . 151–158
Christopher J Maclellan, Erik Harpstead, Rony Patel, and Kenneth R Koedinger. 2016 · 2016
Earlier work this paper cites.
Bias in grading: A meta-analysis of experimental research findings
John M Malouff and Einar B Thorsteinsson. 2016 · 2016
Earlier work this paper cites.
Investigating the heart pump implant decision process: Opportunities for decision support tools to help. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI 2016) . ACM, 4477–4488
Qian Yang, John Zimmerman, Aaron Steinfeld, Lisa Carey, and James F Antaki. 2016 · 2016
Earlier work this paper cites.
The algorithmic imaginary: Exploring the ordinary affects of Facebook algorithms
Taina Bucher. 2017 · 2017
Earlier work this paper cites.
Revolt: Collaborative crowdsourcing for labeling machine learning datasets. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI 2017) . ACM, 2334–2346
Joseph Chee Chang, Saleema Amershi, and Ece Kamar. 2017 · 2017
Earlier work this paper cites.
Fair prediction with disparate impact: A study of bias in recidivism prediction instruments
Alexandra Chouldechova. 2017 · 2017
Earlier work this paper cites.
UX design innovation: Challenges for working with machine learning as a design material. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI 2017) . ACM, 278–288
Graham Dove, Kim Halskov, Jodi Forlizzi, and John Zimmerman. 2017 · 2017
Earlier work this paper cites.
Dermatologist-level classification of skin cancer with deep neural networks
Andre Esteva, Brett Kuprel, Roberto A Novoa, Justin Ko, Susan M Swetter, Helen M Blau, and Sebastian Thrun. 2017 · 2017
Earlier work this paper cites.
Algorithmic accountability
World Wide Web Foundation. 2017 · 2017
Earlier work this paper cites.
Fairness testing: Testing software for discrimination. In Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering (FSE 2017) . ACM, 498–510
Sainyam Galhotra, Yuriy Brun, and Alexandra Meliou. 2017 · 2017
Cited alongside, same era.
Scalable annotation of fine-grained categories without experts. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI 2017) . ACM, 1877–1881
Timnit Gebru, Jonathan Krause, Jia Deng, and Li Fei-Fei. 2017 · 2017
Cited alongside, same era.
Intelligent tutors as teachers’ aides: Exploring teacher needs for real-time analytics in blended classrooms. In Proceedings of the Seventh International Learning Analytics and Knowledge Conference (LAK 2017) . ACM, 257–266
Kenneth Holstein, Bruce M McLaren, and Vincent Aleven. 2017 · 2017
Cited alongside, same era.
Counterfactual fairness. In Advances in Neural Information Processing Systems (NeurIPS 2017) . 4066–4076
Matt J Kusner, Joshua Loftus, Chris Russell, and Ricardo Silva. 2017 · 2017
Cited alongside, same era.
Video interview software for recruiting & hiring
HireVue.com. 2018 · 2018
Closest in time.
The classroom as a dashboard: Co-designing wearable cognitive augmentation for K-12 teachers. In Proceedings of the Eighth International Conference on Learning Analytics and Knowledge (LAK 2018) . ACM, 79–88
Kenneth Holstein, Gena Hong, Mera Tegene, Bruce M McLaren, and Vincent Aleven. 2018a · 2018
Closest in time.
Student learning benefits of a mixed-reality teacher awareness tool in AI-enhanced classrooms. In Proceedings of the International Conference on Artificial Intelligence in Education (AIED 2018) . Springer, 154–168
Kenneth Holstein, Bruce M McLaren, and Vincent Aleven. 2018b · 2018
Closest in time.
AI Now Institute
AI Now Institute. 2018 · 2018
Closest in time.
A user simulator architecture for socially-aware conversational agents. In Proceedings of the 18th International Conference on Intelligent Virtual Agents (IVA 2018) . ACM, 133–140
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Identifying Unknown Unknowns in the Open World: Representations and Policies for Guided Exploration.. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2017)
Himabindu Lakkaraju, Ece Kamar, Rich Caruana, and Eric Horvitz. 2017 · 2017
Cited alongside, same era.
Algorithmic mediation in group decisions: Fairness perceptions of algorithmically mediated vs. discussion-based social division. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work (CSCW 2017) . 1035–1048
Min Kyung Lee and Su Baykal. 2017 · 2017
Cited alongside, same era.
On human intellect and machine failures: Troubleshooting integrative machine learning systems. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2017) . 1017–1025
Besmira Nushi, Ece Kamar, Eric Horvitz, and Donald Kossmann. 2017 · 2017
Cited alongside, same era.
Google DeepMind and healthcare in an age of algorithms
Julia Powles and Hal Hodson. 2017 · 2017
Cited alongside, same era.
Flash organizations: Crowdsourcing complex work by structuring crowds as organizations. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI 2017) . ACM, 3523–3537
Melissa A Valentine, Daniela Retelny, Alexandra To, Negar Rahmati, Tulsee Doshi, and Michael S Bernstein. 2017 · 2017
Cited alongside, same era.
Fairer machine learning in the real world: Mitigating discrimination without collecting sensitive data
Michael Veale and Reuben Binns. 2017 · 2017
Cited alongside, same era.
ACM Conference on Fairness, Accountability, and Transparency (ACM FAT*)
ACM. 2018a · 2018
Cited alongside, same era.
A reductions approach to fair classification. In Proceedings of the Thirty-fifth International Conference on Machine Learning (ICML 2018)
Alekh Agarwal, Alina Beygelzimer, Miroslav Dudík, John Langford, and Hanna Wallach. 2018 · 2018
Cited alongside, same era.
Alankar Jain, Florian Pecune, Yoichi Matsuyama, and Justine Cassell. 2018 · 2018
Closest in time.
Residual unfairness in fair machine learning from prejudiced data
Nathan Kallus and Angela Zhou. 2018 · 2018
Closest in time.
The story in the notebook: Exploratory data science using a literate programming tool. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI 2018) . ACM, 174
Mary Beth Kery, Marissa Radensky, Mahima Arya, Bonnie E John, and Brad A Myers. 2018 · 2018
Closest in time.
Blind justice: Fairness with encrypted sensitive attributes
Niki Kilbertus, Adrià Gascón, Matt J Kusner, Michael Veale, Krishna P Gummadi, and Adrian Weller. 2018 · 2018
Closest in time.
Understanding perception of algorithmic decisions: Fairness, trust, and emotion in response to algorithmic management
Min Kyung Lee. 2018 · 2018
Closest in time.
Delayed impact of fair machine learning
Lydia T Liu, Sarah Dean, Esther Rolf, Max Simchowitz, and Moritz Hardt. 2018 · 2018
Closest in time.
Accenture wants to beat unfair AI with a professional toolkit
Natasha Lomas. 2018a · 2018
Closest in time.
IBM launches cloud tool to detect AI bias and explain automated decisions
Natasha Lomas. 2018b · 2018
Closest in time.
Sloppiness mitigation in crowdsourcing: detecting and correcting bias for crowd scoring tasks
Lingyu Lyu, Mehmed Kantardzic, and Tegjyot Singh Sethi. 2018 · 2018
Closest in time.
MURAL - Make remote design work
MURAL. 2018 · 2018
Closest in time.
21 fairness definitions and their politics
Arvind Narayanan. 2018 · 2018
Closest in time.
Algorithms of oppression: How search engines reinforce racism
Safiya Umoja Noble. 2018 · 2018
Closest in time.
Family Educational Rights and Privacy Act (FERPA)
US Department of Education (ED). 2018 · 2018
Closest in time.
The Partnership on AI
Partnership on AI. 2018 · 2018
Closest in time.
matching talent to opportunity
pymetrics. 2018 · 2018
Closest in time.
The externalities of exploration and how data diversity helps exploitation. In Proceedings of the Thirty-first Annual Conference on Learning Theory (COLT 2018)
Manish Raghavan, Aleksandrs Slivkins, Jennifer Wortman Vaughan, and Zhiwei Steven Wu. 2018 · 2018
Closest in time.
Algorithmic impact assessments: A practical framework for public agency accountability
Dillon Reisman, Jason Schultz, K Crawford, and M Whittaker. 2018 · 2018
Closest in time.
Let’s talk about race: Identity, chatbots, and AI. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI 2018) . ACM, 315
Ari Schlesinger, Kenton P O’Hara, and Alex S Taylor. 2018 · 2018
Closest in time.
Fairness and abstraction in sociotechnical systems. In ACM Conference on Fairness, Accountability, and Transparency (FAT* 2018)
Andrew D Selbst, danah boyd, Sorelle Friedler, Suresh Venkatasubramanian, and Janet Vertesi. 2019 · 2018
Closest in time.
Algorithmic accountability: A primer
Data & Society. 2018 · 2018
Closest in time.
Assessing and addressing algorithmic bias—But before we get there. In Proceedings of the AAAI 2018 Spring Symposium: Designing the User Experience of Artificial Intelligence
Aaron Springer, J. Garcia-Gathright, and Henriette Cramer. 2018 · 2018
Closest in time.
Investigating Human+Machine Complementarity for Recidivism Predictions
Sarah Tan, Julius Adebayo, Kori Inkpen, and Ece Kamar. 2018 · 2018
Closest in time.
IBM secretly used NYPD CCTV footage to train its facial recognition systems
Rob Thubron. 2018 · 2018
Closest in time.
From needs to aspirations in information technology for development
Kentaro Toyama. 2018 · 2018
Closest in time.
Making better use of the crowd
Jennifer Wortman Vaughan. 2018 · 2018
Closest in time.
Fairness and accountability design needs for algorithmic support in high-stakes public sector decision-making. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI 2018) . ACM, 440
Michael Veale, Max Van Kleek, and Reuben Binns. 2018 · 2018
Closest in time.
AI recruiting tools do not eliminate bias
Sara Wachter-Boettcher. 2017 · 2018
Closest in time.
A qualitative exploration of perceptions of algorithmic fairness. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI 2018) . ACM, 656
Allison Woodruff, Sarah E Fox, Steven Rousso-Schindler, and Jeffrey Warshaw. 2018 · 2018
Closest in time.
Machine learning as a UX design material: How can we imagine beyond automation, recommenders, and reminders?. In Proceedings of the AAAI 2018 Spring Symposium: Designing the User Experience of Artificial Intelligence
Qian Yang. 2018 · 2018
Closest in time.
Grounding interactive machine learning tool design in how non-experts actually build models. In Proceedings of the 2018 Conference on Designing Interactive Systems (DIS 2018) . ACM, 573–584
Qian Yang, Jina Suh, Nan-Chen Chen, and Gonzalo Ramos. 2018 · 2018
Closest in time.
Google photos tags two African-Americans as gorillas through facial recognition software
Maggie Zhang. 2015 · 2018
Closest in time.
Socially-conditioned task reasoning for a virtual tutoring agent. In Proceedings of the Seventeenth International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2018) . 2265–2267
Zian Zhao, Michael Madaio, Florian Pecune, Yoichi Matsuyama, and Justine Cassell. 2018 · 2018
Closest in time.
Translation, tracks and data: Algorithmic bias in practice
Henriette Cramer, Jean Garcia-Gathright, Sravana Reddy, Aaron Springer, and Romain Takeo. In press · 2019
Closest in time.