Fetching the paper…

Reading the bibliography…

2020

Measuring Social Biases of Crowd Workers using Counterfactual Queries

Ghai, Bhavya, Liao, Q. Vera, Zhang, Yunfeng et al.

Original
PDF
Post on X

Understand

Social biases based on gender, race, etc.

have been shown to pollute machine learning (ML) pipeline predominantly via biased training datasets.
Crowdsourcing, a popular cost-effective measure to gather labeled training datasets, is not immune to the inherent social biases of crowd workers.
To ensure such social biases aren't passed onto the curated datasets, it's important to know how biased each crowd worker is.

Measuring Social Biases of Crowd Workers using Counterfactual Queries · Around

Built on

Social-desirability bias and the validity of self-reported values
Robert J Fisher and James E Katz. 2000 · 2000
Earlier work this paper cites.
Men also like shopping: Reducing gender bias amplification using corpus-level constraints
Original
Jieyu Zhao, Tianlu Wang, Mark Yatskar, Vicente Ordonez, and Kai-Wei Chang. 2017 · 2004
Earlier work this paper cites.

Similar

Weapons of math destruction: How big data increases inequality and threatens democracy
Cathy O’neil. 2016 · 2016
Cited alongside, same era.
A meta-analysis of procedures to change implicit measures
Patrick S Forscher, Calvin K Lai, Jordan R Axt, Charles R Ebersole, Michelle Herman, Patricia G Devine, and Brian A Nosek. 2019 · 2019
Cited alongside, same era.

Then

Counterfactual fairness in text classification through robustness. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society
Sahaj Garg, Vincent Perot, Nicole Limtiaco, Ankur Taly, Ed H Chi, and Alex Beutel. 2019 · 2019
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…