Toward Fairness in Speech Recognition: Discovery and mitigation of performance disparities

J. Cohen, “A coefficient of agreement for nominal scales,” Educational and psychological measurement , vol. 20, no. 1, pp. 37–46, 1960

1960

Earlier work this paper cites.

A. Sen and J. Foster, On Economic Inequality . Oxford University Press, 1997

1997

Earlier work this paper cites.

M. L. Glenn, S. M. Strassel, H. Lee, K. Maeda, R. Zakhary, and X. Li, “Transcription methods for consistency, volume and efficiency,” in Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC’10) . Valletta, Malta: European Language Resources Association (ELRA), May 2010. [Online]. Available: http://www.lrec-conf.org/proceedings/lrec2010/pdf/849_Paper.pdf

2010

Earlier work this paper cites.

A. Graves, “Sequence transduction with recurrent neural networks,” CoRR , vol. abs/1211.3711, 2012. [Online]. Available: http://arxiv.org/abs/1211.3711

Original

2012

Earlier work this paper cites.

A. Graves, A. Mohamed, and G. E. Hinton, “Speech recognition with deep recurrent neural networks,” in Proc. IEEE ICASSP , 2013. [Online]. Available: http://arxiv.org/abs/1303.5778

Original

2013

Earlier work this paper cites.

A. Stolcke and J. Droppo, “Comparing Human and Machine Errors in Conversational Speech Transcription,” in Proc. Interspeech 2017 , 2017, pp. 137–141

2017

Earlier work this paper cites.

M. J. Kusner, J. Loftus, C. Russell, and R. Silva, “Counterfactual fairness,” Advances in Neural Information Processing Systems , vol. 30, 2017

2017

Earlier work this paper cites.

J. Buolamwini and T. Gebru, “Gender shades: Intersectional accuracy disparities in commercial gender classification,” in Proceedings of the 1st Conference on Fairness, Accountability and Transparency , ser. Proceedings of Machine Learning Research, S. A. Friedler and C. Wilson, Eds., vol. 81. PMLR, 23–24 Feb 2018, pp. 77–91. [Online]. Available: https://proceedings.mlr.press/v81/buolamwini18a.html

2018

Earlier work this paper cites.

L. Wan, Q. Wang, A. Papir, and I. L. Moreno, “Generalized end-to-end loss for speaker verification,” in Proc. IEEE ICASSP , 2018, pp. 4879–4883

2018

Cited alongside, same era.

M. Grace, M. Bastani, and E. Weinstein, “Occam’s adaptation: A comparison of interpolation of bases adaptation methods for multi-dialect acoustic modeling with LSTMS,” in Proc. IEEE Spoken Language Technology Workshop (SLT) , 2018, pp. 174–181

2018

Cited alongside, same era.

T. De Vries, I. Misra, C. Wang, and L. Van der Maaten, “Does object recognition work for everyone?” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops , 2019, pp. 52–59

2019

Cited alongside, same era.

J. P. Bajorek, “Voice recognition still has significant race and gender biases,” Harvard Business Review , May 2019. [Online]. Available: https://hbr.org/2019/05/voice-recognition-still-has-significant-race-and-gender-biases/

2019

Cited alongside, same era.

P. P. Liang, I. M. Li, E. Zheng, Y. C. Lim, R. Salakhutdinov, and L.-P. Morency, “Towards debiasing sentence representations,” arXiv preprint arXiv:2007.08100 , 2020

Original

2020

Later among the works it cites.

A. Koenecke, A. Nam, E. Lake, J. Nudell, M. Quartey, Z. Mengesha, C. Toups, J. R. Rickford, D. Jurafsky, and S. Goel, “Racial disparities in automated speech recognition,” Proceedings of the National Academy of Sciences , vol. 117, no. 14, pp. 7684–7689, 2020. [Online]. Available: https://www.pnas.org/doi/abs/10.1073/pnas.1915768117

2020

Later among the works it cites.

N. Mehrabi, F. Morstatter, N. Saxena, K. Lerman, and A. Galstyan, “A survey on bias and fairness in machine learning,” ACM Comput. Surv. , vol. 54, no. 6, jul 2021. [Online]. Available: https://doi.org/10.1145/3457607

2021

Later among the works it cites.

Y. Pruksachatkun, S. Krishna, J. Dhamala, R. Gupta, and K.-W. Chang, “Does robustness improve fairness? Approaching fairness with word substitution robustness methods for text classification,” arXiv preprint arXiv:2106.10826 , 2021