Hate Speech Classifiers Learn Human-Like Social Stereotypes

Understand

Social stereotypes negatively impact individuals' judgements about different groups and may have a critical role in how people understand language directed toward minority social groups.

• Here, we assess the role of social stereotypes in the automated detection of hateful language by examining the relation between individual annotator biases and erroneous classification of texts by hate speech classifiers.
• Specifically, in Study 1 we investigate the impact of novice annotators' stereotypes on their hate-speech-annotation behavior.
• In Study 2 we examine the effect of language-embedded stereotypes on expert annotators' aggregated judgements in a large annotated corpus.