Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Models

Understand

Hate speech detection models are typically evaluated on held-out test sets.

• However, this risks painting an incomplete and potentially misleading picture of model performance because of increasingly well-documented systematic gaps and biases in hate speech datasets.
• To enable more targeted diagnostic insights, recent research has thus introduced functional tests for hate speech detection models.
• However, these tests currently only exist for English-language content, which means that they cannot support the development of more effective models in other languages spoken by billions across the world.