HateCheckHIn: Evaluating Hindi Hate Speech Detection Models

Understand

Due to the sheer volume of online hate, the AI and NLP communities have started building models to detect such hateful content.

• Recently, multilingual hate is a major emerging challenge for automated detection where code-mixing or more than one language have been used for conversation in social media.
• Typically, hate speech detection models are evaluated by measuring their performance on the held-out test data using metrics such as accuracy and F1-score.
• While these metrics are useful, it becomes difficult to identify using them where the model is failing, and how to resolve it.