2018

Hate Speech Dataset from a White Supremacy Forum

de Gibert, Ona, Perez, Naiara, García-Pablos, Aitor et al.

Understand

Hate speech is commonly defined as any communication that disparages a target group of people based on some characteristic such as race, colour, ethnicity, gender, sexual orientation, nationality, religion, or other characteristic.

Due to the massive rise of user-generated web content on social media, the amount of hate speech is also steadily increasing.
Over the past years, interest in online hate speech detection and, particularly, the automation of this task has continuously grown, along with the societal impact of the phenomenon.
This paper describes a hate speech dataset composed of thousands of sentences manually labelled as containing hate speech or not.

Built on

A Coefficient of Agreement for Nominal Scales
J. Cohen. 1960 · 1960
Earlier work this paper cites.
Measuring nominal scale agreement among many raters
J. L. Fleiss. 1971 · 1971
Earlier work this paper cites.
Long Short-term Memory
S. Hochreiter and J. Schmidhuber. 1997 · 1997
Earlier work this paper cites.
Support vector machines
M. A. Hearst, S. T. Dumais, E. Osuna, J. Platt, and B. Scholkopf. 1998 · 1998
Earlier work this paper cites.
Hate speech
J. T. Nockleby. 2000 · 2000
Earlier work this paper cites.
Spinning the web of hate: Web-based hate propagation by extremist organizations
Joseph A Schafer. 2002 · 2002
Earlier work this paper cites.
Hate Speech or “Reasonable Racism?” The Other in Stormfront
P. M. Meddaugh and J. Kay. 2009 · 2009
Earlier work this paper cites.
Detecting Hate Speech on the World Wide Web
W. Warner and J. Hirschberg. 2012 · 2012
Earlier work this paper cites.
Locate the Hate: Detecting Tweets against Blacks
I. Kwok and Y. Wang. 2013 · 2013
Earlier work this paper cites.
IXA pipeline: Efficient and Ready to Use Multilingual NLP tools
R. Agerri, J. Bermudez, and G. Rigau. 2014 · 2014
Earlier work this paper cites.
Convolutional Neural Networks for Sentence Classification
Y. Kim. 2014 · 2014
Earlier work this paper cites.

Similar

Cyber hate speech on twitter: An application of machine classification and statistical modeling for policy and decision making
P. Burnap and M. L. Williams. 2015 · 2015
Cited alongside, same era.
Hate Speech Detection with Comment Embeddings
N. Djuric, J. Zhou, R. Morris, M. Grbovic, V. Radosavljevic, and N. Bhamidipati. 2015 · 2015
Cited alongside, same era.
A Lexicon-based Approach for Hate Speech Detection
N. D. Gitari, Z. Zuping, H. Damien, and J. Long. 2015 · 2015
Cited alongside, same era.
Measuring online affects in a white supremacy forum
L. Figea, L. Kaati, and R. Scrivens. 2016 · 2016
Cited alongside, same era.
Abusive Language Detection in Online User Content
C. Nobata, J. Tetreault, A. Thomas, Y. Mehdad, and Y. Chang. 2016 · 2016
Cited alongside, same era.
Measuring the reliability of hate speech annotations: The case of the european refugee crisis
B. Ross, M. Rist, G. Carbonell, B. Cabrera, N. Kurowsky, and M. Wojatzki. 2016 · 2016
Cited alongside, same era.
A Web of Hate: Tackling Hateful Speech in Online Social Spaces
H. M. Saleem, K. P. Dillon, S. Benesch, and D. Ruths. 2016 · 2016
Cited alongside, same era.
Analyzing the Targets of Hate in Online Social Media
L. Silva, M. Mondal, D. Correa, F. Benevenuto, and I. Weber. 2016 · 2016
Cited alongside, same era.
Are You a Racist or Am I Seeing Things? Annotator Influence on Hate Speech Detection on Twitter
Z. Waseem. 2016 · 2016
Cited alongside, same era.
Deep Learning for Hate Speech Detection in Tweets
P. Badjatiya, S. Gupta, M. Gupta, and V. Varma. 2017 · 2017
Cited alongside, same era.
Automated Hate Speech Detection and the Problem of Offensive Language
T. Davidson, D. Warmsley, M. Macy, and I. Weber. 2017 · 2017
Cited alongside, same era.

Then

Hate me, hate me not: Hate speech detection on Facebook
F. Del Vigna, A. Cimino, F. Dell’Orletta, M. Petrocchi, and M. Tesconi. 2017 · 2017
Later among the works it cites.
Using convolutional neural networks to classify hate-speech
B. Gambäck and U. K. Sikdar. 2017 · 2017
Later among the works it cites.
LSTM: A Search Space Odyssey
K. Greff, R. K Srivastava, J. Koutník, B. R. Steunebrink, and J. Schmidhuber. 2017 · 2017
Later among the works it cites.
Detecting Hate Speech in Social Media
S. Malmasi and M. Zampieri. 2017 · 2017
Later among the works it cites.
A Survey on Hate Speech Detection using Natural Language Processing
A. Schmidt and M. Wiegand. 2017 · 2017
Later among the works it cites.
Class-based prediction errors to detect hate speech with out-of-vocabulary words
J. Serra, I. Leontiadis, D. Spathis, J. Blackburn, G. Stringhini, and A. Vakali. 2017 · 2017
Later among the works it cites.
Challenges in discriminating profanity from hate speech
S. Malmasi and M. Zampieri. 2018 · 2018
Closest in time.
Degree based Classification of Harmful Speech using Twitter Data
Original
S. Sharma, S. Agrawal, and M. Shrivastava. 2018 · 2018
Closest in time.
Hateful Symbols or Hateful People? Predictive Features for Hate Speech Detection on Twitter
Z. Waseem and D. Hovy. 2016 · 2018
Closest in time.
Hate Speech on Twitter: A Pragmatic Approach to Collect Hateful and Offensive Expressions and Perform Hate Speech Detection
H. Watanabe, M. Bouazizi, and T. Ohtsuki. 2018 · 2018
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…