How to Detect Online Hate towards Migrants and Refugees? Developing and Evaluating a Classifier of Racist and Xenophobic Hate Speech Using Shallow and Deep Learning

• Published in: Sustainability 2022-10, Vol.14 (20), p.13094
• Main Authors: Arcila-Calderón, Carlos, Amores, Javier J, Sánchez-Holgado, Patricia, Vrysis, Lazaros, Vryzas, Nikolaos, Oller Alonso, Martín
• Format: Article
• Language: English
• Subjects: Audiences; Datasets; Deep learning; Discrimination; Displaced persons; Evaluation; Hate crimes; Hate speech; Immigration; Internet; Machine learning; Neural networks; Prototypes; Racism; Social media; Social networks; Social science research; Statistics; Sustainability; Technology application; Xenophobia
• ISSN: 2071-1050; 2071-1050
• DOI: 10.3390/su142013094

Hate speech spreading online is a matter of growing concern since social media allows for its rapid, uncontrolled, and massive dissemination. For this reason, several researchers are already working on the development of prototypes that allow for the detection of cyberhate automatically and on a large scale. However, most of them are developed to detect hate only in English, and very few focus specifically on racism and xenophobia, the category of discrimination in which the most hate crimes are recorded each year. In addition, ad hoc datasets manually generated by several trained coders are rarely used in the development of these prototypes since almost all researchers use already available datasets. The objective of this research is to overcome the limitations of those previous works by developing and evaluating classification models capable of detecting racist and/or xenophobic hate speech being spread online, first in Spanish, and later in Greek and Italian. In the development of these prototypes, three differentiated machine learning strategies are tested. First, various traditional shallow learning algorithms are used. Second, deep learning is used, specifically, an ad hoc developed RNN model. Finally, a BERT-based model is developed in which transformers and neural networks are used. The results confirm that deep learning strategies perform better in detecting anti-immigration hate speech online. It is for this reason that the deep architectures were the ones finally improved and tested for hate speech detection in Greek and Italian and in multisource. The results of this study represent an advance in the scientific literature in this field of research, since up to now, no online anti-immigration hate detectors had been tested in these languages and using this type of deep architecture.