A Dataset of Hindi-English Code-Mixed Social Media Text for Hate Speech Detection
Aditya Bohra, Deepanshu Vijay, Vinay Singh, Syed Sarfaraz Akhtar, Manish Shrivastava
Abstract
Hate speech detection in social media texts is an important Natural language Processing task, which has several crucial applications like sentiment analysis, investigating cyberbullying and examining socio-political controversies. While relevant research has been done independently on code-mixed social media texts and hate speech detection, our work is the first attempt in detecting hate speech in Hindi-English code-mixed social media text. In this paper, we analyze the problem of hate speech detection in code-mixed texts and present a Hindi-English code-mixed dataset consisting of tweets posted online on Twitter. The tweets are annotated with the language at word level and the class they belong to (Hate Speech or Normal Speech). We also propose a supervised classification system for detecting hate speech in the text using various character level, word level, and lexicon based features.- Anthology ID:
- W18-1105
- Volume:
- Proceedings of the Second Workshop on Computational Modeling of People’s Opinions, Personality, and Emotions in Social Media
- Month:
- June
- Year:
- 2018
- Address:
- New Orleans, Louisiana, USA
- Editors:
- Malvina Nissim, Viviana Patti, Barbara Plank, Claudia Wagner
- Venue:
- PEOPLES
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 36–41
- Language:
- URL:
- https://aclanthology.org/W18-1105
- DOI:
- 10.18653/v1/W18-1105
- Cite (ACL):
- Aditya Bohra, Deepanshu Vijay, Vinay Singh, Syed Sarfaraz Akhtar, and Manish Shrivastava. 2018. A Dataset of Hindi-English Code-Mixed Social Media Text for Hate Speech Detection. In Proceedings of the Second Workshop on Computational Modeling of People’s Opinions, Personality, and Emotions in Social Media, pages 36–41, New Orleans, Louisiana, USA. Association for Computational Linguistics.
- Cite (Informal):
- A Dataset of Hindi-English Code-Mixed Social Media Text for Hate Speech Detection (Bohra et al., PEOPLES 2018)
- PDF:
- https://preview.aclanthology.org/ml4al-ingestion/W18-1105.pdf
- Data
- HSD