Abstract
We present our team ‘3Idiots’ (referred as ‘sdhanshu’ in the official rankings) approach for the Trolling, Aggression and Cyberbullying (TRAC) 2020 shared tasks. Our approach relies on fine-tuning various Transformer models on the different datasets. We also investigated the utility of task label marginalization, joint label classification, and joint training on multilingual datasets as possible improvements to our models. Our team came second in English sub-task A, a close fourth in the English sub-task B and third in the remaining 4 sub-tasks. We find the multilingual joint training approach to be the best trade-off between computational efficiency of model deployment and model’s evaluation performance. We open source our approach at https://github.com/socialmediaie/TRAC2020.- Anthology ID:
- 2020.trac-1.19
- Volume:
- Proceedings of the Second Workshop on Trolling, Aggression and Cyberbullying
- Month:
- May
- Year:
- 2020
- Address:
- Marseille, France
- Editors:
- Ritesh Kumar, Atul Kr. Ojha, Bornini Lahiri, Marcos Zampieri, Shervin Malmasi, Vanessa Murdock, Daniel Kadar
- Venue:
- TRAC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 120–125
- Language:
- English
- URL:
- https://aclanthology.org/2020.trac-1.19
- DOI:
- Cite (ACL):
- Sudhanshu Mishra, Shivangi Prasad, and Shubhanshu Mishra. 2020. Multilingual Joint Fine-tuning of Transformer models for identifying Trolling, Aggression and Cyberbullying at TRAC 2020. In Proceedings of the Second Workshop on Trolling, Aggression and Cyberbullying, pages 120–125, Marseille, France. European Language Resources Association (ELRA).
- Cite (Informal):
- Multilingual Joint Fine-tuning of Transformer models for identifying Trolling, Aggression and Cyberbullying at TRAC 2020 (Mishra et al., TRAC 2020)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2020.trac-1.19.pdf
- Code
- socialmediaie/TRAC2020