DCU at SemEval-2023 Task 10: A Comparative Analysis of Encoder-only and Decoder-only Language Models with Insights into Interpretability
Kanishk Verma, Kolawole Adebayo, Joachim Wagner, Brian Davis
Abstract
We conduct a comparison of pre-trained encoder-only and decoder-only language models with and without continued pre-training, to detect online sexism. Our fine-tuning-based classifier system achieved the 16th rank in the SemEval 2023 Shared Task 10 Subtask A that asks to distinguish sexist and non-sexist texts. Additionally, we conduct experiments aimed at enhancing the interpretability of systems designed to detect online sexism. Our findings provide insights into the features and decision-making processes underlying our classifier system, thereby contributing to a broader effort to develop explainable AI models to detect online sexism.- Anthology ID:
- 2023.semeval-1.241
- Volume:
- Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
- Month:
- July
- Year:
- 2023
- Address:
- Toronto, Canada
- Editors:
- Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
- Venue:
- SemEval
- SIG:
- SIGLEX
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1736–1750
- Language:
- URL:
- https://preview.aclanthology.org/jlcl-multiple-ingestion/2023.semeval-1.241/
- DOI:
- 10.18653/v1/2023.semeval-1.241
- Cite (ACL):
- Kanishk Verma, Kolawole Adebayo, Joachim Wagner, and Brian Davis. 2023. DCU at SemEval-2023 Task 10: A Comparative Analysis of Encoder-only and Decoder-only Language Models with Insights into Interpretability. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 1736–1750, Toronto, Canada. Association for Computational Linguistics.
- Cite (Informal):
- DCU at SemEval-2023 Task 10: A Comparative Analysis of Encoder-only and Decoder-only Language Models with Insights into Interpretability (Verma et al., SemEval 2023)
- PDF:
- https://preview.aclanthology.org/jlcl-multiple-ingestion/2023.semeval-1.241.pdf