GMNLP at SemEval-2023 Task 12: Sentiment Analysis with Phylogeny-Based Adapters
Md Mahfuz Ibn Alam, Ruoyu Xie, Fahim Faisal, Antonios Anastasopoulos
Abstract
This report describes GMU’s sentiment analysis system for the SemEval-2023 shared task AfriSenti-SemEval. We participated in all three sub-tasks: Monolingual, Multilingual, and Zero-Shot. Our approach uses models initialized with AfroXLMR-large, a pre-trained multilingual language model trained on African languages and fine-tuned correspondingly. We also introduce augmented training data along with original training data. Alongside finetuning, we perform phylogeny-based adapter-tuning to create several models and ensemble the best models for the final submission. Our system achieves the best F1-score on track 5: Amharic, with 6.2 points higher F1-score than the second-best performing system on this track. Overall, our system ranks 5th among the 10 systems participating in all 15 tracks.- Anthology ID:
- 2023.semeval-1.163
- Volume:
- Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
- Month:
- July
- Year:
- 2023
- Address:
- Toronto, Canada
- Editors:
- Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
- Venue:
- SemEval
- SIG:
- SIGLEX
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1172–1182
- Language:
- URL:
- https://aclanthology.org/2023.semeval-1.163
- DOI:
- 10.18653/v1/2023.semeval-1.163
- Cite (ACL):
- Md Mahfuz Ibn Alam, Ruoyu Xie, Fahim Faisal, and Antonios Anastasopoulos. 2023. GMNLP at SemEval-2023 Task 12: Sentiment Analysis with Phylogeny-Based Adapters. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 1172–1182, Toronto, Canada. Association for Computational Linguistics.
- Cite (Informal):
- GMNLP at SemEval-2023 Task 12: Sentiment Analysis with Phylogeny-Based Adapters (Alam et al., SemEval 2023)
- PDF:
- https://preview.aclanthology.org/ingest-bitext-workshop/2023.semeval-1.163.pdf