Abstract
This research explores the effectiveness of using pre-trained language models (PLMs) as feature extractors for Arabic stance detection on social media, focusing on topics like women empowerment, COVID-19 vaccination, and digital transformation. By leveraging sentence transformers to extract embeddings and incorporating aggregation architectures on top of BERT, we aim to achieve high performance without the computational expense of fine-tuning. Our approach demonstrates significant resource and time savings while maintaining competitive performance, scoring an F1-score of 78.62 on the test set. This study highlights the potential of PLMs in enhancing stance detection in Arabic social media analysis, offering a resource-efficient alternative to traditional fine-tuning methods.- Anthology ID:
- 2024.arabicnlp-1.89
- Volume:
- Proceedings of The Second Arabic Natural Language Processing Conference
- Month:
- August
- Year:
- 2024
- Address:
- Bangkok, Thailand
- Editors:
- Nizar Habash, Houda Bouamor, Ramy Eskander, Nadi Tomeh, Ibrahim Abu Farha, Ahmed Abdelali, Samia Touileb, Injy Hamed, Yaser Onaizan, Bashar Alhafni, Wissam Antoun, Salam Khalifa, Hatem Haddad, Imed Zitouni, Badr AlKhamissi, Rawan Almatham, Khalil Mrini
- Venues:
- ArabicNLP | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 783–787
- Language:
- URL:
- https://aclanthology.org/2024.arabicnlp-1.89
- DOI:
- Cite (ACL):
- Omar Galal and Abdelrahman Kaseb. 2024. Team_Zero at StanceEval2024: Frozen PLMs for Arabic Stance Detection. In Proceedings of The Second Arabic Natural Language Processing Conference, pages 783–787, Bangkok, Thailand. Association for Computational Linguistics.
- Cite (Informal):
- Team_Zero at StanceEval2024: Frozen PLMs for Arabic Stance Detection (Galal & Kaseb, ArabicNLP-WS 2024)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2024.arabicnlp-1.89.pdf