The AdabEval 2026 Shared Task on Arabic Politeness Detection
Reem Fahad Alqifari, Hend Al-Khalifa, Nadia Ghezaiel, Maria Bounnit, Hend Hamed Alhazmi, Ameera Masoud Almasoud, Sharefah Ahmed Al-Ghamdi, Noof Abdullah Alfear
Abstract
We present an overview of the AdabEval 2026 shared task, organized as part of the OSACT7 workshop (co-located with LREC 2026). This task introduces the first benchmark suite for politeness detection. It includes two subtasks: Politeness Classification (Subtask A) and Category Prediction (Subtask B). The task focuses on evaluating models’ ability to recognize and categorize politeness phenomena in Arabic text. Evaluation was conducted using an automatic metric (macro F1-score). A total of 28 unique teams participated in the shared task. Of these, 13 teams submitted final system predictions across the two subtasks. The top-performing systems relied primarily on transformer-based architectures. The winning systems achieved macro F1-scores of 0.89 for Subtask A and 0.58 for Subtask B.- Anthology ID:
- 2026.osact-1.17
- Volume:
- The 7th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT7) with 5 Shared Tasks
- Month:
- May
- Year:
- 2026
- Address:
- Palma, Mallorca (Spain)
- Editors:
- Hend Al-Khalifa, Mo El-Haj, Saad Ezzini
- Venues:
- OSACT | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 151–156
- Language:
- External URL:
- https://lrec.elra.info/lrec2026-ws-osact-17
- DOI:
- 10.63317/3sbqjqbib67c
- Cite (ACL):
- Reem Fahad Alqifari, Hend Al-Khalifa, Nadia Ghezaiel, Maria Bounnit, Hend Hamed Alhazmi, Ameera Masoud Almasoud, Sharefah Ahmed Al-Ghamdi, and Noof Abdullah Alfear. 2026. The AdabEval 2026 Shared Task on Arabic Politeness Detection. In The 7th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT7) with 5 Shared Tasks, pages 151–156, Palma, Mallorca (Spain). Association for Computational Linguistics.
- Cite (Informal):
- The AdabEval 2026 Shared Task on Arabic Politeness Detection (Alqifari et al., OSACT 2026)