Imen Jarraya
2025
Palm: A Culturally Inclusive and Linguistically Diverse Dataset for Arabic LLMs
Fakhraddin Alwajih | Abdellah El Mekki | Samar Mohamed Magdy | AbdelRahim A. Elmadany | Omer Nacar | El Moatez Billah Nagoudi | Reem Abdel-Salam | Hanin Atwany | Youssef Nafea | Abdulfattah Mohammed Yahya | Rahaf Alhamouri | Hamzah A. Alsayadi | Hiba Zayed | Sara Shatnawi | Serry Sibaee | Yasir Ech-chammakhy | Walid Al-Dhabyani | Marwa Mohamed Ali | Imen Jarraya | Ahmed Oumar El-Shangiti | Aisha Alraeesi | Mohammed Anwar AL-Ghrawi | Abdulrahman S. Al-Batati | Elgizouli Mohamed | Noha Taha Elgindi | Muhammed Saeed | Houdaifa Atou | Issam Ait Yahia | Abdelhak Bouayad | Mohammed Machrouh | Amal Makouar | Dania Alkawi | Mukhtar Mohamed | Safaa Taher Abdelfadil | Amine Ziad Ounnoughene | Anfel Rouabhia | Rwaa Assi | Ahmed Sorkatti | Mohamedou Cheikh Tourad | Anis Koubaa | Ismail Berrada | Mustafa Jarrar | Shady Shehata | Muhammad Abdul-Mageed
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Fakhraddin Alwajih | Abdellah El Mekki | Samar Mohamed Magdy | AbdelRahim A. Elmadany | Omer Nacar | El Moatez Billah Nagoudi | Reem Abdel-Salam | Hanin Atwany | Youssef Nafea | Abdulfattah Mohammed Yahya | Rahaf Alhamouri | Hamzah A. Alsayadi | Hiba Zayed | Sara Shatnawi | Serry Sibaee | Yasir Ech-chammakhy | Walid Al-Dhabyani | Marwa Mohamed Ali | Imen Jarraya | Ahmed Oumar El-Shangiti | Aisha Alraeesi | Mohammed Anwar AL-Ghrawi | Abdulrahman S. Al-Batati | Elgizouli Mohamed | Noha Taha Elgindi | Muhammed Saeed | Houdaifa Atou | Issam Ait Yahia | Abdelhak Bouayad | Mohammed Machrouh | Amal Makouar | Dania Alkawi | Mukhtar Mohamed | Safaa Taher Abdelfadil | Amine Ziad Ounnoughene | Anfel Rouabhia | Rwaa Assi | Ahmed Sorkatti | Mohamedou Cheikh Tourad | Anis Koubaa | Ismail Berrada | Mustafa Jarrar | Shady Shehata | Muhammad Abdul-Mageed
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
As large language models (LLMs) become increasingly integrated into daily life, ensuring their cultural sensitivity and inclusivity is paramount. We introduce PALM, a year-long community-driven project covering all 22 Arab countries. The dataset contains instruction–response pairs in both Modern Standard Arabic (MSA) and dialectal Arabic (DA), spanning 20 diverse topics. Built by a team of 44 researchers across the Arab world—each an author of this paper—PALM offers a broad, inclusive perspective. We use PALM to evaluate the cultural and dialectal capabilities of several frontier LLMs, revealing notable limitations: while closed-source LLMs generally perform strongly, they still exhibit flaws, and smaller open-source models face greater challenges. Furthermore, certain countries (e.g., Egypt, the UAE) appear better represented than others (e.g., Iraq, Mauritania, Yemen). Our annotation guidelines, code, and data are publicly available for reproducibility. More information about PALM is available on our project page: https://github.com/UBC-NLP/palm.
Search
Fix author
Co-authors
- Mohammed Anwar AL-Ghrawi 1
- Reem Abdel-Salam 1
- Safaa Taher Abdelfadil 1
- Muhammad Abdul-Mageed 1
- Abdulrahman S. Al-Batati 1
- Walid Al-Dhabyani 1
- Rahaf Alhamouri 1
- Marwa Mohamed Ali 1
- Dania Alkawi 1
- Aisha Alraeesi 1
- Hamzah A. Alsayadi 1
- Fakhraddin Alwajih 1
- Rwaa Assi 1
- Houdaifa Atou 1
- Hanin Atwany 1
- Ismail Berrada 1
- Abdelhak Bouayad 1
- Yasir Ech-chammakhy 1
- Abdellah El Mekki 1
- Ahmed Oumar El-Shangiti 1
- Noha Taha Elgindi 1
- AbdelRahim A. Elmadany 1
- Mustafa Jarrar 1
- Anis Koubaa 1
- Mohammed Machrouh 1
- Samar Mohamed Magdy 1
- Amal Makouar 1
- Elgizouli Mohamed 1
- Mukhtar Mohamed 1
- Omer Nacar 1
- Youssef Nafea 1
- El-Moatez-Billah Nagoudi 1
- Amine Ziad Ounnoughene 1
- Anfel Rouabhia 1
- Muhammed Saeed 1
- Sara Shatnawi 1
- Shady Shehata 1
- Serry Sibaee 1
- Ahmed Sorkatti 1
- Mohamedou Cheikh Tourad 1
- Issam Ait Yahia 1
- Abdulfattah Mohammed Yahya 1
- Hiba Zayed 1
Venues
- acl1