FanarGuard: A Culturally-Aware Moderation Filter for Arabic Language Models

Masoomali Fatehkia, Enes Altinisik, Husrev Taha Sencar


Abstract
Content moderation filters are a critical safeguard against alignment failures in language models. Yet most existing filters focus narrowly on general safety and overlook cultural context. In this work, we introduce FanarGuard, a bilingual moderation filter that evaluates both safety and cultural alignment in Arabic and English. We construct a dataset of over 468K prompt and response pairs, drawn from synthetic and public datasets, scored by a panel of LLM judges on harmlessness and cultural awareness, and use it to train two filter variants.To rigorously evaluate cultural alignment, we further develop the first benchmark targeting Arabic cultural contexts, comprising over 1K norm-sensitive prompts with LLM-generated responses annotated by human raters. Results show that FanarGuard achieves stronger agreement with human annotations than inter-annotator reliability, while matching the performance of state-of-the-art filters on safety benchmarks. These findings highlight the importance of integrating cultural awareness into moderation and establish FanarGuard as a practical step toward more context-sensitive safeguards.
Anthology ID:
2026.eacl-long.368
Volume:
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Vera Demberg, Kentaro Inui, Lluís Marquez
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7848–7869
Language:
URL:
https://preview.aclanthology.org/ingest-eacl/2026.eacl-long.368/
DOI:
Bibkey:
Cite (ACL):
Masoomali Fatehkia, Enes Altinisik, and Husrev Taha Sencar. 2026. FanarGuard: A Culturally-Aware Moderation Filter for Arabic Language Models. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7848–7869, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
FanarGuard: A Culturally-Aware Moderation Filter for Arabic Language Models (Fatehkia et al., EACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-eacl/2026.eacl-long.368.pdf