Alex-U 2023 NLP at WojoodNER shared task: AraBINDER (Bi-encoder for Arabic Named Entity Recognition)

Mariam Hussein, Sarah Khaled, Marwan Torki, Nagwa El-Makky

Abstract
Named Entity Recognition (NER) is a crucial task in natural language processing that facilitates the extraction of vital information from text. However, NER for Arabic presents a significant challenge due to the language’s unique characteristics. In this paper, we introduce AraBINDER, our submission to the Wojood NER Shared Task 2023 (ArabicNLP 2023). The shared task comprises two sub-tasks: sub-task 1 focuses on Flat NER, while sub-task 2 centers on Nested NER. We have participated in both sub-tasks. The Bi-Encoder has proven its efficiency for NER in English. We employ AraBINDER (Arabic Bi-Encoder for Named Entity Recognition), which uses the power of two transformer encoders and employs contrastive learning to map candidate text spans and entity types into the same vector representation space. This approach frames NER as a representation learning problem that maximizes the similarity between the vector representations of an entity mention and its type. Our experiments reveal that AraBINDER achieves a micro F-1 score of 0.918 for Flat NER and 0.9 for Nested NER on the Wojood dataset.
Anthology ID:
2023.arabicnlp-1.90
Volume:
Proceedings of ArabicNLP 2023
Month:
December
Year:
2023
Address:
Singapore (Hybrid)
Editors:
Hassan Sawaf, Samhaa El-Beltagy, Wajdi Zaghouani, Walid Magdy, Ahmed Abdelali, Nadi Tomeh, Ibrahim Abu Farha, Nizar Habash, Salam Khalifa, Amr Keleg, Hatem Haddad, Imed Zitouni, Khalil Mrini, Rawan Almatham
Venues:
ArabicNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
797–802
Language:
URL:
https://aclanthology.org/2023.arabicnlp-1.90
DOI:
10.18653/v1/2023.arabicnlp-1.90
Bibkey:
Cite (ACL):
Mariam Hussein, Sarah Khaled, Marwan Torki, and Nagwa El-Makky. 2023. Alex-U 2023 NLP at WojoodNER shared task: AraBINDER (Bi-encoder for Arabic Named Entity Recognition). In Proceedings of ArabicNLP 2023, pages 797–802, Singapore (Hybrid). Association for Computational Linguistics.
Cite (Informal):
Alex-U 2023 NLP at WojoodNER shared task: AraBINDER (Bi-encoder for Arabic Named Entity Recognition) (Hussein et al., ArabicNLP-WS 2023)
Copy Citation:
PDF:
https://preview.aclanthology.org/improve-issue-templates/2023.arabicnlp-1.90.pdf
Video:
 https://preview.aclanthology.org/improve-issue-templates/2023.arabicnlp-1.90.mp4
PDF Search Video