Abstract
With the fast pace of reporting around the globe from various sources, event extraction has increasingly become an important task in NLP. The use of pre-trained language models (PTMs) has become popular to provide contextual representation for downstream tasks. This work aims to pre-train language models that enhance event extraction accuracy. To this end, we propose an Event-Based Knowledge (EBK) masking approach to mask the most significant terms in the event detection task. These significant terms are based on an external knowledge source that is curated for the purpose of event detection for the Arabic language. The proposed approach improves the classification accuracy of all the 9 event types. The experimental results demonstrate the effectiveness of the proposed masking approach and encourage further exploration.- Anthology ID:
- 2022.wanlp-1.25
- Volume:
- Proceedings of the Seventh Arabic Natural Language Processing Workshop (WANLP)
- Month:
- December
- Year:
- 2022
- Address:
- Abu Dhabi, United Arab Emirates (Hybrid)
- Editors:
- Houda Bouamor, Hend Al-Khalifa, Kareem Darwish, Owen Rambow, Fethi Bougares, Ahmed Abdelali, Nadi Tomeh, Salam Khalifa, Wajdi Zaghouani
- Venue:
- WANLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 273–286
- Language:
- URL:
- https://aclanthology.org/2022.wanlp-1.25
- DOI:
- 10.18653/v1/2022.wanlp-1.25
- Cite (ACL):
- Asma Z Yamani, Amjad K Alsulami, and Rabeah A Al-Zaidy. 2022. Event-Based Knowledge MLM for Arabic Event Detection. In Proceedings of the Seventh Arabic Natural Language Processing Workshop (WANLP), pages 273–286, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics.
- Cite (Informal):
- Event-Based Knowledge MLM for Arabic Event Detection (Yamani et al., WANLP 2022)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2022.wanlp-1.25.pdf