EventFull: Complete and Consistent Event Relation Annotation

Alon Eirew, Eviatar Nachshoni, Aviv Slobodkin, Ido Dagan


Abstract
Event relation detection is a fundamental NLP task, leveraged in many downstream applications, whose modeling requires datasets annotated with event relations of various types. However, systematic and complete annotation of these relations is costly and challenging, due to the quadratic number of event pairs that need to be considered. Consequently, many current event relation datasets lack systematicity and completeness.In response, we introduce EventFull, the first tool that supports consistent, complete and efficient annotation of temporal, causal and coreference relations via a unified and synergetic process.A pilot study demonstrates that EventFull accelerates and simplifies the annotation process while yielding high inter-annotator agreement.
Anthology ID:
2025.naacl-demo.40
Volume:
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (System Demonstrations)
Month:
April
Year:
2025
Address:
Albuquerque, New Mexico
Editors:
Nouha Dziri, Sean (Xiang) Ren, Shizhe Diao
Venues:
NAACL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
494–508
Language:
URL:
https://preview.aclanthology.org/moar-dois/2025.naacl-demo.40/
DOI:
10.18653/v1/2025.naacl-demo.40
Bibkey:
Cite (ACL):
Alon Eirew, Eviatar Nachshoni, Aviv Slobodkin, and Ido Dagan. 2025. EventFull: Complete and Consistent Event Relation Annotation. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (System Demonstrations), pages 494–508, Albuquerque, New Mexico. Association for Computational Linguistics.
Cite (Informal):
EventFull: Complete and Consistent Event Relation Annotation (Eirew et al., NAACL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/moar-dois/2025.naacl-demo.40.pdf