Event Causality Identification - Shared Task 3, CASE 2023
Fiona Anting Tan, Hansi Hettiarachchi, Ali Hürriyetoğlu, Nelleke Oostdijk, Onur Uca, Surendrabikram Thapa, Farhana Ferdousi Liza
Abstract
The Event Causality Identification Shared Task of CASE 2023 is the second iteration of a shared task centered around the Causal News Corpus. Two subtasks were involved: In Subtask 1, participants were challenged to predict if a sentence contains a causal relation or not. In Subtask 2, participants were challenged to identify the Cause, Effect, and Signal spans given an input causal sentence. For both subtasks, participants uploaded their predictions for a held-out test set, and ranking was done based on binary F1 and macro F1 scores for Subtask 1 and 2, respectively. This paper includes an overview of the work of the ten teams that submitted their results to our competition and the six system description papers that were received. The highest F1 scores achieved for Subtask 1 and 2 were 84.66% and 72.79%, respectively.- Anthology ID:
- 2023.case-1.19
- Volume:
- Proceedings of the 6th Workshop on Challenges and Applications of Automated Extraction of Socio-political Events from Text
- Month:
- sEPTEMBER
- Year:
- 2023
- Address:
- Varna, Bulgaria
- Editors:
- Ali Hürriyetoğlu, Hristo Tanev, Vanni Zavarella, Reyyan Yeniterzi, Erdem Yörük, Milena Slavcheva
- Venues:
- CASE | WS
- SIG:
- Publisher:
- INCOMA Ltd., Shoumen, Bulgaria
- Note:
- Pages:
- 144–150
- Language:
- URL:
- https://aclanthology.org/2023.case-1.19
- DOI:
- Cite (ACL):
- Fiona Anting Tan, Hansi Hettiarachchi, Ali Hürriyetoğlu, Nelleke Oostdijk, Onur Uca, Surendrabikram Thapa, and Farhana Ferdousi Liza. 2023. Event Causality Identification - Shared Task 3, CASE 2023. In Proceedings of the 6th Workshop on Challenges and Applications of Automated Extraction of Socio-political Events from Text, pages 144–150, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
- Cite (Informal):
- Event Causality Identification - Shared Task 3, CASE 2023 (Tan et al., CASE-WS 2023)
- PDF:
- https://preview.aclanthology.org/naacl24-info/2023.case-1.19.pdf