ConTempo: A Unified Temporally Contrastive Framework for Temporal Relation Extraction

Jingcheng Niu, Saifei Liao, Victoria Ng, Simon De Montigny, Gerald Penn


Abstract
The task of temporal relation extraction (TRE) involves identifying and extracting temporal relations between events from narratives. We identify two primary issues with TRE systems. First, by formulating TRE as a simple text classification task where every temporal relation is independent, it is hard to enhance the TRE model’s representation of meaning of temporal relations, and its facility with the underlying temporal calculus. We solve the issue by proposing a novel Temporally Contrastive learning model (ConTempo) that increase the model’s awareness of the meaning of temporal relations by leveraging their symmetric or antisymmetric properties. Second, the reusability of innovations has been limited due to incompatibilities in model architectures. Therefore, we propose a unified framework and show that ConTempo is compatible with all three main branches of TRE research. Our results demonstrate that the performance gains of ConTempo are more pronounced, with the total combination achieving state-of-the-art performance on the widely used MATRES and TBD corpora. We furthermore identified and corrected a large number of annotation errors present in the test set of MATRES, after which the performance increase brought by ConTempo becomes more apparent.
Anthology ID:
2024.findings-acl.89
Volume:
Findings of the Association for Computational Linguistics ACL 2024
Month:
August
Year:
2024
Address:
Bangkok, Thailand and virtual meeting
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1521–1533
Language:
URL:
https://aclanthology.org/2024.findings-acl.89
DOI:
Bibkey:
Cite (ACL):
Jingcheng Niu, Saifei Liao, Victoria Ng, Simon De Montigny, and Gerald Penn. 2024. ConTempo: A Unified Temporally Contrastive Framework for Temporal Relation Extraction. In Findings of the Association for Computational Linguistics ACL 2024, pages 1521–1533, Bangkok, Thailand and virtual meeting. Association for Computational Linguistics.
Cite (Informal):
ConTempo: A Unified Temporally Contrastive Framework for Temporal Relation Extraction (Niu et al., Findings 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-4/2024.findings-acl.89.pdf