Probing into the Root: A Dataset for Reason Extraction of Structural Events from Financial Documents

Pei Chen, Kang Liu, Yubo Chen, Taifeng Wang, Jun Zhao


Abstract
This paper proposes a new task regarding event reason extraction from document-level texts. Unlike the previous causality detection task, we do not assign target events in the text, but only provide structural event descriptions, and such settings accord more with practice scenarios. Moreover, we annotate a large dataset FinReason for evaluation, which provides Reasons annotation for Financial events in company announcements. This task is challenging because the cases of multiple-events, multiple-reasons, and implicit-reasons are included. In total, FinReason contains 8,794 documents, 12,861 financial events and 11,006 reason spans. We also provide the performance of existing canonical methods in event extraction and machine reading comprehension on this task. The results show a 7 percentage point F1 score gap between the best model and human performance, and existing methods are far from resolving this problem.
Anthology ID:
2021.eacl-main.175
Volume:
Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume
Month:
April
Year:
2021
Address:
Online
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2042–2048
Language:
URL:
https://aclanthology.org/2021.eacl-main.175
DOI:
10.18653/v1/2021.eacl-main.175
Bibkey:
Cite (ACL):
Pei Chen, Kang Liu, Yubo Chen, Taifeng Wang, and Jun Zhao. 2021. Probing into the Root: A Dataset for Reason Extraction of Structural Events from Financial Documents. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 2042–2048, Online. Association for Computational Linguistics.
Cite (Informal):
Probing into the Root: A Dataset for Reason Extraction of Structural Events from Financial Documents (Chen et al., EACL 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/update-css-js/2021.eacl-main.175.pdf
Dataset:
 2021.eacl-main.175.Dataset.zip
Software:
 2021.eacl-main.175.Software.zip