SemEval-2018 Task 5: Counting Events and Participants in the Long Tail

Marten Postma, Filip Ilievski, Piek Vossen


Abstract
This paper discusses SemEval-2018 Task 5: a referential quantification task of counting events and participants in local, long-tail news documents with high ambiguity. The complexity of this task challenges systems to establish the meaning, reference and identity across documents. The task consists of three subtasks and spans across three domains. We detail the design of this referential quantification task, describe the participating systems, and present additional analysis to gain deeper insight into their performance.
Anthology ID:
S18-1009
Volume:
Proceedings of The 12th International Workshop on Semantic Evaluation
Month:
June
Year:
2018
Address:
New Orleans, Louisiana
Venue:
SemEval
SIGs:
SIGLEX | SIGSEM
Publisher:
Association for Computational Linguistics
Note:
Pages:
70–80
Language:
URL:
https://aclanthology.org/S18-1009
DOI:
10.18653/v1/S18-1009
Bibkey:
Cite (ACL):
Marten Postma, Filip Ilievski, and Piek Vossen. 2018. SemEval-2018 Task 5: Counting Events and Participants in the Long Tail. In Proceedings of The 12th International Workshop on Semantic Evaluation, pages 70–80, New Orleans, Louisiana. Association for Computational Linguistics.
Cite (Informal):
SemEval-2018 Task 5: Counting Events and Participants in the Long Tail (Postma et al., SemEval 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/update-css-js/S18-1009.pdf
Data
FrameNet