Abstract
This paper discusses SemEval-2018 Task 5: a referential quantification task of counting events and participants in local, long-tail news documents with high ambiguity. The complexity of this task challenges systems to establish the meaning, reference and identity across documents. The task consists of three subtasks and spans across three domains. We detail the design of this referential quantification task, describe the participating systems, and present additional analysis to gain deeper insight into their performance.- Anthology ID:
- S18-1009
- Volume:
- Proceedings of the 12th International Workshop on Semantic Evaluation
- Month:
- June
- Year:
- 2018
- Address:
- New Orleans, Louisiana
- Editors:
- Marianna Apidianaki, Saif M. Mohammad, Jonathan May, Ekaterina Shutova, Steven Bethard, Marine Carpuat
- Venue:
- SemEval
- SIG:
- SIGLEX
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 70–80
- Language:
- URL:
- https://aclanthology.org/S18-1009
- DOI:
- 10.18653/v1/S18-1009
- Cite (ACL):
- Marten Postma, Filip Ilievski, and Piek Vossen. 2018. SemEval-2018 Task 5: Counting Events and Participants in the Long Tail. In Proceedings of the 12th International Workshop on Semantic Evaluation, pages 70–80, New Orleans, Louisiana. Association for Computational Linguistics.
- Cite (Informal):
- SemEval-2018 Task 5: Counting Events and Participants in the Long Tail (Postma et al., SemEval 2018)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-2/S18-1009.pdf
- Data
- FrameNet