SemEval 2018 Task 6: Parsing Time Normalizations
Egoitz Laparra, Dongfang Xu, Ahmed Elsayed, Steven Bethard, Martha Palmer
Abstract
This paper presents the outcomes of the Parsing Time Normalization shared task held within SemEval-2018. The aim of the task is to parse time expressions into the compositional semantic graphs of the Semantically Compositional Annotation of Time Expressions (SCATE) schema, which allows the representation of a wider variety of time expressions than previous approaches. Two tracks were included, one to evaluate the parsing of individual components of the produced graphs, in a classic information extraction way, and another one to evaluate the quality of the time intervals resulting from the interpretation of those graphs. Though 40 participants registered for the task, only one team submitted output, achieving 0.55 F1 in Track 1 (parsing) and 0.70 F1 in Track 2 (intervals).- Anthology ID:
- S18-1011
- Volume:
- Proceedings of the 12th International Workshop on Semantic Evaluation
- Month:
- June
- Year:
- 2018
- Address:
- New Orleans, Louisiana
- Editors:
- Marianna Apidianaki, Saif M. Mohammad, Jonathan May, Ekaterina Shutova, Steven Bethard, Marine Carpuat
- Venue:
- SemEval
- SIG:
- SIGLEX
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 88–96
- Language:
- URL:
- https://aclanthology.org/S18-1011
- DOI:
- 10.18653/v1/S18-1011
- Cite (ACL):
- Egoitz Laparra, Dongfang Xu, Ahmed Elsayed, Steven Bethard, and Martha Palmer. 2018. SemEval 2018 Task 6: Parsing Time Normalizations. In Proceedings of the 12th International Workshop on Semantic Evaluation, pages 88–96, New Orleans, Louisiana. Association for Computational Linguistics.
- Cite (Informal):
- SemEval 2018 Task 6: Parsing Time Normalizations (Laparra et al., SemEval 2018)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-2/S18-1011.pdf