LSDSem 2017 Shared Task: The Story Cloze Test
Nasrin Mostafazadeh, Michael Roth, Annie Louis, Nathanael Chambers, James Allen
Abstract
The LSDSem’17 shared task is the Story Cloze Test, a new evaluation for story understanding and script learning. This test provides a system with a four-sentence story and two possible endings, and the system must choose the correct ending to the story. Successful narrative understanding (getting closer to human performance of 100%) requires systems to link various levels of semantics to commonsense knowledge. A total of eight systems participated in the shared task, with a variety of approaches including.- Anthology ID:
- W17-0906
- Volume:
- Proceedings of the 2nd Workshop on Linking Models of Lexical, Sentential and Discourse-level Semantics
- Month:
- April
- Year:
- 2017
- Address:
- Valencia, Spain
- Editors:
- Michael Roth, Nasrin Mostafazadeh, Nathanael Chambers, Annie Louis
- Venue:
- LSDSem
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 46–51
- Language:
- URL:
- https://aclanthology.org/W17-0906
- DOI:
- 10.18653/v1/W17-0906
- Cite (ACL):
- Nasrin Mostafazadeh, Michael Roth, Annie Louis, Nathanael Chambers, and James Allen. 2017. LSDSem 2017 Shared Task: The Story Cloze Test. In Proceedings of the 2nd Workshop on Linking Models of Lexical, Sentential and Discourse-level Semantics, pages 46–51, Valencia, Spain. Association for Computational Linguistics.
- Cite (Informal):
- LSDSem 2017 Shared Task: The Story Cloze Test (Mostafazadeh et al., LSDSem 2017)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/W17-0906.pdf
- Data
- ROCStories