Abstract
Understanding stories – sequences of events – is a crucial yet challenging natural language understanding task. These events typically carry multiple aspects of semantics including actions, entities and emotions. Not only does each individual aspect contribute to the meaning of the story, so does the interaction among these aspects. Building on this intuition, we propose to jointly model important aspects of semantic knowledge – frames, entities and sentiments – via a semantic language model. We achieve this by first representing these aspects’ semantic units at an appropriate level of abstraction and then using the resulting vector representations for each semantic aspect to learn a joint representation via a neural language model. We show that the joint semantic language model is of high quality and can generate better semantic sequences than models that operate on the word level. We further demonstrate that our joint model can be applied to story cloze test and shallow discourse parsing tasks with improved performance and that each semantic aspect contributes to the model.- Anthology ID:
- K17-1019
- Volume:
- Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017)
- Month:
- August
- Year:
- 2017
- Address:
- Vancouver, Canada
- Venue:
- CoNLL
- SIG:
- SIGNLL
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 173–183
- Language:
- URL:
- https://aclanthology.org/K17-1019
- DOI:
- 10.18653/v1/K17-1019
- Cite (ACL):
- Haoruo Peng, Snigdha Chaturvedi, and Dan Roth. 2017. A Joint Model for Semantic Sequences: Frames, Entities, Sentiments. In Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017), pages 173–183, Vancouver, Canada. Association for Computational Linguistics.
- Cite (Informal):
- A Joint Model for Semantic Sequences: Frames, Entities, Sentiments (Peng et al., CoNLL 2017)
- PDF:
- https://preview.aclanthology.org/paclic-22-ingestion/K17-1019.pdf
- Data
- FrameNet, ROCStories