Towards a Semantic Model for Textual Entailment Annotation
Assaf Toledo, Stavroula Alexandropoulou, Sophie Chesney, Sophia Katrenko, Heid Klockmann, Pepjin Kokke, Benno Kruit, Yoad Winter
Abstract
We introduce a new formal semantic model for annotating textual entailments that describes restrictive, intersective, and appositive modification. The model contains a formally defined interpreted lexicon, which specifies the inventory of symbols and the supported semantic operators, and an informally defined annotation scheme that instructs annotators in which way to bind words and constructions from a given pair of premise and hypothesis to the interpreted lexicon. We explore the applicability of the proposed model to the Recognizing Textual Entailment (RTE) 1–4 corpora and describe a first-stage annotation scheme on which we based the manual annotation work. The constructions we annotated were found to occur in 80.65% of the entailments in RTE 1–4 and were annotated with cross-annotator agreement of 68% on average. The annotated parts of the RTE corpora are publicly available for further research.- Anthology ID:
- 2014.lilt-9.10
- Volume:
- Linguistic Issues in Language Technology, Volume 9, 2014 - Perspectives on Semantic Representations for Textual Inference
- Month:
- Year:
- 2014
- Address:
- Venue:
- LILT
- SIG:
- Publisher:
- CSLI Publications
- Note:
- Pages:
- Language:
- URL:
- https://aclanthology.org/2014.lilt-9.10
- DOI:
- Cite (ACL):
- Assaf Toledo, Stavroula Alexandropoulou, Sophie Chesney, Sophia Katrenko, Heid Klockmann, Pepjin Kokke, Benno Kruit, and Yoad Winter. 2014. Towards a Semantic Model for Textual Entailment Annotation. Linguistic Issues in Language Technology, 9.
- Cite (Informal):
- Towards a Semantic Model for Textual Entailment Annotation (Toledo et al., LILT 2014)
- PDF:
- https://preview.aclanthology.org/landing_page/2014.lilt-9.10.pdf