Yoad Winter


Geo-Aware Image Caption Generation
Sofia Nikiforova | Tejaswini Deoskar | Denis Paperno | Yoad Winter
Proceedings of the 28th International Conference on Computational Linguistics

Standard image caption generation systems produce generic descriptions of images and do not utilize any contextual information or world knowledge. In particular, they are unable to generate captions that contain references to the geographic context of an image, for example, the location where a photograph is taken or relevant geographic objects around an image location. In this paper, we develop a geo-aware image caption generation system, which incorporates geographic contextual information into a standard image captioning pipeline. We propose a way to build an image-specific representation of the geographic context and adapt the caption generation network to produce appropriate geographic names in the image descriptions. We evaluate our system on a novel captioning dataset that contains contextualized captions and geographic metadata and achieve substantial improvements in BLEU, ROUGE, METEOR and CIDEr scores. We also introduce a new metric to assess generated geographic references directly and empirically demonstrate our system’s ability to produce captions with relevant and factually accurate geographic referencing.


Presupposition Projection and Repair Strategies in Trivalent Semantics
Yoad Winter
Proceedings of the 16th Meeting on the Mathematics of Language


Towards a Semantic Model for Textual Entailment Annotation
Assaf Toledo | Stavroula Alexandropoulou | Sophie Chesney | Sophia Katrenko | Heid Klockmann | Pepjin Kokke | Benno Kruit | Yoad Winter
Linguistic Issues in Language Technology, Volume 9, 2014 - Perspectives on Semantic Representations for Textual Inference

We introduce a new formal semantic model for annotating textual entailments that describes restrictive, intersective, and appositive modification. The model contains a formally defined interpreted lexicon, which specifies the inventory of symbols and the supported semantic operators, and an informally defined annotation scheme that instructs annotators in which way to bind words and constructions from a given pair of premise and hypothesis to the interpreted lexicon. We explore the applicability of the proposed model to the Recognizing Textual Entailment (RTE) 1–4 corpora and describe a first-stage annotation scheme on which we based the manual annotation work. The constructions we annotated were found to occur in 80.65% of the entailments in RTE 1–4 and were annotated with cross-annotator agreement of 68% on average. The annotated parts of the RTE corpora are publicly available for further research.

Annotating by Proving using SemAnTE
Assaf Toledo | Stavroula Alexandropoulou | Sophie Chesney | Robert Grimm | Pepijn Kokke | Benno Kruit | Kyriaki Neophytou | Antony Nguyen | Yoad Winter
Proceedings of the Demonstrations at the 14th Conference of the European Chapter of the Association for Computational Linguistics


Semantic Annotation of Textual Entailment
Assaf Toledo | Stavroula Alexandropoulou | Sophia Katrenko | Heidi Klockmann | Pepijn Kokke | Yoad Winter
Proceedings of the 10th International Conference on Computational Semantics (IWCS 2013) – Long Papers


Smoothing a Lexicon-based POS Tagger for Arabic and Hebrew
Saib Manour | Khalil Sima’an | Yoad Winter
Proceedings of the 2007 Workshop on Computational Approaches to Semitic Languages: Common Issues and Resources


Controlled Language for Geographical Information System Queries
Sela Mador-Haim | Yoad Winter | Anthony Braun
Proceedings of the Fifth International Workshop on Inference in Computational Semantics (ICoS-5)


Choosing an Optimal Architecture for Segmentation and POS-Tagging of Modern Hebrew
Roy Bar-Haim | Khalil Sima’an | Yoad Winter
Proceedings of the ACL Workshop on Computational Approaches to Semitic Languages