Image Annotation with ISO-Space: Distinguishing Content from Structure

James Pustejovsky, Zachary Yocum

Abstract
Natural language descriptions of visual media present interesting problems for linguistic annotation of spatial information. This paper explores the use of ISO-Space, an annotation specification to capturing spatial information, for encoding spatial relations mentioned in descriptions of images. Especially, we focus on the distinction between references to representational content and structural components of images, and the utility of such a distinction within a compositional semantics. We also discuss how such a structure-content distinction within the linguistic annotation can be leveraged to compute further inferences about spatial configurations depicted by images with verbal captions. We construct a composition table to relate content-based relations to structure-based relations in the image, as expressed in the captions. While still preliminary, our initial results suggest that a weak composition table is both sound and informative for deriving new spatial relations.
Anthology ID:
L14-1021
Volume:
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
Month:
May
Year:
2014
Address:
Reykjavik, Iceland
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
426–431
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/1026_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
James Pustejovsky and Zachary Yocum. 2014. Image Annotation with ISO-Space: Distinguishing Content from Structure. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 426–431, Reykjavik, Iceland. European Language Resources Association (ELRA).
Cite (Informal):
Image Annotation with ISO-Space: Distinguishing Content from Structure (Pustejovsky & Yocum, LREC 2014)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/1026_Paper.pdf
PDF Search