Katerina Pastra


2017

pdf bib
Proceedings of the Sixth Workshop on Vision and Language
Anya Belz | Erkut Erdem | Katerina Pastra | Krystian Mikolajczyk
Proceedings of the Sixth Workshop on Vision and Language

2016

pdf bib
Proceedings of the 5th Workshop on Vision and Language
Anya Belz | Erkut Erdem | Krystian Mikolajczyk | Katerina Pastra
Proceedings of the 5th Workshop on Vision and Language

2015

pdf bib
Proceedings of the Fourth Workshop on Vision and Language
Anja Belz | Luisa Coheur | Vittorio Ferrari | Marie-Francine Moens | Katerina Pastra | Ivan Vulić
Proceedings of the Fourth Workshop on Vision and Language

2010

pdf bib
The POETICON Corpus: Capturing Language Use and Sensorimotor Experience in Everyday Interaction
Katerina Pastra | Christian Wallraven | Michael Schultze | Argyro Vataki | Kathrin Kaulard
Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)

Natural language use, acquisition, and understanding takes place usually in multisensory and multimedia communication environments. Therefore, for one to model language in its interaction and integration with sensorimotor experiences, one needs a representative corpus of such interplay. In this paper, we will present the first corpus of language use and sensorimotor experience recordings in everyday human:human interaction, in which spontaneous language communication has been recorded along with corresponding multiview video recordings, recordings of 3D full body kinematics, and 3D tracking of objects in focus. It is a twelve-hour corpus which comprises of six everyday human:human interaction scenes, each one performed 3 times by 4 different English-speaking couples (interaction between a male and a female actor), each couple acting each scene in two settings: a fully naturalistic setting in which 5-camera multi-view video recordings take place, and a high-tech setting, with full body motion capture for both individuals, a 2-camera multiview video recording, and 3D tracking of focus objects. The corpus has been developed within an EU-funded cognitive systems research project, POETICON (http://www.poeticon.eu), and represents a new type of language resources for cognitive systems. Namely, a corpus that reveals the dynamic role of language in its interplay with sensorimotor experiences and which allows one to computationally model this interplay.

2009

pdf bib
A Text-Based Search Interface for Multimedia Dialectics
Katerina Pastra | Eirini Balta
Proceedings of the Demonstrations Session at EACL 2009

2006

pdf bib
Beyond Multimedia Integration: corpora and annotations for cross-media decision mechanisms
Katerina Pastra
Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06)

In this paper, we look into the notion of cross-media decision mechanisms, focussing on ones that work within multimedia documents for a variety of applications, such as the generation of intelligent multimedia presentations and multimedia indexing. In order for these mechanisms to go beyond the identification of semantic equivalence relations between media, which is what integration does, appropriate corpora and annotations are needed. Drawing from our experience in the REVEAL THIS project, we indicate the characteristics that such corpora should have, and suggest a number of annotations that would allow for training/designing such mechanisms. We conclude with a view on the suitability of two related markup languages (MPEG-7 and EMMA) for accommodating the suggested annotations.

2004

pdf bib
Image-Language Multimodal Corpora: Needs, Lacunae and an AI Synergy for Annotation
Katerina Pastra | Yorick Wilks
Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC’04)

2003

pdf bib
NLP for Indexing and Retrieval of Captioned Photographs
Horacio Saggion | Katerina Pastra | Yorick Wilks
10th Conference of the European Chapter of the Association for Computational Linguistics

pdf bib
Proceedings of the EACL 2003 Workshop on Evaluation Initiatives in Natural Language Processing: are evaluation methods, metrics and resources reusable?
Katerina Pastra
Proceedings of the EACL 2003 Workshop on Evaluation Initiatives in Natural Language Processing: are evaluation methods, metrics and resources reusable?

pdf bib
Colouring Summaries BLEU
Katerina Pastra | Horacio Saggion
Proceedings of the EACL 2003 Workshop on Evaluation Initiatives in Natural Language Processing: are evaluation methods, metrics and resources reusable?

2002

pdf bib
How feasible is the reuse of grammars for Named Entity Recognition?
Katerina Pastra | Diana Maynard | Oana Hamza | Hamish Cunningham | Yorick Wilks
Proceedings of the Third International Conference on Language Resources and Evaluation (LREC’02)