The REX corpora: A collection of multimodal corpora of referring expressions in collaborative problem solving dialogues

Takenobu Tokunaga, Ryu Iida, Asuka Terai, Naoko Kuriyama


Abstract
This paper describes a collection of multimodal corpora of referring expressions, the REX corpora. The corpora have two notable features, namely (1) they include time-aligned extra-linguistic information such as participant actions and eye-gaze on top of linguistic information, (2) dialogues were collected with various configurations in terms of the puzzle type, hinting and language. After describing how the corpora were constructed and sketching out each, we present an analysis of various statistics for the corpora with respect to the various configurations mentioned above. The analysis showed that the corpora have different characteristics in the number of utterances and referring expressions in a dialogue, the task completion time and the attributes used in the referring expressions. In this respect, we succeeded in constructing a collection of corpora that included a variety of characteristics by changing the configurations for each set of dialogues, as originally planned. The corpora are now under preparation for publication, to be used for research on human reference behaviour.
Anthology ID:
L12-1392
Volume:
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
Month:
May
Year:
2012
Address:
Istanbul, Turkey
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
422–429
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/676_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Takenobu Tokunaga, Ryu Iida, Asuka Terai, and Naoko Kuriyama. 2012. The REX corpora: A collection of multimodal corpora of referring expressions in collaborative problem solving dialogues. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 422–429, Istanbul, Turkey. European Language Resources Association (ELRA).
Cite (Informal):
The REX corpora: A collection of multimodal corpora of referring expressions in collaborative problem solving dialogues (Tokunaga et al., LREC 2012)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/676_Paper.pdf