Finding Recurrent Features of Image Schema Gestures: the FIGURE corpus

Andy Luecking, Alexander Mehler, Désirée Walther, Marcel Mauri, Dennis Kurfürst

Abstract
The Frankfurt Image GestURE corpus (FIGURE) is introduced. The corpus data is collected in an experimental setting where 50 naive participants spontaneously produced gestures in response to five to six terms from a total of 27 stimulus terms. The stimulus terms have been compiled mainly from image schemata from psycholinguistics, since such schemata provide a panoply of abstract contents derived from natural language use. The gestures have been annotated for kinetic features. FIGURE aims at finding (sets of) stable kinetic feature configurations associated with the stimulus terms. Given such configurations, they can be used for designing HCI gestures that go beyond pre-defined gesture vocabularies or touchpad gestures. It is found, for instance, that movement trajectories are far more informative than handshapes, speaking against purely handshape-based HCI vocabularies. Furthermore, the mean temporal duration of hand and arm movements associated vary with the stimulus terms, indicating a dynamic dimension not covered by vocabulary-based approaches. Descriptive results are presented and related to findings from gesture studies and natural language dialogue.
Anthology ID:
L16-1227
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
1426–1431
Language:
URL:
https://aclanthology.org/L16-1227
DOI:
Bibkey:
Cite (ACL):
Andy Luecking, Alexander Mehler, Désirée Walther, Marcel Mauri, and Dennis Kurfürst. 2016. Finding Recurrent Features of Image Schema Gestures: the FIGURE corpus. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 1426–1431, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
Finding Recurrent Features of Image Schema Gestures: the FIGURE corpus (Luecking et al., LREC 2016)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-1/L16-1227.pdf
PDF Search