Mining a multimodal corpus for non-verbal behavior sequences conveying attitudes

Mathieu Chollet, Magalie Ochs, Catherine Pelachaud

Abstract
Interpersonal attitudes are expressed by non-verbal behaviors on a variety of different modalities. The perception of these behaviors is influenced by how they are sequenced with other behaviors from the same person and behaviors from other interactants. In this paper, we present a method for extracting and generating sequences of non-verbal signals expressing interpersonal attitudes. These sequences are used as part of a framework for non-verbal expression with Embodied Conversational Agents that considers different features of non-verbal behavior: global behavior tendencies, interpersonal reactions, sequencing of non-verbal signals, and communicative intentions. Our method uses a sequence mining technique on an annotated multimodal corpus to extract sequences characteristic of different attitudes. New sequences of non-verbal signals are generated using a probabilistic model, and evaluated using the previously mined sequences.
Anthology ID:
L14-1225
Volume:
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
Month:
May
Year:
2014
Address:
Reykjavik, Iceland
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
3417–3424
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/235_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Mathieu Chollet, Magalie Ochs, and Catherine Pelachaud. 2014. Mining a multimodal corpus for non-verbal behavior sequences conveying attitudes. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 3417–3424, Reykjavik, Iceland. European Language Resources Association (ELRA).
Cite (Informal):
Mining a multimodal corpus for non-verbal behavior sequences conveying attitudes (Chollet et al., LREC 2014)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/235_Paper.pdf
PDF Search