Construction of Japanese Audio-Visual Emotion Database and Its Application in Emotion Recognition

Nurul Lubis, Randy Gomez, Sakriani Sakti, Keisuke Nakamura, Koichiro Yoshino, Satoshi Nakamura, Kazuhiro Nakadai

Abstract
Emotional aspects play a vital role in making human communication a rich and dynamic experience. As we introduce more automated system in our daily lives, it becomes increasingly important to incorporate emotion to provide as natural an interaction as possible. To achieve said incorporation, rich sets of labeled emotional data is prerequisite. However, in Japanese, existing emotion database is still limited to unimodal and bimodal corpora. Since emotion is not only expressed through speech, but also visually at the same time, it is essential to include multiple modalities in an observation. In this paper, we present the first audio-visual emotion corpora in Japanese, collected from 14 native speakers. The corpus contains 100 minutes of annotated and transcribed material. We performed preliminary emotion recognition experiments on the corpus and achieved an accuracy of 61.42% for five classes of emotion.
Anthology ID:
L16-1346
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
2180–2184
Language:
URL:
https://aclanthology.org/L16-1346
DOI:
Bibkey:
Cite (ACL):
Nurul Lubis, Randy Gomez, Sakriani Sakti, Keisuke Nakamura, Koichiro Yoshino, Satoshi Nakamura, and Kazuhiro Nakadai. 2016. Construction of Japanese Audio-Visual Emotion Database and Its Application in Emotion Recognition. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 2180–2184, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
Construction of Japanese Audio-Visual Emotion Database and Its Application in Emotion Recognition (Lubis et al., LREC 2016)
Copy Citation:
PDF:
https://preview.aclanthology.org/add_acl24_videos/L16-1346.pdf
Data
SEMAINE
PDF Search