Contextualized Representations for Low-resource Utterance Tagging

Bhargavi Paranjape, Graham Neubig


Abstract
Utterance-level analysis of the speaker’s intentions and emotions is a core task in conversational understanding. Depending on the end objective of the conversational understanding task, different categorical dialog-act or affect labels are expertly designed to cover specific aspects of the speakers’ intentions or emotions respectively. Accurately annotating with these labels requires a high level of human expertise, and thus applying this process to a large conversation corpus or new domains is prohibitively expensive. The resulting paucity of data limits the use of sophisticated neural models. In this paper, we tackle these limitations by performing unsupervised training of utterance representations from a large corpus of spontaneous dialogue data. Models initialized with these representations achieve competitive performance on utterance-level dialogue-act recognition and emotion classification, especially in low-resource settings encountered when analyzing conversations in new domains.
Anthology ID:
W19-5909
Volume:
Proceedings of the 20th Annual SIGdial Meeting on Discourse and Dialogue
Month:
September
Year:
2019
Address:
Stockholm, Sweden
Editors:
Satoshi Nakamura, Milica Gasic, Ingrid Zukerman, Gabriel Skantze, Mikio Nakano, Alexandros Papangelis, Stefan Ultes, Koichiro Yoshino
Venue:
SIGDIAL
SIG:
SIGDIAL
Publisher:
Association for Computational Linguistics
Note:
Pages:
68–74
Language:
URL:
https://aclanthology.org/W19-5909
DOI:
10.18653/v1/W19-5909
Bibkey:
Cite (ACL):
Bhargavi Paranjape and Graham Neubig. 2019. Contextualized Representations for Low-resource Utterance Tagging. In Proceedings of the 20th Annual SIGdial Meeting on Discourse and Dialogue, pages 68–74, Stockholm, Sweden. Association for Computational Linguistics.
Cite (Informal):
Contextualized Representations for Low-resource Utterance Tagging (Paranjape & Neubig, SIGDIAL 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/fix-dup-bibkey/W19-5909.pdf