Annotation Process for the Dialog Act Classification of a Taglish E-commerce Q&A Corpus
Jared Rivera, Jan Caleb Oliver Pensica, Jolene Valenzuela, Alfonso Secuya, Charibeth Cheng
Abstract
With conversational agents or chatbots making up in quantity of replies rather than quality, the need to identify user intent has become a main concern to improve these agents. Dialog act (DA) classification tackles this concern, and while existing studies have already addressed DA classification in general contexts, no training corpora in the context of e-commerce is available to the public. This research addressed the said insufficiency by building a text-based corpus of 7,265 posts from the question and answer section of products on Lazada Philippines. The SWBD-DAMSL tagset for DA classification was modified to 28 tags fitting the categories applicable to e-commerce conversations. The posts were annotated manually by three (3) human annotators and preprocessing techniques decreased the vocabulary size from 6,340 to 1,134. After analysis, the corpus was composed dominantly of single-label posts, with 34% of the corpus having multiple intent tags. The annotated corpus allowed insights toward the structure of posts created with single to multiple intents.- Anthology ID:
- D19-5108
- Volume:
- Proceedings of the Second Workshop on Economics and Natural Language Processing
- Month:
- November
- Year:
- 2019
- Address:
- Hong Kong
- Editors:
- Udo Hahn, Véronique Hoste, Zhu Zhang
- Venue:
- WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 61–68
- Language:
- URL:
- https://aclanthology.org/D19-5108
- DOI:
- 10.18653/v1/D19-5108
- Cite (ACL):
- Jared Rivera, Jan Caleb Oliver Pensica, Jolene Valenzuela, Alfonso Secuya, and Charibeth Cheng. 2019. Annotation Process for the Dialog Act Classification of a Taglish E-commerce Q&A Corpus. In Proceedings of the Second Workshop on Economics and Natural Language Processing, pages 61–68, Hong Kong. Association for Computational Linguistics.
- Cite (Informal):
- Annotation Process for the Dialog Act Classification of a Taglish E-commerce Q&A Corpus (Rivera et al., 2019)
- PDF:
- https://preview.aclanthology.org/emnlp-22-attachments/D19-5108.pdf