Introducing a Large-Scale Dataset for Vietnamese POS Tagging on Conversational Texts

Oanh Tran, Tu Pham, Vu Dang, Bang Nguyen

Abstract
This paper introduces a large-scale human-labeled dataset for the Vietnamese POS tagging task on conversational texts. To this end, wepropose a new tagging scheme (with 36 POS tags) consisting of exclusive tags for special phenomena of conversational words, developthe annotation guideline and manually annotate 16.310K sentences using this guideline. Based on this corpus, a series of state-of-the-art tagging methods has been conducted to estimate their performances. Experimental results showed that the Conditional Random Fields model using both automatically learnt features from deep neural networks and handcrafted features yielded the best performance. Thismodel achieved 93.36% in the accuracy score which is 1.6% and 2.7% higher than the model using either handcrafted features orautomatically-learnt features, respectively. This result is also a little bit higher than the model of fine-tuning BERT by 0.94% in theaccuracy score. The performance measured on each POS tag is also very high with >90% in the F1 score for 20 POS tags and >80%in the F1 score for 11 POS tags. This work provides the public dataset and preliminary results for follow-up research on this interesting direction.
Anthology ID:
2020.lrec-1.482
Volume:
Proceedings of the Twelfth Language Resources and Evaluation Conference
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
3913–3921
Language:
English
URL:
https://aclanthology.org/2020.lrec-1.482
DOI:
Bibkey:
Cite (ACL):
Oanh Tran, Tu Pham, Vu Dang, and Bang Nguyen. 2020. Introducing a Large-Scale Dataset for Vietnamese POS Tagging on Conversational Texts. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 3913–3921, Marseille, France. European Language Resources Association.
Cite (Informal):
Introducing a Large-Scale Dataset for Vietnamese POS Tagging on Conversational Texts (Tran et al., LREC 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-2023-videos/2020.lrec-1.482.pdf
PDF Search