Abstract
Treebanks are important resources for researchers in natural language processing, speech recognition, theoretical linguistics, etc. To strengthen the automatic processing of the Vietnamese language, a Vietnamese treebank has been built. However, the quality of this treebank is not satisfactory and is a possible source for the low performance of Vietnamese language processing. We have been building a new treebank for Vietnamese with about 40,000 sentences annotated with three layers: word segmentation, part-of-speech tagging, and bracketing. In this paper, we describe several challenges of Vietnamese language and how we solve them in developing annotation guidelines. We also present our methods to improve the quality of the annotation guidelines and ensure annotation accuracy and consistency. Experiment results show that inter-annotator agreement ratios and accuracy are higher than 90% which is satisfactory.- Anthology ID:
- L16-1243
- Volume:
- Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
- Month:
- May
- Year:
- 2016
- Address:
- Portorož, Slovenia
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 1532–1539
- Language:
- URL:
- https://aclanthology.org/L16-1243
- DOI:
- Cite (ACL):
- Quy Nguyen, Yusuke Miyao, Ha Le, and Ngan Nguyen. 2016. Challenges and Solutions for Consistent Annotation of Vietnamese Treebank. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 1532–1539, Portorož, Slovenia. European Language Resources Association (ELRA).
- Cite (Informal):
- Challenges and Solutions for Consistent Annotation of Vietnamese Treebank (Nguyen et al., LREC 2016)
- PDF:
- https://preview.aclanthology.org/remove-xml-comments/L16-1243.pdf