Character-based Joint Segmentation and POS Tagging for Chinese using Bidirectional RNN-CRF

Yan Shao, Christian Hardmeier, Jörg Tiedemann, Joakim Nivre


Abstract
We present a character-based model for joint segmentation and POS tagging for Chinese. The bidirectional RNN-CRF architecture for general sequence tagging is adapted and applied with novel vector representations of Chinese characters that capture rich contextual information and lower-than-character level features. The proposed model is extensively evaluated and compared with a state-of-the-art tagger respectively on CTB5, CTB9 and UD Chinese. The experimental results indicate that our model is accurate and robust across datasets in different sizes, genres and annotation schemes. We obtain state-of-the-art performance on CTB5, achieving 94.38 F1-score for joint segmentation and POS tagging.
Anthology ID:
I17-1018
Volume:
Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
Month:
November
Year:
2017
Address:
Taipei, Taiwan
Editors:
Greg Kondrak, Taro Watanabe
Venue:
IJCNLP
SIG:
Publisher:
Asian Federation of Natural Language Processing
Note:
Pages:
173–183
Language:
URL:
https://aclanthology.org/I17-1018
DOI:
Bibkey:
Cite (ACL):
Yan Shao, Christian Hardmeier, Jörg Tiedemann, and Joakim Nivre. 2017. Character-based Joint Segmentation and POS Tagging for Chinese using Bidirectional RNN-CRF. In Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 173–183, Taipei, Taiwan. Asian Federation of Natural Language Processing.
Cite (Informal):
Character-based Joint Segmentation and POS Tagging for Chinese using Bidirectional RNN-CRF (Shao et al., IJCNLP 2017)
Copy Citation:
PDF:
https://preview.aclanthology.org/naacl-24-ws-corrections/I17-1018.pdf
Software:
 I17-1018.Software.zip
Code
 yanshao9798/tagger
Data
Universal Dependencies