Abstract
Chinese Spelling Correction (CSC) aims to detect and correct erroneous characters in Chinese texts. Although efforts have been made to introduce phonetic information (Hanyu Pinyin) in this task, they typically merge phonetic representations with character representations, which tends to weaken the representation effect of normal texts. In this work, we propose to disentangle the two types of features to allow for direct interaction between textual and phonetic information. To learn useful phonetic representations, we introduce a pinyin-to-character objective to ask the model to predict the correct characters based solely on phonetic information, where a separation mask is imposed to disable attention from phonetic input to text. To avoid overfitting the phonetics, we further design a self-distillation module to ensure that semantic information plays a major role in the prediction. Extensive experiments on three CSC benchmarks demonstrate the superiority of our method in using phonetic information.- Anthology ID:
- 2023.acl-long.755
- Volume:
- Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Month:
- July
- Year:
- 2023
- Address:
- Toronto, Canada
- Editors:
- Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 13509–13521
- Language:
- URL:
- https://aclanthology.org/2023.acl-long.755
- DOI:
- 10.18653/v1/2023.acl-long.755
- Cite (ACL):
- Zihong Liang, Xiaojun Quan, and Qifan Wang. 2023. Disentangled Phonetic Representation for Chinese Spelling Correction. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 13509–13521, Toronto, Canada. Association for Computational Linguistics.
- Cite (Informal):
- Disentangled Phonetic Representation for Chinese Spelling Correction (Liang et al., ACL 2023)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-3/2023.acl-long.755.pdf