Abstract
This paper describes our proposed model for the Chinese Grammatical Error Diagnosis (CGED) task in NLPTEA2020. The goal of CGED is to use natural language processing techniques to automatically diagnose Chinese grammatical errors in sentences. To this end, we design and implement a CGED model named BERT with Score-feature Gates Error Diagnoser (BSGED), which is based on the BERT model, Bidirectional Long Short-Term Memory (BiLSTM) and conditional random field (CRF). In order to address the problem of losing partial-order relationships when embedding continuous feature items as with previous works, we propose a gating mechanism for integrating continuous feature items, which effectively retains the partial-order relationships between feature items. We perform LSTM processing on the encoding result of the BERT model, and further extract the sequence features. In the final test-set evaluation, we obtained the highest F1 score at the detection level and are among the top 3 F1 scores at the identification level.- Anthology ID:
- 2020.nlptea-1.7
- Volume:
- Proceedings of the 6th Workshop on Natural Language Processing Techniques for Educational Applications
- Month:
- December
- Year:
- 2020
- Address:
- Suzhou, China
- Editors:
- Erhong YANG, Endong XUN, Baolin ZHANG, Gaoqi RAO
- Venue:
- NLP-TEA
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 49–56
- Language:
- URL:
- https://aclanthology.org/2020.nlptea-1.7
- DOI:
- Cite (ACL):
- Yongchang Cao, Liang He, Robert Ridley, and Xinyu Dai. 2020. Integrating BERT and Score-based Feature Gates for Chinese Grammatical Error Diagnosis. In Proceedings of the 6th Workshop on Natural Language Processing Techniques for Educational Applications, pages 49–56, Suzhou, China. Association for Computational Linguistics.
- Cite (Informal):
- Integrating BERT and Score-based Feature Gates for Chinese Grammatical Error Diagnosis (Cao et al., NLP-TEA 2020)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2020.nlptea-1.7.pdf