Chengyu Cloze Test

Zhiying Jiang, Boliang Zhang, Lifu Huang, Heng Ji


Abstract
We present a neural recommendation model for Chengyu, which is a special type of Chinese idiom. Given a query, which is a sentence with an empty slot where the Chengyu is taken out, our model will recommend the best Chengyu candidate that best fits the slot context. The main challenge lies in that the literal meaning of a Chengyu is usually very different from it’s figurative meaning. We propose a new neural approach to leverage the definition of each Chengyu and incorporate it as background knowledge. Experiments on both Chengyu cloze test and coherence checking in college entrance exams show that our system achieves 89.5% accuracy on cloze test and outperforms human subjects who attended competitive universities in China. We will make all of our data sets and resources publicly available as a new benchmark for research purposes.
Anthology ID:
W18-0516
Volume:
Proceedings of the Thirteenth Workshop on Innovative Use of NLP for Building Educational Applications
Month:
June
Year:
2018
Address:
New Orleans, Louisiana
Venue:
BEA
SIG:
SIGEDU
Publisher:
Association for Computational Linguistics
Note:
Pages:
154–158
Language:
URL:
https://aclanthology.org/W18-0516
DOI:
10.18653/v1/W18-0516
Bibkey:
Cite (ACL):
Zhiying Jiang, Boliang Zhang, Lifu Huang, and Heng Ji. 2018. Chengyu Cloze Test. In Proceedings of the Thirteenth Workshop on Innovative Use of NLP for Building Educational Applications, pages 154–158, New Orleans, Louisiana. Association for Computational Linguistics.
Cite (Informal):
Chengyu Cloze Test (Jiang et al., BEA 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/starsem-semeval-split/W18-0516.pdf
Dataset:
 W18-0516.Datasets.zip
Code
 bazingagin/chengyu_data