An Intelligent Testing Strategy for Vocabulary Assessment of Chinese Second Language Learners

Wei Zhou, Renfen Hu, Feipeng Sun, Ronghuai Huang

Abstract
Vocabulary is one of the most important parts of language competence. Testing of vocabulary knowledge is central to research on reading and language. However, it usually costs a large amount of time and human labor to build an item bank and to test large number of students. In this paper, we propose a novel testing strategy by combining automatic item generation (AIG) and computerized adaptive testing (CAT) in vocabulary assessment for Chinese L2 learners. Firstly, we generate three types of vocabulary questions by modeling both the vocabulary knowledge and learners’ writing error data. After evaluation and calibration, we construct a balanced item pool with automatically generated items, and implement a three-parameter computerized adaptive test. We conduct manual item evaluation and online student tests in the experiments. The results show that the combination of AIG and CAT can construct test items efficiently and reduce test cost significantly. Also, the test result of CAT can provide valuable feedback to AIG algorithms.
Anthology ID:
W19-4403
Volume:
Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications
Month:
August
Year:
2019
Address:
Florence, Italy
Editors:
Helen Yannakoudakis, Ekaterina Kochmar, Claudia Leacock, Nitin Madnani, Ildikó Pilán, Torsten Zesch
Venue:
BEA
SIG:
SIGEDU
Publisher:
Association for Computational Linguistics
Note:
Pages:
21–29
Language:
URL:
https://aclanthology.org/W19-4403
DOI:
10.18653/v1/W19-4403
Bibkey:
Cite (ACL):
Wei Zhou, Renfen Hu, Feipeng Sun, and Ronghuai Huang. 2019. An Intelligent Testing Strategy for Vocabulary Assessment of Chinese Second Language Learners. In Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications, pages 21–29, Florence, Italy. Association for Computational Linguistics.
Cite (Informal):
An Intelligent Testing Strategy for Vocabulary Assessment of Chinese Second Language Learners (Zhou et al., BEA 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/emnlp-22-attachments/W19-4403.pdf
PDF Search