Abstract
This study introduces and evaluates a computerized approach to measuring Japanese L2 oral proficiency. We present a testing and scoring method that uses a type of structured speech called elicited imitation (EI) to evaluate accuracy of speech productions. Several types of language resources and toolkits are required to develop, administer, and score responses to this test. First, we present a corpus-based test item creation method to produce EI items with targeted linguistic features in a principled and efficient manner. Second, we sketch how we are able to bootstrap a small learner speech corpus to generate a significantly large corpus of training data for language model construction. Lastly, we show how newly created test items effectively classify learners according to their L2 speaking capability and illustrate how our scoring method computes a metric for language proficiency that correlates well with more traditional human scoring methods.- Anthology ID:
- L12-1093
- Volume:
- Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
- Month:
- May
- Year:
- 2012
- Address:
- Istanbul, Turkey
- Editors:
- Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 2682–2689
- Language:
- URL:
- http://www.lrec-conf.org/proceedings/lrec2012/pdf/241_Paper.pdf
- DOI:
- Cite (ACL):
- Hitokazu Matsushita and Deryle Lonsdale. 2012. Item Development and Scoring for Japanese Oral Proficiency Testing. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 2682–2689, Istanbul, Turkey. European Language Resources Association (ELRA).
- Cite (Informal):
- Item Development and Scoring for Japanese Oral Proficiency Testing (Matsushita & Lonsdale, LREC 2012)
- PDF:
- http://www.lrec-conf.org/proceedings/lrec2012/pdf/241_Paper.pdf