Consistent Classification of Translation Revisions: A Case Study of English-Japanese Student Translations
Atsushi Fujita, Kikuko Tanabe, Chiho Toyoshima, Mayuka Yamamoto, Kyo Kageura, Anthony Hartley
Abstract
Consistency is a crucial requirement in text annotation. It is especially important in educational applications, as lack of consistency directly affects learners’ motivation and learning performance. This paper presents a quality assessment scheme for English-to-Japanese translations produced by learner translators at university. We constructed a revision typology and a decision tree manually through an application of the OntoNotes method, i.e., an iteration of assessing learners’ translations and hypothesizing the conditions for consistent decision making, as well as re-organizing the typology. Intrinsic evaluation of the created scheme confirmed its potential contribution to the consistent classification of identified erroneous text spans, achieving visibly higher Cohen’s kappa values, up to 0.831, than previous work. This paper also describes an application of our scheme to an English-to-Japanese translation exercise course for undergraduate students at a university in Japan.- Anthology ID:
- W17-0807
- Volume:
- Proceedings of the 11th Linguistic Annotation Workshop
- Month:
- April
- Year:
- 2017
- Address:
- Valencia, Spain
- Editors:
- Nathan Schneider, Nianwen Xue
- Venue:
- LAW
- SIG:
- SIGANN
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 57–66
- Language:
- URL:
- https://aclanthology.org/W17-0807
- DOI:
- 10.18653/v1/W17-0807
- Cite (ACL):
- Atsushi Fujita, Kikuko Tanabe, Chiho Toyoshima, Mayuka Yamamoto, Kyo Kageura, and Anthony Hartley. 2017. Consistent Classification of Translation Revisions: A Case Study of English-Japanese Student Translations. In Proceedings of the 11th Linguistic Annotation Workshop, pages 57–66, Valencia, Spain. Association for Computational Linguistics.
- Cite (Informal):
- Consistent Classification of Translation Revisions: A Case Study of English-Japanese Student Translations (Fujita et al., LAW 2017)
- PDF:
- https://preview.aclanthology.org/naacl24-info/W17-0807.pdf