Consistent Classification of Translation Revisions: A Case Study of English-Japanese Student Translations

Atsushi Fujita, Kikuko Tanabe, Chiho Toyoshima, Mayuka Yamamoto, Kyo Kageura, Anthony Hartley

Abstract
Consistency is a crucial requirement in text annotation. It is especially important in educational applications, as lack of consistency directly affects learners’ motivation and learning performance. This paper presents a quality assessment scheme for English-to-Japanese translations produced by learner translators at university. We constructed a revision typology and a decision tree manually through an application of the OntoNotes method, i.e., an iteration of assessing learners’ translations and hypothesizing the conditions for consistent decision making, as well as re-organizing the typology. Intrinsic evaluation of the created scheme confirmed its potential contribution to the consistent classification of identified erroneous text spans, achieving visibly higher Cohen’s kappa values, up to 0.831, than previous work. This paper also describes an application of our scheme to an English-to-Japanese translation exercise course for undergraduate students at a university in Japan.
Anthology ID:
W17-0807
Volume:
Proceedings of the 11th Linguistic Annotation Workshop
Month:
April
Year:
2017
Address:
Valencia, Spain
Editors:
Nathan Schneider, Nianwen Xue
Venue:
LAW
SIG:
SIGANN
Publisher:
Association for Computational Linguistics
Note:
Pages:
57–66
Language:
URL:
https://aclanthology.org/W17-0807
DOI:
10.18653/v1/W17-0807
Bibkey:
Cite (ACL):
Atsushi Fujita, Kikuko Tanabe, Chiho Toyoshima, Mayuka Yamamoto, Kyo Kageura, and Anthony Hartley. 2017. Consistent Classification of Translation Revisions: A Case Study of English-Japanese Student Translations. In Proceedings of the 11th Linguistic Annotation Workshop, pages 57–66, Valencia, Spain. Association for Computational Linguistics.
Cite (Informal):
Consistent Classification of Translation Revisions: A Case Study of English-Japanese Student Translations (Fujita et al., LAW 2017)
Copy Citation:
PDF:
https://preview.aclanthology.org/add_acl24_videos/W17-0807.pdf
PDF Search