Abstract
The paper presents our participation in the WMT 2018 Metrics Shared Task. We propose an improved version of Translation Edit/Error Rate (TER). In addition to including the basic edit operations in TER, namely - insertion, deletion, substitution and shift, our metric also allows stem matching, optimizable edit costs and better normalization so as to correlate better with human judgement scores. The proposed metric shows much higher correlation with human judgments than TER.- Anthology ID:
- W18-6455
- Volume:
- Proceedings of the Third Conference on Machine Translation: Shared Task Papers
- Month:
- October
- Year:
- 2018
- Address:
- Belgium, Brussels
- Venue:
- WMT
- SIG:
- SIGMT
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 746–750
- Language:
- URL:
- https://aclanthology.org/W18-6455
- DOI:
- 10.18653/v1/W18-6455
- Cite (ACL):
- Joybrata Panja and Sudip Kumar Naskar. 2018. ITER: Improving Translation Edit Rate through Optimizable Edit Costs. In Proceedings of the Third Conference on Machine Translation: Shared Task Papers, pages 746–750, Belgium, Brussels. Association for Computational Linguistics.
- Cite (Informal):
- ITER: Improving Translation Edit Rate through Optimizable Edit Costs (Panja & Naskar, WMT 2018)
- PDF:
- https://preview.aclanthology.org/paclic-22-ingestion/W18-6455.pdf