Abstract
This paper summarizes the results of our test suite evaluation on 12 machine translation systems submitted at the Shared Task of the 8th Conference of Machine Translation (WMT23) for English-German (en-de) language pair. Our test suite covers five specific domains (entertainment, environment, health, science, legal) and spans five distinct writing styles (descriptive, judgments, narrative, reporting, technical-writing). We present our analysis through automatic evaluation methods, conducted with a focus on domain-specific and writing style-specific evaluations.- Anthology ID:
- 2023.wmt-1.24
- Volume:
- Proceedings of the Eighth Conference on Machine Translation
- Month:
- December
- Year:
- 2023
- Address:
- Singapore
- Editors:
- Philipp Koehn, Barry Haddow, Tom Kocmi, Christof Monz
- Venue:
- WMT
- SIG:
- SIGMT
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 246–251
- Language:
- URL:
- https://aclanthology.org/2023.wmt-1.24
- DOI:
- 10.18653/v1/2023.wmt-1.24
- Cite (ACL):
- Ananya Mukherjee and Manish Shrivastava. 2023. IIIT HYD’s Submission for WMT23 Test-suite Task. In Proceedings of the Eighth Conference on Machine Translation, pages 246–251, Singapore. Association for Computational Linguistics.
- Cite (Informal):
- IIIT HYD’s Submission for WMT23 Test-suite Task (Mukherjee & Shrivastava, WMT 2023)
- PDF:
- https://preview.aclanthology.org/naacl-24-ws-corrections/2023.wmt-1.24.pdf