Abstract
We present work on handling XML markup in Statistical Machine Translation (SMT). The methods we propose can be used to effectively preserve markup (for instance inline formatting or structure) and to place markup correctly in a machine-translated segment. We evaluate our approaches with parallel data that naturally contains markup or where markup was inserted to create synthetic examples. In our experiments, hybrid reinsertion has proven the most accurate method to handle markup, while alignment masking and alignment reinsertion should be regarded as viable alternatives. We provide implementations of all the methods described and they are freely available as an open-source framework.- Anthology ID:
- W17-4804
- Volume:
- Proceedings of the Third Workshop on Discourse in Machine Translation
- Month:
- September
- Year:
- 2017
- Address:
- Copenhagen, Denmark
- Editors:
- Bonnie Webber, Andrei Popescu-Belis, Jörg Tiedemann
- Venue:
- DiscoMT
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 36–46
- Language:
- URL:
- https://aclanthology.org/W17-4804
- DOI:
- 10.18653/v1/W17-4804
- Cite (ACL):
- Mathias Müller. 2017. Treatment of Markup in Statistical Machine Translation. In Proceedings of the Third Workshop on Discourse in Machine Translation, pages 36–46, Copenhagen, Denmark. Association for Computational Linguistics.
- Cite (Informal):
- Treatment of Markup in Statistical Machine Translation (Müller, DiscoMT 2017)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/W17-4804.pdf