Abstract
Lexicalized and hierarchical reordering models use relative frequencies of fully lexicalized phrase pairs to learn phrase reordering distributions. This results in unreliable estimation for infrequent phrase pairs which also tend to be longer phrases. There are some smoothing techniques used to smooth the distributions in these models. But these techniques are unable to address the similarities between phrase pairs and their reordering distributions. We propose two models to use shorter sub-phrase pairs of an original phrase pair to smooth the phrase reordering distributions. In the first model we follow the classic idea of backing off to shorter histories commonly used in language model smoothing. In the second model, we use syntactic dependencies to identify the most relevant words in a phrase to back off to. We show how these models can be easily applied to existing lexicalized and hierarchical reordering models. Our models achieve improvements of up to 0.40 BLEU points in Chinese-English translation compared to a baseline which uses a regular lexicalized reordering model and a hierarchical reordering model. The results show that not all the words inside a phrase pair are equally important in defining phrase reordering behavior and shortening towards important words will decrease the sparsity problem for long phrase pairs.- Anthology ID:
- 2016.amta-researchers.12
- Volume:
- Conferences of the Association for Machine Translation in the Americas: MT Researchers' Track
- Month:
- October 28 - November 1
- Year:
- 2016
- Address:
- Austin, TX, USA
- Editors:
- Spence Green, Lane Schwartz
- Venue:
- AMTA
- SIG:
- Publisher:
- The Association for Machine Translation in the Americas
- Note:
- Pages:
- 149–162
- Language:
- URL:
- https://aclanthology.org/2016.amta-researchers.12
- DOI:
- Cite (ACL):
- Hamidreza Ghader and Christof Monz. 2016. Which Words Matter in Defining Phrase Reordering Behavior in Statistical Machine Translation?. In Conferences of the Association for Machine Translation in the Americas: MT Researchers' Track, pages 149–162, Austin, TX, USA. The Association for Machine Translation in the Americas.
- Cite (Informal):
- Which Words Matter in Defining Phrase Reordering Behavior in Statistical Machine Translation? (Ghader & Monz, AMTA 2016)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-2/2016.amta-researchers.12.pdf