Abstract
We conduct a large-scale fine-grained comparative analysis of machine translations (MTs) against human translations (HTs) through the lens of morphosyntactic divergence. Across three language pairs and two types of divergence defined as the structural difference between the source and the target, MT is consistently more conservative than HT, with less morphosyntactic diversity, more convergent patterns, and more one-to-one alignments. Through analysis on different decoding algorithms, we attribute this discrepancy to the use of beam search that biases MT towards more convergent patterns. This bias is most amplified when the convergent pattern appears around 50% of the time in training data. Lastly, we show that for a majority of morphosyntactic divergences, their presence in HT is correlated with decreased MT performance, presenting a greater challenge for MT systems.- Anthology ID:
- 2024.tacl-1.20
- Volume:
- Transactions of the Association for Computational Linguistics, Volume 12
- Month:
- Year:
- 2024
- Address:
- Cambridge, MA
- Venue:
- TACL
- SIG:
- Publisher:
- MIT Press
- Note:
- Pages:
- 355–371
- Language:
- URL:
- https://aclanthology.org/2024.tacl-1.20
- DOI:
- 10.1162/tacl_a_00645
- Cite (ACL):
- Jiaming Luo, Colin Cherry, and George Foster. 2024. To Diverge or Not to Diverge: A Morphosyntactic Perspective on Machine Translation vs Human Translation. Transactions of the Association for Computational Linguistics, 12:355–371.
- Cite (Informal):
- To Diverge or Not to Diverge: A Morphosyntactic Perspective on Machine Translation vs Human Translation (Luo et al., TACL 2024)
- PDF:
- https://preview.aclanthology.org/naacl24-info/2024.tacl-1.20.pdf