Modeling Discourse Structure for Document-level Neural Machine Translation
Junxuan Chen, Xiang Li, Jiarui Zhang, Chulun Zhou, Jianwei Cui, Bin Wang, Jinsong Su
Abstract
Recently, document-level neural machine translation (NMT) has become a hot topic in the community of machine translation. Despite its success, most of existing studies ignored the discourse structure information of the input document to be translated, which has shown effective in other tasks. In this paper, we propose to improve document-level NMT with the aid of discourse structure information. Our encoder is based on a hierarchical attention network (HAN) (Miculicich et al., 2018). Specifically, we first parse the input document to obtain its discourse structure. Then, we introduce a Transformer-based path encoder to embed the discourse structure information of each word. Finally, we combine the discourse structure information with the word embedding before it is fed into the encoder. Experimental results on the English-to-German dataset show that our model can significantly outperform both Transformer and Transformer+HAN.- Anthology ID:
- 2020.autosimtrans-1.5
- Volume:
- Proceedings of the First Workshop on Automatic Simultaneous Translation
- Month:
- July
- Year:
- 2020
- Address:
- Seattle, Washington
- Editors:
- Hua Wu, Colin Cherry, Liang Huang, Zhongjun He, Mark Liberman, James Cross, Yang Liu
- Venue:
- AutoSimTrans
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 30–36
- Language:
- URL:
- https://aclanthology.org/2020.autosimtrans-1.5
- DOI:
- 10.18653/v1/2020.autosimtrans-1.5
- Cite (ACL):
- Junxuan Chen, Xiang Li, Jiarui Zhang, Chulun Zhou, Jianwei Cui, Bin Wang, and Jinsong Su. 2020. Modeling Discourse Structure for Document-level Neural Machine Translation. In Proceedings of the First Workshop on Automatic Simultaneous Translation, pages 30–36, Seattle, Washington. Association for Computational Linguistics.
- Cite (Informal):
- Modeling Discourse Structure for Document-level Neural Machine Translation (Chen et al., AutoSimTrans 2020)
- PDF:
- https://preview.aclanthology.org/proper-vol2-ingestion/2020.autosimtrans-1.5.pdf