NICT’s Neural Machine Translation Systems for the WAT21 Restricted Translation Task

Zuchao Li, Masao Utiyama, Eiichiro Sumita, Hai Zhao


Abstract
This paper describes our system (Team ID: nictrb) for participating in the WAT’21 restricted machine translation task. In our submitted system, we designed a new training approach for restricted machine translation. By sampling from the translation target, we can solve the problem that ordinary training data does not have a restricted vocabulary. With the further help of constrained decoding in the inference phase, we achieved better results than the baseline, confirming the effectiveness of our solution. In addition, we also tried the vanilla and sparse Transformer as the backbone network of the model, as well as model ensembling, which further improved the final translation performance.
Anthology ID:
2021.wat-1.4
Volume:
Proceedings of the 8th Workshop on Asian Translation (WAT2021)
Month:
August
Year:
2021
Address:
Online
Venues:
ACL | IJCNLP | WAT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
62–67
Language:
URL:
https://aclanthology.org/2021.wat-1.4
DOI:
10.18653/v1/2021.wat-1.4
Bibkey:
Cite (ACL):
Zuchao Li, Masao Utiyama, Eiichiro Sumita, and Hai Zhao. 2021. NICT’s Neural Machine Translation Systems for the WAT21 Restricted Translation Task. In Proceedings of the 8th Workshop on Asian Translation (WAT2021), pages 62–67, Online. Association for Computational Linguistics.
Cite (Informal):
NICT’s Neural Machine Translation Systems for the WAT21 Restricted Translation Task (Li et al., WAT 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/update-css-js/2021.wat-1.4.pdf