HW-TSC’s Participation in the IWSLT 2022 Isometric Spoken Language Translation
Zongyao Li, Jiaxin Guo, Daimeng Wei, Hengchao Shang, Minghan Wang, Ting Zhu, Zhanglin Wu, Zhengzhe Yu, Xiaoyu Chen, Lizhi Lei, Hao Yang, Ying Qin
Abstract
This paper presents our submissions to the IWSLT 2022 Isometric Spoken Language Translation task. We participate in all three language pairs (English-German, English-French, English-Spanish) under the constrained setting, and submit an English-German result under the unconstrained setting. We use the standard Transformer model as the baseline and obtain the best performance via one of its variants that shares the decoder input and output embedding. We perform detailed pre-processing and filtering on the provided bilingual data. Several strategies are used to train our models, such as Multilingual Translation, Back Translation, Forward Translation, R-Drop, Average Checkpoint, and Ensemble. We investigate three methods for biasing the output length: i) conditioning the output to a given target-source length-ratio class; ii) enriching the transformer positional embedding with length information and iii) length control decoding for non-autoregressive translation etc. Our submissions achieve 30.7, 41.6 and 36.7 BLEU respectively on the tst-COMMON test sets for English-German, English-French, English-Spanish tasks and 100% comply with the length requirements.- Anthology ID:
- 2022.iwslt-1.33
- Volume:
- Proceedings of the 19th International Conference on Spoken Language Translation (IWSLT 2022)
- Month:
- May
- Year:
- 2022
- Address:
- Dublin, Ireland (in-person and online)
- Editors:
- Elizabeth Salesky, Marcello Federico, Marta Costa-jussà
- Venue:
- IWSLT
- SIG:
- SIGSLT
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 361–368
- Language:
- URL:
- https://aclanthology.org/2022.iwslt-1.33
- DOI:
- 10.18653/v1/2022.iwslt-1.33
- Cite (ACL):
- Zongyao Li, Jiaxin Guo, Daimeng Wei, Hengchao Shang, Minghan Wang, Ting Zhu, Zhanglin Wu, Zhengzhe Yu, Xiaoyu Chen, Lizhi Lei, Hao Yang, and Ying Qin. 2022. HW-TSC’s Participation in the IWSLT 2022 Isometric Spoken Language Translation. In Proceedings of the 19th International Conference on Spoken Language Translation (IWSLT 2022), pages 361–368, Dublin, Ireland (in-person and online). Association for Computational Linguistics.
- Cite (Informal):
- HW-TSC’s Participation in the IWSLT 2022 Isometric Spoken Language Translation (Li et al., IWSLT 2022)
- PDF:
- https://preview.aclanthology.org/improve-issue-templates/2022.iwslt-1.33.pdf