HW-TSC at IWSLT2023: Break the Quality Ceiling of Offline Track via Pre-Training and Domain Adaptation

Zongyao Li, Zhanglin Wu, Zhiqiang Rao, Xie YuHao, Guo JiaXin, Daimeng Wei, Hengchao Shang, Wang Minghan, Xiaoyu Chen, Zhengzhe Yu, Li ShaoJun, Lei LiZhi, Hao Yang

Abstract
This paper presents HW-TSC’s submissions to the IWSLT 2023 Offline Speech Translation task, including speech translation of talks from English to German, Chinese, and Japanese, respectively. We participate in all three conditions (constrained training, constrained with large language models training, and unconstrained training) with models of cascaded architectures. We use data enhancement, pre-training models and other means to improve the ASR quality, and R-Drop, deep model, domain data selection, etc. to improve the translation quality. Compared with last year’s best results, we achieve 2.1 BLEU improvement on the MuST-C English-German test set.
Anthology ID:
2023.iwslt-1.14
Volume:
Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023)
Month:
July
Year:
2023
Address:
Toronto, Canada (in-person and online)
Venue:
IWSLT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
187–193
Language:
URL:
https://aclanthology.org/2023.iwslt-1.14
DOI:
Bibkey:
Cite (ACL):
Zongyao Li, Zhanglin Wu, Zhiqiang Rao, Xie YuHao, Guo JiaXin, Daimeng Wei, Hengchao Shang, Wang Minghan, Xiaoyu Chen, Zhengzhe Yu, Li ShaoJun, Lei LiZhi, and Hao Yang. 2023. HW-TSC at IWSLT2023: Break the Quality Ceiling of Offline Track via Pre-Training and Domain Adaptation. In Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023), pages 187–193, Toronto, Canada (in-person and online). Association for Computational Linguistics.
Cite (Informal):
HW-TSC at IWSLT2023: Break the Quality Ceiling of Offline Track via Pre-Training and Domain Adaptation (Li et al., IWSLT 2023)
Copy Citation:
PDF:
https://preview.aclanthology.org/nodalida-main-page/2023.iwslt-1.14.pdf
PDF Search