HW-TSC’s Simultaneous Speech Translation System for IWSLT 2024
Shaojun Li, Zhiqiang Rao, Bin Wei, Yuanchang Luo, Zhanglin Wu, Zongyao Li, Hengchao Shang, Jiaxin Guo, Daimeng Wei, Hao Yang
Abstract
This paper outlines our submission for the IWSLT 2024 Simultaneous Speech-to-Text (SimulS2T) and Speech-to-Speech (SimulS2S) Translation competition. We have engaged in all four language directions and both the SimulS2T and SimulS2S tracks: English-German (EN-DE), English-Chinese (EN-ZH), English-Japanese (EN-JA), and Czech-English (CS-EN). For the S2T track, we have built upon our previous year’s system and further honed the cascade system composed of ASR model and MT model. Concurrently, we have introduced an end-to-end system specifically for the CS-EN direction. This end-to-end (E2E) system primarily employs the pre-trained seamlessM4T model. In relation to the SimulS2S track, we have integrated a novel TTS model into our SimulS2T system. The final submission for the S2T directions of EN-DE, EN-ZH, and EN-JA has been refined over our championship system from last year. Building upon this foundation, the incorporation of the new TTS into our SimulS2S system has resulted in the ASR-BLEU surpassing last year’s best score.- Anthology ID:
- 2024.iwslt-1.32
- Volume:
- Proceedings of the 21st International Conference on Spoken Language Translation (IWSLT 2024)
- Month:
- August
- Year:
- 2024
- Address:
- Bangkok, Thailand (in-person and online)
- Editors:
- Elizabeth Salesky, Marcello Federico, Marine Carpuat
- Venue:
- IWSLT
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 274–279
- Language:
- URL:
- https://preview.aclanthology.org/build-pipeline-with-new-library/2024.iwslt-1.32/
- DOI:
- 10.18653/v1/2024.iwslt-1.32
- Cite (ACL):
- Shaojun Li, Zhiqiang Rao, Bin Wei, Yuanchang Luo, Zhanglin Wu, Zongyao Li, Hengchao Shang, Jiaxin Guo, Daimeng Wei, and Hao Yang. 2024. HW-TSC’s Simultaneous Speech Translation System for IWSLT 2024. In Proceedings of the 21st International Conference on Spoken Language Translation (IWSLT 2024), pages 274–279, Bangkok, Thailand (in-person and online). Association for Computational Linguistics.
- Cite (Informal):
- HW-TSC’s Simultaneous Speech Translation System for IWSLT 2024 (Li et al., IWSLT 2024)
- PDF:
- https://preview.aclanthology.org/build-pipeline-with-new-library/2024.iwslt-1.32.pdf