Abstract
Live video streaming has become an important form of communication such as virtual conferences. However, for cross-language communication in live video streaming, reading subtitles degrades the viewing experience. To address this problem, our simultaneous dubbing prototype translates and replaces the original speech of a live video stream in a simultaneous manner. Tests on a collection of 90 public videos show that our system achieves a low average latency of 11.90 seconds for smooth playback. Our method is general and can be extended to other language pairs.- Anthology ID:
- 2023.acl-demo.16
- Volume:
- Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)
- Month:
- July
- Year:
- 2023
- Address:
- Toronto, Canada
- Editors:
- Danushka Bollegala, Ruihong Huang, Alan Ritter
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 169–178
- Language:
- URL:
- https://aclanthology.org/2023.acl-demo.16
- DOI:
- 10.18653/v1/2023.acl-demo.16
- Cite (ACL):
- Xiaolin Wang, Masao Utiyama, and Eiichiro Sumita. 2023. Japanese-to-English Simultaneous Dubbing Prototype. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations), pages 169–178, Toronto, Canada. Association for Computational Linguistics.
- Cite (Informal):
- Japanese-to-English Simultaneous Dubbing Prototype (Wang et al., ACL 2023)
- PDF:
- https://preview.aclanthology.org/revert-3132-ingestion-checklist/2023.acl-demo.16.pdf