Abstract
Speech translation for subtitling (SubST) is the task of automatically translating speech data into well-formed subtitles by inserting subtitle breaks compliant to specific displaying guidelines. Similar to speech translation (ST), model training requires parallel data comprising audio inputs paired with their textual translations. In SubST, however, the text has to be also annotated with subtitle breaks. So far, this requirement has represented a bottleneck for system development, as confirmed by the dearth of publicly available SubST corpora. To fill this gap, we propose a method to convert existing ST corpora into SubST resources without human intervention. We build a segmenter model that automatically segments texts into proper subtitles by exploiting audio and text in a multimodal fashion, achieving high segmentation quality in zero-shot conditions. Comparative experiments with SubST systems respectively trained on manual and automatic segmentations result in similar performance, showing the effectiveness of our approach.- Anthology ID:
- 2022.aacl-short.59
- Volume:
- Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 2: Short Papers)
- Month:
- November
- Year:
- 2022
- Address:
- Online only
- Editors:
- Yulan He, Heng Ji, Sujian Li, Yang Liu, Chua-Hui Chang
- Venues:
- AACL | IJCNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 480–487
- Language:
- URL:
- https://aclanthology.org/2022.aacl-short.59
- DOI:
- Cite (ACL):
- Sara Papi, Alina Karakanta, Matteo Negri, and Marco Turchi. 2022. Dodging the Data Bottleneck: Automatic Subtitling with Automatically Segmented ST Corpora. In Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pages 480–487, Online only. Association for Computational Linguistics.
- Cite (Informal):
- Dodging the Data Bottleneck: Automatic Subtitling with Automatically Segmented ST Corpora (Papi et al., AACL-IJCNLP 2022)
- PDF:
- https://preview.aclanthology.org/naacl24-info/2022.aacl-short.59.pdf