Subtitles to Segmentation: Improving Low-Resource Speech-to-TextTranslation Pipelines
David Wan, Zhengping Jiang, Chris Kedzie, Elsbeth Turcan, Peter Bell, Kathy McKeown
Abstract
In this work, we focus on improving ASR output segmentation in the context of low-resource language speech-to-text translation. ASR output segmentation is crucial, as ASR systems segment the input audio using purely acoustic information and are not guaranteed to output sentence-like segments. Since most MT systems expect sentences as input, feeding in longer unsegmented passages can lead to sub-optimal performance. We explore the feasibility of using datasets of subtitles from TV shows and movies to train better ASR segmentation models. We further incorporate part-of-speech (POS) tag and dependency label information (derived from the unsegmented ASR outputs) into our segmentation model. We show that this noisy syntactic information can improve model accuracy. We evaluate our models intrinsically on segmentation quality and extrinsically on downstream MT performance, as well as downstream tasks including cross-lingual information retrieval (CLIR) tasks and human relevance assessments. Our model shows improved performance on downstream tasks for Lithuanian and Bulgarian.- Anthology ID:
- 2020.clssts-1.11
- Volume:
- Proceedings of the workshop on Cross-Language Search and Summarization of Text and Speech (CLSSTS2020)
- Month:
- May
- Year:
- 2020
- Address:
- Marseille, France
- Editors:
- Kathy McKeown, Douglas W. Oard, Elizabeth, Richard Schwartz
- Venue:
- CLSSTS
- SIG:
- Publisher:
- European Language Resources Association
- Note:
- Pages:
- 68–73
- Language:
- English
- URL:
- https://aclanthology.org/2020.clssts-1.11
- DOI:
- Cite (ACL):
- David Wan, Zhengping Jiang, Chris Kedzie, Elsbeth Turcan, Peter Bell, and Kathy McKeown. 2020. Subtitles to Segmentation: Improving Low-Resource Speech-to-TextTranslation Pipelines. In Proceedings of the workshop on Cross-Language Search and Summarization of Text and Speech (CLSSTS2020), pages 68–73, Marseille, France. European Language Resources Association.
- Cite (Informal):
- Subtitles to Segmentation: Improving Low-Resource Speech-to-TextTranslation Pipelines (Wan et al., CLSSTS 2020)
- PDF:
- https://preview.aclanthology.org/ingest-acl-2023-videos/2020.clssts-1.11.pdf