Overview of the IWSLT 2011 evaluation campaign
Marcello Federico, Luisa Bentivogli, Michael Paul, Sebastian Stüker
Abstract
We report here on the eighth Evaluation Campaign organized by the IWSLT workshop. This year, the IWSLT evaluation focused on the automatic translation of public talks and included tracks for speech recognition, speech translation, text translation, and system combination. Unlike previous years, all data supplied for the evaluation has been publicly released on the workshop website, and is at the disposal of researchers interested in working on our benchmarks and in comparing their results with those published at the workshop. This paper provides an overview of the IWSLT 2011 Evaluation Campaign, which includes: descriptions of the supplied data and evaluation specifications of each track, the list of participants specifying their submitted runs, a detailed description of the subjective evaluation carried out, the main findings of each exercise drawn from the results and the system descriptions prepared by the participants, and, finally, several detailed tables reporting all the evaluation results.- Anthology ID:
- 2011.iwslt-evaluation.1
- Volume:
- Proceedings of the 8th International Workshop on Spoken Language Translation: Evaluation Campaign
- Month:
- December 8-9
- Year:
- 2011
- Address:
- San Francisco, California
- Editors:
- Marcello Federico, Mei-Yuh Hwang, Margit Rödder, Sebastian Stüker
- Venue:
- IWSLT
- SIG:
- SIGSLT
- Publisher:
- Note:
- Pages:
- 11–27
- Language:
- URL:
- https://aclanthology.org/2011.iwslt-evaluation.1
- DOI:
- Cite (ACL):
- Marcello Federico, Luisa Bentivogli, Michael Paul, and Sebastian Stüker. 2011. Overview of the IWSLT 2011 evaluation campaign. In Proceedings of the 8th International Workshop on Spoken Language Translation: Evaluation Campaign, pages 11–27, San Francisco, California.
- Cite (Informal):
- Overview of the IWSLT 2011 evaluation campaign (Federico et al., IWSLT 2011)
- PDF:
- https://preview.aclanthology.org/add_acl24_videos/2011.iwslt-evaluation.1.pdf