Multi-language Speech Collection for NIST LRE
Karen Jones, Stephanie Strassel, Kevin Walker, David Graff, Jonathan Wright
Abstract
The Multi-language Speech (MLS) Corpus supports NIST’s Language Recognition Evaluation series by providing new conversational telephone speech and broadcast narrowband data in 20 languages/dialects. The corpus was built with the intention of testing system performance in the matter of distinguishing closely related or confusable linguistic varieties, and careful manual auditing of collected data was an important aspect of this work. This paper lists the specific data requirements for the collection and provides both a commentary on the rationale for those requirements as well as an outline of the various steps taken to ensure all goals were met as specified. LDC conducted a large-scale recruitment effort involving the implementation of candidate assessment and interview techniques suitable for hiring a large contingent of telecommuting workers, and this recruitment effort is discussed in detail. We also describe the telephone and broadcast collection infrastructure and protocols, and provide details of the steps taken to pre-process collected data prior to auditing. Finally, annotation training, procedures and outcomes are presented in detail.- Anthology ID:
- L16-1674
- Volume:
- Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
- Month:
- May
- Year:
- 2016
- Address:
- Portorož, Slovenia
- Editors:
- Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 4253–4258
- Language:
- URL:
- https://preview.aclanthology.org/build-pipeline-with-new-library/L16-1674/
- DOI:
- Cite (ACL):
- Karen Jones, Stephanie Strassel, Kevin Walker, David Graff, and Jonathan Wright. 2016. Multi-language Speech Collection for NIST LRE. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 4253–4258, Portorož, Slovenia. European Language Resources Association (ELRA).
- Cite (Informal):
- Multi-language Speech Collection for NIST LRE (Jones et al., LREC 2016)
- PDF:
- https://preview.aclanthology.org/build-pipeline-with-new-library/L16-1674.pdf