A Shared Task for Spoken CALL?
Claudia Baur, Johanna Gerlach, Manny Rayner, Martin Russell, Helmer Strik
Abstract
We argue that the field of spoken CALL needs a shared task in order to facilitate comparisons between different groups and methodologies, and describe a concrete example of such a task, based on data collected from a speech-enabled online tool which has been used to help young Swiss German teens practise skills in English conversation. Items are prompt-response pairs, where the prompt is a piece of German text and the response is a recorded English audio file. The task is to label pairs as “accept” or “reject”, accepting responses which are grammatically and linguistically correct to match a set of hidden gold standard answers as closely as possible. Initial resources are provided so that a scratch system can be constructed with a minimal investment of effort, and in particular without necessarily using a speech recogniser. Training data for the task will be released in June 2016, and test data in January 2017.- Anthology ID:
- L16-1036
- Volume:
- Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
- Month:
- May
- Year:
- 2016
- Address:
- Portorož, Slovenia
- Editors:
- Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 237–244
- Language:
- URL:
- https://aclanthology.org/L16-1036
- DOI:
- Cite (ACL):
- Claudia Baur, Johanna Gerlach, Manny Rayner, Martin Russell, and Helmer Strik. 2016. A Shared Task for Spoken CALL?. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 237–244, Portorož, Slovenia. European Language Resources Association (ELRA).
- Cite (Informal):
- A Shared Task for Spoken CALL? (Baur et al., LREC 2016)
- PDF:
- https://preview.aclanthology.org/ingest-acl-2023-videos/L16-1036.pdf