Abstract
Text corpora represent the foundation on which most natural language processing systems rely. However, for many languages, collecting or building a text corpus of a sufficient size still remains a complex issue, especially for corpora that are accessible and distributed under a clear license allowing modification (such as annotation) and further resharing. In this paper, we review the sources of text corpora usually called upon to fill the gap in low-resource contexts, and how crowdsourcing has been used to build linguistic resources. Then, we present our own experiments with crowdsourcing text corpora and an analysis of the obstacles we encountered. Although the results obtained in terms of participation are still unsatisfactory, we advocate that the effort towards a greater involvement of the speakers should be pursued, especially when the language of interest is newly written.- Anthology ID:
- 2020.sltu-1.15
- Volume:
- Proceedings of the 1st Joint Workshop on Spoken Language Technologies for Under-resourced languages (SLTU) and Collaboration and Computing for Under-Resourced Languages (CCURL)
- Month:
- May
- Year:
- 2020
- Address:
- Marseille, France
- Editors:
- Dorothee Beermann, Laurent Besacier, Sakriani Sakti, Claudia Soria
- Venue:
- SLTU
- SIG:
- Publisher:
- European Language Resources association
- Note:
- Pages:
- 111–120
- Language:
- English
- URL:
- https://aclanthology.org/2020.sltu-1.15
- DOI:
- Cite (ACL):
- Alice Millour and Karën Fort. 2020. Text Corpora and the Challenge of Newly Written Languages. In Proceedings of the 1st Joint Workshop on Spoken Language Technologies for Under-resourced languages (SLTU) and Collaboration and Computing for Under-Resourced Languages (CCURL), pages 111–120, Marseille, France. European Language Resources association.
- Cite (Informal):
- Text Corpora and the Challenge of Newly Written Languages (Millour & Fort, SLTU 2020)
- PDF:
- https://preview.aclanthology.org/teach-a-man-to-fish/2020.sltu-1.15.pdf