Collection of a corpus of Dutch SMS

Maaske Treurniet, Orphée De Clercq, Henk van den Heuvel, Nelleke Oostdijk

Abstract
In this paper we present the first freely available corpus of Dutch text messages containing data originating from the Netherlands and Flanders. This corpus has been collected in the framework of the SoNaR project and constitutes a viable part of this 500-million-word corpus. About 53,000 text messages were collected on a large scale, based on voluntary donations. These messages will be distributed as such. In this paper we focus on the data collection processes involved and after studying the effect of media coverage we show that especially free publicity in newspapers and on social media networks results in more contributions. All SMS are provided with metadata information. Looking at the composition of the corpus, it becomes visible that a small number of people have contributed a large amount of data, in total 272 people have contributed to the corpus during three months. The number of women contributing to the corpus is larger than the number of men, but male contributors submitted larger amounts of data. This corpus will be of paramount importance for sociolinguistic research and normalisation studies.
Anthology ID:
L12-1302
Volume:
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
Month:
May
Year:
2012
Address:
Istanbul, Turkey
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
2268–2273
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/537_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Maaske Treurniet, Orphée De Clercq, Henk van den Heuvel, and Nelleke Oostdijk. 2012. Collection of a corpus of Dutch SMS. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 2268–2273, Istanbul, Turkey. European Language Resources Association (ELRA).
Cite (Informal):
Collection of a corpus of Dutch SMS (Treurniet et al., LREC 2012)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/537_Paper.pdf
PDF Search