Parallel Global Voices: a Collection of Multilingual Corpora with Citizen Media Stories

Prokopis Prokopidis, Vassilis Papavassiliou, Stelios Piperidis


Abstract
We present a new collection of multilingual corpora automatically created from the content available in the Global Voices websites, where volunteers have been posting and translating citizen media stories since 2004. We describe how we crawled and processed this content to generate parallel resources comprising 302.6K document pairs and 8.36M segment alignments in 756 language pairs. For some language pairs, the segment alignments in this resource are the first open examples of their kind. In an initial use of this resource, we discuss how a set of document pair detection algorithms performs on the Greek-English corpus.
Anthology ID:
L16-1144
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
900–905
Language:
URL:
https://aclanthology.org/L16-1144
DOI:
Bibkey:
Cite (ACL):
Prokopis Prokopidis, Vassilis Papavassiliou, and Stelios Piperidis. 2016. Parallel Global Voices: a Collection of Multilingual Corpora with Citizen Media Stories. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 900–905, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
Parallel Global Voices: a Collection of Multilingual Corpora with Citizen Media Stories (Prokopidis et al., LREC 2016)
Copy Citation:
PDF:
https://preview.aclanthology.org/remove-xml-comments/L16-1144.pdf