A Distributed Resource Repository for Cloud-Based Machine Translation

Jörg Tiedemann, Dorte Haltrup Hansen, Lene Offersgaard, Sussi Olsen, Matthias Zumpe

Abstract
In this paper, we present the architecture of a distributed resource repository developed for collecting training data for building customized statistical machine translation systems. The repository is designed for the cloud-based translation service integrated in the Let'sMT! platform which is about to be launched to the public. The system includes important features such as automatic import and alignment of textual documents in a variety of formats, a flexible database for meta-information using modern key-value stores and a grid-based backend for running off-line processes. The entire system is very modular and supports highly distributed setups to enable a maximum of flexibility and scalability. The system uses secure connections and includes an effective permission management to ensure data integrity. In this paper, we also take a closer look at the task of sentence alignment. The process of alignment is extremely important for the success of translation models trained on the platform. Alignment decisions significantly influence the quality of SMT engines.
Anthology ID:
L12-1243
Volume:
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
Month:
May
Year:
2012
Address:
Istanbul, Turkey
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
2207–2213
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/457_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Jörg Tiedemann, Dorte Haltrup Hansen, Lene Offersgaard, Sussi Olsen, and Matthias Zumpe. 2012. A Distributed Resource Repository for Cloud-Based Machine Translation. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 2207–2213, Istanbul, Turkey. European Language Resources Association (ELRA).
Cite (Informal):
A Distributed Resource Repository for Cloud-Based Machine Translation (Tiedemann et al., LREC 2012)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/457_Paper.pdf
PDF Search