Translation errors from English to Portuguese: an annotated corpus

Angela Costa, Tiago Luís, Luísa Coheur


Abstract
Analysing the translation errors is a task that can help us finding and describing translation problems in greater detail, but can also suggest where the automatic engines should be improved. Having these aims in mind we have created a corpus composed of 150 sentences, 50 from the TAP magazine, 50 from a TED talk and the other 50 from the from the TREC collection of factoid questions. We have automatically translated these sentences from English into Portuguese using Google Translate and Moses. After we have analysed the errors and created the error annotation taxonomy, the corpus was annotated by a linguist native speaker of Portuguese. Although Google’s overall performance was better in the translation task (we have also calculated the BLUE and NIST scores), there are some error types that Moses was better at coping with, specially discourse level errors.
Anthology ID:
L14-1201
Volume:
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
Month:
May
Year:
2014
Address:
Reykjavik, Iceland
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
1231–1234
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/199_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Angela Costa, Tiago Luís, and Luísa Coheur. 2014. Translation errors from English to Portuguese: an annotated corpus. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 1231–1234, Reykjavik, Iceland. European Language Resources Association (ELRA).
Cite (Informal):
Translation errors from English to Portuguese: an annotated corpus (Costa et al., LREC 2014)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/199_Paper.pdf