Benchmarking of English-Hindi parallel corpora

Jayendra Rakesh Yeka, Prasanth Kolachina, Dipti Misra Sharma


Abstract
In this paper we present several parallel corpora for English↔Hindi and talk about their natures and domains. We also discuss briefly a few previous attempts in MT for translation from English to Hindi. The lack of uniformly annotated data makes it difficult to compare these attempts and precisely analyze their strengths and shortcomings. With this in mind, we propose a standard pipeline to provide uniform linguistic annotations to these resources using state-of-art NLP technologies. We conclude the paper by presenting evaluation scores of different statistical MT systems on the corpora detailed in this paper for English→Hindi and present the proposed plans for future work. We hope that both these annotated parallel corpora resources and MT systems will serve as benchmarks for future approaches to MT in English→Hindi. This was and remains the main motivation for the attempts detailed in this paper.
Anthology ID:
L14-1095
Volume:
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
Month:
May
Year:
2014
Address:
Reykjavik, Iceland
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
1812–1818
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/1137_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Jayendra Rakesh Yeka, Prasanth Kolachina, and Dipti Misra Sharma. 2014. Benchmarking of English-Hindi parallel corpora. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 1812–1818, Reykjavik, Iceland. European Language Resources Association (ELRA).
Cite (Informal):
Benchmarking of English-Hindi parallel corpora (Yeka et al., LREC 2014)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/1137_Paper.pdf