Abstract
Parallel corpora are indispensable resources for a variety of multilingual natural language processing tasks. This paper presents a technique for fully automatic construction of constantly growing parallel corpora. We propose a simple and effective dictionary-based algorithm to extract parallel document pairs from a large collection of articles retrieved from the Internet, potentially containing manually translated texts. This algorithm was implemented and tested on Hebrew-English parallel texts. With properly selected thresholds, precision of 100% can be obtained.- Anthology ID:
- L10-1019
- Volume:
- Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)
- Month:
- May
- Year:
- 2010
- Address:
- Valletta, Malta
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- Language:
- URL:
- http://www.lrec-conf.org/proceedings/lrec2010/pdf/40_Paper.pdf
- DOI:
- Cite (ACL):
- Yulia Tsvetkov and Shuly Wintner. 2010. Automatic Acquisition of Parallel Corpora from Websites with Dynamic Content. In Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10), Valletta, Malta. European Language Resources Association (ELRA).
- Cite (Informal):
- Automatic Acquisition of Parallel Corpora from Websites with Dynamic Content (Tsvetkov & Wintner, LREC 2010)
- PDF:
- http://www.lrec-conf.org/proceedings/lrec2010/pdf/40_Paper.pdf