A Comparison of Two Variant Corpora: The Same Content with Different Source

Kyonghee Paik, Kiyonori Ohtake, Kazuhide Yamamoto


Abstract
In order to investigate the effect of source language on translations, we investigate two variants of a Korean translation corpus. The first variant consists of Korean translations of 162,308 Japanese sentences from the ATR BTEC (Basic Expression Text Corpus). The second variant was made by translating the English translations of the Japanese sentences into Korean. We show that the source language text has a large influence on the target text. Even after normalizing orthographic differences, fewer than 8.3\% of the sentences in the two variants were identical. We describe in general which phenomena differ and then discuss how our analysis can be used in natural language processing.
Anthology ID:
L04-1249
Volume:
Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC’04)
Month:
May
Year:
2004
Address:
Lisbon, Portugal
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2004/pdf/424.pdf
DOI:
Bibkey:
Cite (ACL):
Kyonghee Paik, Kiyonori Ohtake, and Kazuhide Yamamoto. 2004. A Comparison of Two Variant Corpora: The Same Content with Different Source. In Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC’04), Lisbon, Portugal. European Language Resources Association (ELRA).
Cite (Informal):
A Comparison of Two Variant Corpora: The Same Content with Different Source (Paik et al., LREC 2004)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2004/pdf/424.pdf