Enriching Phrase Tables for Statistical Machine Translation Using Mixed Embeddings

Peyman Passban, Qun Liu, Andy Way


Abstract
The phrase table is considered to be the main bilingual resource for the phrase-based statistical machine translation (PBSMT) model. During translation, a source sentence is decomposed into several phrases. The best match of each source phrase is selected among several target-side counterparts within the phrase table, and processed by the decoder to generate a sentence-level translation. The best match is chosen according to several factors, including a set of bilingual features. PBSMT engines by default provide four probability scores in phrase tables which are considered as the main set of bilingual features. Our goal is to enrich that set of features, as a better feature set should yield better translations. We propose new scores generated by a Convolutional Neural Network (CNN) which indicate the semantic relatedness of phrase pairs. We evaluate our model in different experimental settings with different language pairs. We observe significant improvements when the proposed features are incorporated into the PBSMT pipeline.
Anthology ID:
C16-1243
Volume:
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers
Month:
December
Year:
2016
Address:
Osaka, Japan
Editors:
Yuji Matsumoto, Rashmi Prasad
Venue:
COLING
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
2582–2591
Language:
URL:
https://aclanthology.org/C16-1243
DOI:
Bibkey:
Cite (ACL):
Peyman Passban, Qun Liu, and Andy Way. 2016. Enriching Phrase Tables for Statistical Machine Translation Using Mixed Embeddings. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 2582–2591, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
Enriching Phrase Tables for Statistical Machine Translation Using Mixed Embeddings (Passban et al., COLING 2016)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-4/C16-1243.pdf