Abstract
This paper presents the evaluation of the translation quality and Cross-Lingual Information Retrieval (CLIR) performance when using session information as the context of queries. The hypothesis is that previous queries provide context that helps to solve ambiguous translations in the current query. We tested several strategies on the TREC 2010 Session track dataset, which includes query reformulations grouped by generalization, specification, and drifting types. We study the Basque to English direction, evaluating both the translation quality and CLIR performance, with positive results in both cases. The results show that the quality of translation improved, reducing error rate by 12% (HTER) when using session information, which improved CLIR results 5% (nDCG). We also provide an analysis of the improvements across the three kinds of sessions: generalization, specification, and drifting. Translation quality improved in all three types (generalization, specification, and drifting), and CLIR improved for generalization and specification sessions, preserving the performance in drifting sessions.- Anthology ID:
- L16-1064
- Volume:
- Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
- Month:
- May
- Year:
- 2016
- Address:
- Portorož, Slovenia
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 407–411
- Language:
- URL:
- https://aclanthology.org/L16-1064
- DOI:
- Cite (ACL):
- Xabier Saralegi, Eneko Agirre, and Iñaki Alegria. 2016. Evaluating Translation Quality and CLIR Performance of Query Sessions. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 407–411, Portorož, Slovenia. European Language Resources Association (ELRA).
- Cite (Informal):
- Evaluating Translation Quality and CLIR Performance of Query Sessions (Saralegi et al., LREC 2016)
- PDF:
- https://preview.aclanthology.org/nodalida-main-page/L16-1064.pdf