Designing a Frame-Semantic Machine Translation Evaluation Metric
Oliver Czulo, Tiago Timponi Torrent, Ely Edison da Silva Matos, Alexandre Diniz da Costa, Debanjana Kar
Abstract
We propose a metric for machine translation evaluation based on frame semantics which does not require the use of reference translations or human corrections, but is aimed at comparing original and translated output directly. The metrics is described on the basis of an existing manual frame-semantic annotation of a parallel corpus with an English original and a Brazilian Portuguese and a German translation. We discuss implications of our metrics design, including the potential of scaling it for multiple languages.- Anthology ID:
- W19-8704
- Volume:
- Proceedings of the Human-Informed Translation and Interpreting Technology Workshop (HiT-IT 2019)
- Month:
- September
- Year:
- 2019
- Address:
- Varna, Bulgaria
- Venue:
- RANLP
- SIG:
- Publisher:
- Incoma Ltd., Shoumen, Bulgaria
- Note:
- Pages:
- 28–35
- Language:
- URL:
- https://aclanthology.org/W19-8704
- DOI:
- 10.26615/issn.2683-0078.2019_004
- Cite (ACL):
- Oliver Czulo, Tiago Timponi Torrent, Ely Edison da Silva Matos, Alexandre Diniz da Costa, and Debanjana Kar. 2019. Designing a Frame-Semantic Machine Translation Evaluation Metric. In Proceedings of the Human-Informed Translation and Interpreting Technology Workshop (HiT-IT 2019), pages 28–35, Varna, Bulgaria. Incoma Ltd., Shoumen, Bulgaria.
- Cite (Informal):
- Designing a Frame-Semantic Machine Translation Evaluation Metric (Czulo et al., RANLP 2019)
- PDF:
- https://preview.aclanthology.org/fix-dup-bibkey/W19-8704.pdf