Pragmatics-based translation and MT evaluation

David Farwell, Stephen Helmreich


Abstract
In this paper the authors wish to present a view of translation equivalence related to a pragmatics-based approach to machine translation. We will argue that current evaluation methods which assume that there is a predictable correspondence between language forms cannot adequately account for this view. We will then describe a method for objectively determining the relative equivalence of two texts. However, given the need for both an open world assumption and non-monotonic inferencing, such a method cannot be realistically implemented and therefore certain "classic" evaluation strategies will continue to be preferable as practical methods of evaluation.
Anthology ID:
2003.mtsummit-eval.3
Volume:
Workshop on Systemizing MT Evaluation
Month:
September 23-27
Year:
2003
Address:
New Orleans, USA
Venue:
MTSummit
SIG:
Publisher:
Note:
Pages:
Language:
URL:
https://aclanthology.org/2003.mtsummit-eval.3
DOI:
Bibkey:
Cite (ACL):
David Farwell and Stephen Helmreich. 2003. Pragmatics-based translation and MT evaluation. In Workshop on Systemizing MT Evaluation, New Orleans, USA.
Cite (Informal):
Pragmatics-based translation and MT evaluation (Farwell & Helmreich, MTSummit 2003)
Copy Citation:
PDF:
https://preview.aclanthology.org/emnlp-22-attachments/2003.mtsummit-eval.3.pdf