Abstract
In this paper some of the problems encountered in designing an evaluation for an MT system will be examined. The source text, in French, provided by INRA (Institut National pour la Recherche Agronomique i.e. National Institute for Agronomic Research) deals with biotechnology and animal reproduction. It has been translated into English. The output of the system (i.e. the result of the assembling of several components), as opposed to its individual modules or specific components (i.e. analysis, generation, grammar, lexicon, core, etc.), will be evaluated. Moreover, the evaluation will concentrate on translation quality and its fidelity to the source text. The evaluation is not comparative, which means that we tested a specific MT system, not necessarily representative of other MT systems that can be found on the market.- Anthology ID:
- 2001.mtsummit-eval.4
- Volume:
- Workshop on MT Evaluation
- Month:
- September 18-22
- Year:
- 2001
- Address:
- Santiago de Compostela, Spain
- Editors:
- Eduard Hovy, Margaret King, Sandra Manzi, Florence Reeder
- Venue:
- MTSummit
- SIG:
- Publisher:
- Note:
- Pages:
- Language:
- URL:
- https://aclanthology.org/2001.mtsummit-eval.4
- DOI:
- Cite (ACL):
- Widad Mustafa El Hadi, Ismail Timimi, and Marianne Dabbadie. 2001. Setting a methodology for machine translation evaluation. In Workshop on MT Evaluation, Santiago de Compostela, Spain.
- Cite (Informal):
- Setting a methodology for machine translation evaluation (Mustafa El Hadi et al., MTSummit 2001)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2001.mtsummit-eval.4.pdf