How are you doing? A look at MT evaluation

Michelle Vanni, Florence Reeder


Abstract
Machine Translation evaluation has been more magic and opinion than science. The history of MT evaluation is long and checkered - the search for objective, measurable, resource-reduced methods of evaluation continues. A recent trend towards task-based evaluation inspires the question - can we use methods of evaluation of language competence in language learners and apply them reasonably to MT evaluation? This paper is the first in a series of steps to look at this question. In this paper, we will present the theoretical framework for our ideas, the notions we ultimately aim towards and some very preliminary results of a small experiment along these lines.
Anthology ID:
2000.amta-papers.11
Volume:
Proceedings of the Fourth Conference of the Association for Machine Translation in the Americas: Technical Papers
Month:
October 10-14
Year:
2000
Address:
Cuernavaca, Mexico
Venue:
AMTA
SIG:
Publisher:
Springer
Note:
Pages:
109–116
Language:
URL:
https://link.springer.com/chapter/10.1007/3-540-39965-8_11
DOI:
Bibkey:
Cite (ACL):
Michelle Vanni and Florence Reeder. 2000. How are you doing? A look at MT evaluation. In Proceedings of the Fourth Conference of the Association for Machine Translation in the Americas: Technical Papers, pages 109–116, Cuernavaca, Mexico. Springer.
Cite (Informal):
How are you doing? A look at MT evaluation (Vanni & Reeder, AMTA 2000)
Copy Citation:
PDF:
https://link.springer.com/chapter/10.1007/3-540-39965-8_11