<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="correa-2003-fine">
    <titleInfo>
        <title>A fine-grained evaluation framework for machine translation system development</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Nelson</namePart>
        <namePart type="family">Correa</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2003-sep&quot; 23-27&quot;</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of Machine Translation Summit IX: Papers</title>
        </titleInfo>
        <originInfo>
            <place>
                <placeTerm type="text">New Orleans, USA</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Intelligibility and fidelity are the two key notions in machine translation system evaluation, but do not always provide enough information for system development. Detailed information about the type and number of errors of each type that a translation system makes is important for diagnosing the system, evaluating the translation approach, and allocating development resources. In this paper, we present a fine-grained machine translation evaluation framework that, in addition to the notions of intelligibility and fidelity, includes a typology of errors common in automatic translation, as well as several other properties of source and translated texts. The proposed framework is informative, sensitive, and relatively inexpensive to apply, to diagnose and quantify the types and likely sources of translation error. The proposed fine-grained framework has been used in two evaluation experiments on the LMT English-Spanish machine translation system, and has already suggested one important architectural improvement of the system.</abstract>
    <identifier type="citekey">correa-2003-fine</identifier>
    <location>
        <url>https://aclanthology.org/2003.mtsummit-papers.7</url>
    </location>
    <part>
        <date>2003-sep&quot; 23-27&quot;</date>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T A fine-grained evaluation framework for machine translation system development
%A Correa, Nelson
%S Proceedings of Machine Translation Summit IX: Papers
%D 2003
%8 sep" 23 27"
%C New Orleans, USA
%F correa-2003-fine
%X Intelligibility and fidelity are the two key notions in machine translation system evaluation, but do not always provide enough information for system development. Detailed information about the type and number of errors of each type that a translation system makes is important for diagnosing the system, evaluating the translation approach, and allocating development resources. In this paper, we present a fine-grained machine translation evaluation framework that, in addition to the notions of intelligibility and fidelity, includes a typology of errors common in automatic translation, as well as several other properties of source and translated texts. The proposed framework is informative, sensitive, and relatively inexpensive to apply, to diagnose and quantify the types and likely sources of translation error. The proposed fine-grained framework has been used in two evaluation experiments on the LMT English-Spanish machine translation system, and has already suggested one important architectural improvement of the system.
%U https://aclanthology.org/2003.mtsummit-papers.7

Markdown (Informal)

[A fine-grained evaluation framework for machine translation system development](https://aclanthology.org/2003.mtsummit-papers.7) (Correa, MTSummit 2003)

• A fine-grained evaluation framework for machine translation system development (Correa, MTSummit 2003)

ACL

• Nelson Correa. 2003. A fine-grained evaluation framework for machine translation system development. In Proceedings of Machine Translation Summit IX: Papers, New Orleans, USA.