<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="doyon-etal-1999-task">
    <titleInfo>
        <title>Task-based evaluation for machine translation</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Jennifer</namePart>
        <namePart type="given">B</namePart>
        <namePart type="family">Doyon</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Kathryn</namePart>
        <namePart type="given">B</namePart>
        <namePart type="family">Taylor</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">John</namePart>
        <namePart type="given">S</namePart>
        <namePart type="family">White</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>1999-sep&quot; 13-17&quot;</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of Machine Translation Summit VII</title>
        </titleInfo>
        <originInfo>
            <place>
                <placeTerm type="text">Singapore, Singapore</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>In an effort to reduce the subjectivity, cost, and complexity of evaluation methods for machine translation (MT) and other language technologies, task-based assessment is examined as an alternative to metrics-based in human judgments about MT, i.e., the previously applied adequacy, fluency, and informativeness measures. For task-based evaluation strategies to be employed effectively to evaluate languageprocessing technologies in general, certain key elements must be known. Most importantly, the objectives the technology’s use is expected to accomplish must be known, the objectives must be expressed as tasks that accomplish the objectives, and then successful outcomes defined for the tasks. For MT, task-based evaluation is correlated to a scale of tasks, and has as its premise that certain tasks are more forgiving of errors than others. In other words, a poor translation may suffice to determine the general topic of a text, but may not permit accurate identification of participants or the specific event. The ordering of tasks according to their tolerance for errors, as determined by actual task outcomes provided in this paper, is the basis of a scale and repeatable process by which to measure MT systems that has advantages over previous methods.</abstract>
    <identifier type="citekey">doyon-etal-1999-task</identifier>
    <location>
        <url>https://aclanthology.org/1999.mtsummit-1.85</url>
    </location>
    <part>
        <date>1999-sep&quot; 13-17&quot;</date>
        <extent unit="page">
            <start>574</start>
            <end>578</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Task-based evaluation for machine translation
%A Doyon, Jennifer B.
%A Taylor, Kathryn B.
%A White, John S.
%S Proceedings of Machine Translation Summit VII
%D 1999
%8 sep" 13 17"
%C Singapore, Singapore
%F doyon-etal-1999-task
%X In an effort to reduce the subjectivity, cost, and complexity of evaluation methods for machine translation (MT) and other language technologies, task-based assessment is examined as an alternative to metrics-based in human judgments about MT, i.e., the previously applied adequacy, fluency, and informativeness measures. For task-based evaluation strategies to be employed effectively to evaluate languageprocessing technologies in general, certain key elements must be known. Most importantly, the objectives the technology’s use is expected to accomplish must be known, the objectives must be expressed as tasks that accomplish the objectives, and then successful outcomes defined for the tasks. For MT, task-based evaluation is correlated to a scale of tasks, and has as its premise that certain tasks are more forgiving of errors than others. In other words, a poor translation may suffice to determine the general topic of a text, but may not permit accurate identification of participants or the specific event. The ordering of tasks according to their tolerance for errors, as determined by actual task outcomes provided in this paper, is the basis of a scale and repeatable process by which to measure MT systems that has advantages over previous methods.
%U https://aclanthology.org/1999.mtsummit-1.85
%P 574-578

Markdown (Informal)

[Task-based evaluation for machine translation](https://aclanthology.org/1999.mtsummit-1.85) (Doyon et al., MTSummit 1999)

• Task-based evaluation for machine translation (Doyon et al., MTSummit 1999)

ACL

• Jennifer B. Doyon, Kathryn B. Taylor, and John S. White. 1999. Task-based evaluation for machine translation. In Proceedings of Machine Translation Summit VII, pages 574–578, Singapore, Singapore.