<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="gotou-etal-2020-taking">
    <titleInfo>
        <title>Taking the Correction Difficulty into Account in Grammatical Error Correction Evaluation</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Takumi</namePart>
        <namePart type="family">Gotou</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Ryo</namePart>
        <namePart type="family">Nagata</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Masato</namePart>
        <namePart type="family">Mita</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Kazuaki</namePart>
        <namePart type="family">Hanawa</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2020-dec</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 28th International Conference on Computational Linguistics</title>
        </titleInfo>
        <originInfo>
            <publisher>International Committee on Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Barcelona, Spain (Online)</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>This paper presents performance measures for grammatical error correction which take into account the difficulty of error correction. To the best of our knowledge, no conventional measure has such functionality despite the fact that some errors are easy to correct and others are not. The main purpose of this work is to provide a way of determining the difficulty of error correction and to motivate researchers in the domain to attack such difficult errors. The performance measures are based on the simple idea that the more systems successfully correct an error, the easier it is considered to be. This paper presents a set of algorithms to implement this idea. It evaluates the performance measures quantitatively and qualitatively on a wide variety of corpora and systems, revealing that they agree with our intuition of correction difficulty. A scorer and difficulty weight data based on the algorithms have been made available on the web.</abstract>
    <identifier type="citekey">gotou-etal-2020-taking</identifier>
    <identifier type="doi">10.18653/v1/2020.coling-main.188</identifier>
    <location>
        <url>https://aclanthology.org/2020.coling-main.188</url>
    </location>
    <part>
        <date>2020-dec</date>
        <extent unit="page">
            <start>2085</start>
            <end>2095</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Taking the Correction Difficulty into Account in Grammatical Error Correction Evaluation
%A Gotou, Takumi
%A Nagata, Ryo
%A Mita, Masato
%A Hanawa, Kazuaki
%S Proceedings of the 28th International Conference on Computational Linguistics
%D 2020
%8 dec
%I International Committee on Computational Linguistics
%C Barcelona, Spain (Online)
%F gotou-etal-2020-taking
%X This paper presents performance measures for grammatical error correction which take into account the difficulty of error correction. To the best of our knowledge, no conventional measure has such functionality despite the fact that some errors are easy to correct and others are not. The main purpose of this work is to provide a way of determining the difficulty of error correction and to motivate researchers in the domain to attack such difficult errors. The performance measures are based on the simple idea that the more systems successfully correct an error, the easier it is considered to be. This paper presents a set of algorithms to implement this idea. It evaluates the performance measures quantitatively and qualitatively on a wide variety of corpora and systems, revealing that they agree with our intuition of correction difficulty. A scorer and difficulty weight data based on the algorithms have been made available on the web.
%R 10.18653/v1/2020.coling-main.188
%U https://aclanthology.org/2020.coling-main.188
%U https://doi.org/10.18653/v1/2020.coling-main.188
%P 2085-2095

Markdown (Informal)

[Taking the Correction Difficulty into Account in Grammatical Error Correction Evaluation](https://aclanthology.org/2020.coling-main.188) (Gotou et al., COLING 2020)

• Taking the Correction Difficulty into Account in Grammatical Error Correction Evaluation (Gotou et al., COLING 2020)

ACL

• Takumi Gotou, Ryo Nagata, Masato Mita, and Kazuaki Hanawa. 2020. Taking the Correction Difficulty into Account in Grammatical Error Correction Evaluation. In Proceedings of the 28th International Conference on Computational Linguistics, pages 2085–2095, Barcelona, Spain (Online). International Committee on Computational Linguistics.