@inproceedings{akiba-etal-2003-experimental,
    title = "Experimental comparison of {MT} evaluation methods: {RED} vs.{BLEU}",
    author = "Akiba, Yasuhiro  and
      Sumita, Eiichiro  and
      Nakaiwa, Hiromi  and
      Yamamoto, Seiichi  and
      Okuno, Hiroshi G.",
    booktitle = "Proceedings of Machine Translation Summit IX: Papers",
    month = sep # " 23-27",
    year = "2003",
    address = "New Orleans, USA",
    url = "https://aclanthology.org/2003.mtsummit-papers.1",
    abstract = "This paper experimentally compares two automatic evaluators, RED and BLEU, to determine how close the evaluation results of each automatic evaluator are to average evaluation results by human evaluators, following the ATR standard of MT evaluation. This paper gives several cautionary remarks intended to prevent MT developers from drawing misleading conclusions when using the automatic evaluators. In addition, this paper reports a way of using the automatic evaluators so that their results agree with those of human evaluators.",
}