@inproceedings{yang-etal-2014-review,
    title = "Review and analysis of {C}hina workshop on machine translation 2013 evaluation",
    author = {Yang, Sitong  and
      Yu, Heng  and
      Zhao, Hongmei  and
      Liu, Qun  and
      L{\"u}, Yajuan},
    editor = "Al-Onaizan, Yaser  and
      Simard, Michel",
    booktitle = "Proceedings of the 11th Conference of the Association for Machine Translation in the Americas: MT Researchers Track",
    month = oct # " 22-26",
    year = "2014",
    address = "Vancouver, Canada",
    publisher = "Association for Machine Translation in the Americas",
    url = "https://preview.aclanthology.org/jlcl-multiple-ingestion/2014.amta-researchers.16/",
    pages = "208--221",
    abstract = "This paper gives a general review and detailed analysis of China Workshop on Machine Translation (CWMT) Evaluation. Compared with the past CWMT evaluation campaigns, CWMT2013 evaluation is characterized as follows: first, adopting gray-box evaluation which makes the results more replicable and controllable; second, adding one rule-based system as a counterpart; third, carrying out manual evaluations on some specific tasks to give a more comprehensive analysis of the translation errors. Boosted by those new features, our analysis and case study on the evaluation results shows the pros and cons of both rule-based and statistical systems, and reveals some interesting correlations bewteen automatic and manual evaluation metrics on different translation systems."
}