@inproceedings{pighin-etal-2012-graph,
    title = "A Graph-based Strategy to Streamline Translation Quality Assessments",
    author = "Pighin, Daniele  and
      Formiga, Llu{\'i}s  and
      M{\`a}rquez, Llu{\'i}s",
    booktitle = "Proceedings of the 10th Conference of the Association for Machine Translation in the Americas: Research Papers",
    month = oct # " 28-" # nov # " 1",
    year = "2012",
    address = "San Diego, California, USA",
    publisher = "Association for Machine Translation in the Americas",
    url = "https://preview.aclanthology.org/jlcl-multiple-ingestion/2012.amta-papers.13/",
    abstract = "We present a detailed analysis of a graph-based annotation strategy that we employed to annotate a corpus of 11,292 real-world English to Spanish automatic translations with relative (ranking) and absolute (adequate/non-adequate) quality assessments. The proposed approach, inspired by previous work in Interactive Evolutionary Computation and Interactive Genetic Algorithms, results in a simpler and faster annotation process. We empirically compare the method against a traditional, explicit ranking approach, and show that the graph-based strategy: 1) is considerably faster, and 2) produces consistently more reliable annotations."
}