Abstract
We present a detailed analysis of a graph-based annotation strategy that we employed to annotate a corpus of 11,292 real-world English to Spanish automatic translations with relative (ranking) and absolute (adequate/non-adequate) quality assessments. The proposed approach, inspired by previous work in Interactive Evolutionary Computation and Interactive Genetic Algorithms, results in a simpler and faster annotation process. We empirically compare the method against a traditional, explicit ranking approach, and show that the graph-based strategy: 1) is considerably faster, and 2) produces consistently more reliable annotations.- Anthology ID:
- 2012.amta-papers.13
- Volume:
- Proceedings of the 10th Conference of the Association for Machine Translation in the Americas: Research Papers
- Month:
- October 28-November 1
- Year:
- 2012
- Address:
- San Diego, California, USA
- Venue:
- AMTA
- SIG:
- Publisher:
- Association for Machine Translation in the Americas
- Note:
- Pages:
- Language:
- URL:
- https://aclanthology.org/2012.amta-papers.13
- DOI:
- Cite (ACL):
- Daniele Pighin, Lluís Formiga, and Lluís Màrquez. 2012. A Graph-based Strategy to Streamline Translation Quality Assessments. In Proceedings of the 10th Conference of the Association for Machine Translation in the Americas: Research Papers, San Diego, California, USA. Association for Machine Translation in the Americas.
- Cite (Informal):
- A Graph-based Strategy to Streamline Translation Quality Assessments (Pighin et al., AMTA 2012)
- PDF:
- https://preview.aclanthology.org/bionlp-24-ingestion/2012.amta-papers.13.pdf