Nat Pavasant
2026
Machine translation Evaluation Eng-Thai MQM Ranking dataset
Phichet Phuangrot | Natdanai Trintawat | Kanawat Vilasri | Yanapat Patcharawiwatpong | Pachara Boonsarngsuk | Nat Pavasant | Ekapol Chuangsuwanich
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 2: Short Papers)
Phichet Phuangrot | Natdanai Trintawat | Kanawat Vilasri | Yanapat Patcharawiwatpong | Pachara Boonsarngsuk | Nat Pavasant | Ekapol Chuangsuwanich
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 2: Short Papers)
We introduce MEET-MR (Machine Translation English–Thai MQM and Ranking Dataset), a comprehensive benchmark for evaluating English–Thai machine translation systems. The dataset is constructed using the Multidimensional Quality Metrics (MQM) annotation framework, providing fine-grained human judgements of translation quality. In addition, MEET-MR includes human preference rankings and reference translations, enabling both absolute and relative assessment of translation quality. The dataset covers nine diverse domains providing linguistic and contextual diversity. By combining high-quality reference translations, objective MQM error annotations, and subjective preference rankings, MEET-MR serves as a valuable resource for studying translation quality estimation, model alignment with human evaluation, and cross-domain performance in English–Thai machine translation. MEET-MR is publicly available at https://huggingface.co/datasets/Chula-AI/MEET-MR