Abstract
This paper describes an intelligibility snap-judgment test. In this exercise, participants are shown a series of human translations and machine translations and are asked to determine whether the author was human or machine. The experiment shows that snap judgments on intelligibility are made successfully and that system rankings on snap judgments are consistent with more detailed intelligibility measures. In addition to demonstrating a quick intelligibility judgment, representing on a few minutes time of each participant, it details the types of errors which led to the snap judgments.- Anthology ID:
- 2004.amta-papers.25
- Volume:
- Proceedings of the 6th Conference of the Association for Machine Translation in the Americas: Technical Papers
- Month:
- September 28 - October 2
- Year:
- 2004
- Address:
- Washington, USA
- Editors:
- Robert E. Frederking, Kathryn B. Taylor
- Venue:
- AMTA
- SIG:
- Publisher:
- Springer
- Note:
- Pages:
- 227–235
- Language:
- URL:
- https://link.springer.com/chapter/10.1007/978-3-540-30194-3_25
- DOI:
- Cite (ACL):
- Florence Reeder. 2004. Investigation of intelligibility judgments. In Proceedings of the 6th Conference of the Association for Machine Translation in the Americas: Technical Papers, pages 227–235, Washington, USA. Springer.
- Cite (Informal):
- Investigation of intelligibility judgments (Reeder, AMTA 2004)
- PDF:
- https://link.springer.com/chapter/10.1007/978-3-540-30194-3_25