@inproceedings{doherty-obrien-2012-user,
    title = "A User-Based Usability Assessment of Raw Machine Translated Technical Instructions",
    author = "Doherty, Stephen  and
      O{'}Brien, Sharon",
    booktitle = "Proceedings of the 10th Conference of the Association for Machine Translation in the Americas: Commercial MT User Program",
    month = oct # " 28-" # nov # " 1",
    year = "2012",
    address = "San Diego, California, USA",
    publisher = "Association for Machine Translation in the Americas",
    url = "https://preview.aclanthology.org/fix-sig-urls/2012.amta-commercial.4/",
    abstract = "This paper reports on a project whose aims are to investigate the usability of raw machine translated technical support documentation for a commercial online file storage service. Following the ISO/TR 16982 definition of usability - goal completion, satisfaction, effectiveness, and efficiency - comparisons are drawn for all measures between the original user documentation written in English for a well-known online file storage service and raw machine translated output in four target languages: Spanish, French, German and Japanese. Using native speakers for each language, we found significant differences between the source and MT output for three out of the four measures: goal completion, efficiency and user satisfaction. This leads to a tentative conclusion that there is a difference in usability between well-formed content and raw machine translated content, and we suggest avenues for further work."
}