Martha Herzog


2007

pdf
ILR-Based MT Comprehension Test with Multi-Level Questions
Douglas Jones | Martha Herzog | Hussny Ibrahim | Arvind Jairam | Wade Shen | Edward Gibson | Michael Emonts
Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers

2006

pdf
Toward an Interagency Language Roundtable Based Assessment of Speech-to-Speech Translation Capabilities
Douglas Jones | Timothy Anderson | Sabine Atwell | Brian Delaney | James Dirgin | Michael Emots | Neil Granoein | Martha Herzog | Timothy Hunter | Sargon Jabri | Wade Shen | Jurgen Sottung
Proceedings of the 7th Conference of the Association for Machine Translation in the Americas: Technical Papers

We present observations from three exercises designed to map the effective listening and speaking skills of an operator of a speech-to-speech translation system (S2S) to the Interagency Language Roundtable (ILR) scale. Such a mapping is non-trivial, but will be useful for government and military decision makers in managing expectations of S2S technology. We observed domain-dependent S2S capabilities in the ILR range of Level 0+ to Level 1, and interactive text-based machine translation in the Level 3 range.