End-to-End Evaluation in VERBMOBIL I

Rita Nübel


Abstract
VERBMOBIL is a speech-to-speech translation system for spoken dialogues between two speakers. The application scenario is appointment scheduling for business meetings, with spoken dialogues between two speakers. Both dialogue participants have at least a passive knowledge of English which serves as intermediate language1. The transfer directions are German to English and Japanese to English. A special feature of VERBMOBIL is that translations are produced on demand when the dialogue participants are unable to express themselves in English and therefore prefer to use their mother tongue. In this paper2 we present the criteria and the evaluation procedure for evaluating the translation quality of the VERBMOBIL prototype. The evaluated data have been produced by three concurrent processing methods that are integrated in the VERBMOBIL prototype. These processing methods differ with respect to processing depth, processing speed and translation quality ([2], p. 2). The paper is structured as follows: we start by giving a short description of the VERBMOBIL architecture focusing on the concurrent linguistic analyses and transfer processes which lead to three alternative translation outputs for each turn3. In section two we outline the evaluation procedure and criteria. The third section discusses the evaluation results, and the conclusion of the paper gives an outlook to future applications of automated evaluation procedures for machine translation (MT) based on an MT architecture where several concurrent translation approaches are integrated.
Anthology ID:
1997.mtsummit-papers.22
Volume:
Proceedings of Machine Translation Summit VI: Papers
Month:
October 29 – November 1
Year:
1997
Address:
San Diego, California
Venue:
MTSummit
SIG:
Publisher:
Note:
Pages:
232–239
Language:
URL:
https://aclanthology.org/1997.mtsummit-papers.22
DOI:
Bibkey:
Cite (ACL):
Rita Nübel. 1997. End-to-End Evaluation in VERBMOBIL I. In Proceedings of Machine Translation Summit VI: Papers, pages 232–239, San Diego, California.
Cite (Informal):
End-to-End Evaluation in VERBMOBIL I (Nübel, MTSummit 1997)
Copy Citation:
PDF:
https://preview.aclanthology.org/update-css-js/1997.mtsummit-papers.22.pdf