Abstract
In this paper we present a methodology for automating the evaluation of the grammatical coverage of machine translation (MT) systems. The methodology is based on the importance of unfolded grammatical structures, which represent the most basic syntactic pattern for a sentence in a given language. A database of unfolded grammatical structures is built to evaluate the parser of any NLP or MT system. The evaluation results in an overall measure called the grammatical coverage. The results of implementing the above approach on three English-to-Arabic commercial MT systems are presented.- Anthology ID:
- 2001.mtsummit-papers.25
- Volume:
- Proceedings of Machine Translation Summit VIII
- Month:
- September 18-22
- Year:
- 2001
- Address:
- Santiago de Compostela, Spain
- Venue:
- MTSummit
- SIG:
- Publisher:
- Note:
- Pages:
- Language:
- URL:
- https://aclanthology.org/2001.mtsummit-papers.25
- DOI:
- Cite (ACL):
- A. Guessoum and R. Zantout. 2001. Semi-automatic evaluation of the grammatical coverage of machine translation systems. In Proceedings of Machine Translation Summit VIII, Santiago de Compostela, Spain.
- Cite (Informal):
- Semi-automatic evaluation of the grammatical coverage of machine translation systems (Guessoum & Zantout, MTSummit 2001)
- PDF:
- https://preview.aclanthology.org/remove-xml-comments/2001.mtsummit-papers.25.pdf