Evaluation Strategies for Computational Construction Grammars

Tânia Marques, Katrien Beuls

[How to correct problems with metadata yourself]


Abstract
Despite the growing number of Computational Construction Grammar implementations, the field is still lacking evaluation methods to compare grammar fragments across different platforms. Moreover, the hand-crafted nature of most grammars requires profiling tools to understand the complex interactions between constructions of different types. This paper presents a number of evaluation measures, partially based on existing measures in the field of semantic parsing, that are especially relevant for reversible grammar formalisms. The measures are tested on a grammar fragment for European Portuguese clitic placement that is currently under development.
Anthology ID:
C16-1108
Volume:
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers
Month:
December
Year:
2016
Address:
Osaka, Japan
Editors:
Yuji Matsumoto, Rashmi Prasad
Venue:
COLING
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
1137–1146
Language:
URL:
https://aclanthology.org/C16-1108
DOI:
Bibkey:
Cite (ACL):
Tânia Marques and Katrien Beuls. 2016. Evaluation Strategies for Computational Construction Grammars. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 1137–1146, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
Evaluation Strategies for Computational Construction Grammars (Marques & Beuls, COLING 2016)
Copy Citation:
PDF:
https://preview.aclanthology.org/teach-a-man-to-fish/C16-1108.pdf