Grammar Engineering Meets LLMs: Development of Cantonese and Irish ParGram Treebanks

Chit-Fung Lam, Elaine Uí Dhonnchadha


Abstract
Grammar engineering requires expertise in linguistic formalism and computational implementation, particularly in parallel grammar projects that balance cross-linguistic consistency with language-specific properties. This paper presents the development of Cantonese and Irish treebanks within the Parallel Grammar (ParGram) Project, where linguistic parallelism is maintained at an abstract functional level. We also investigated the methodological potential and limitations of using multilingual LLMs to support grammar engineering, focusing on Cantonese–Irish translation and the generation of formal syntactic structures using OpenAI’s gpt-oss-120b. The results showed that translation performance was generally unsatisfactory and unaffected by prompt language. For syntactic structure generation, the model produced some structurally meaningful outputs, but performed poorly on tasks requiring cross-linguistic abstraction. Nonetheless, LLM-generated outputs may still offer some reference value by suggesting alternative analyses and (partially) capturing predicate–argument relations. Overall, our findings highlight both the potential and limitations of using LLMs in collaborative grammar engineering, while underscoring the continued importance of expert-driven analysis and verification.
Anthology ID:
2026.brigap-1.11
Volume:
Proceedings of the Third Workshop on the Bridges and Gaps between Formal and Computational Linguistics (BriGap-3)
Month:
July
Year:
2026
Address:
Paris, France
Editors:
Timothée Bernard, Emmanuele Chersoni, Giulia Rambelli
Venues:
BriGap | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
121–134
Language:
URL:
https://preview.aclanthology.org/ingest-brigap/2026.brigap-1.11/
DOI:
Bibkey:
Cite (ACL):
Chit-Fung Lam and Elaine Uí Dhonnchadha. 2026. Grammar Engineering Meets LLMs: Development of Cantonese and Irish ParGram Treebanks. In Proceedings of the Third Workshop on the Bridges and Gaps between Formal and Computational Linguistics (BriGap-3), pages 121–134, Paris, France. Association for Computational Linguistics.
Cite (Informal):
Grammar Engineering Meets LLMs: Development of Cantonese and Irish ParGram Treebanks (Lam & Uí Dhonnchadha, BriGap 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-brigap/2026.brigap-1.11.pdf