Neurosymbolic AI for Natural Language Inference in French : combining LLMs and theorem provers for semantic parsing and natural language reasoning
Maximos Skandalis, Lasha Abzianidze, Richard Moot, Christian Retoré, Simon Robillard
Abstract
In this article, we describe the first comprehensive neurosymbolic pipeline for the task of Natural Language Inference (NLI) for French, with the synergy of Large Language Models (CamemBERT) and automated theorem provers (GrailLight, LangPro). LLMs prepare the input for GrailLight by tagging each token with Part-of-Speech and grammatical information based on the Type-Logical Grammar formalism. GrailLight then produces the lambda-terms given as input to the LangPro theorem prover, a tableau-based theorem prover for natural logic originally developped for English. Currently, the proposed system works on the French version of SICK dataset. The results obtained are comparable to the ones on the English and Dutch versions of SICK with the same LangPro theorem prover, and are better than the results of recent transformers on this specific dataset.Finally, we have identified ways to further improve the results obtained, such as giving access to the theorem prover to lexical knowledge via a knowledge base for French.- Anthology ID:
- 2025.iwcs-1.22
- Volume:
- Proceedings of the 16th International Conference on Computational Semantics
- Month:
- September
- Year:
- 2025
- Address:
- Düsseldorf, Germany
- Editors:
- Kilian Evang, Laura Kallmeyer, Sylvain Pogodalla
- Venues:
- IWCS | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 252–263
- Language:
- URL:
- https://preview.aclanthology.org/iwcs-25-ingestion/2025.iwcs-1.22/
- DOI:
- Cite (ACL):
- Maximos Skandalis, Lasha Abzianidze, Richard Moot, Christian Retoré, and Simon Robillard. 2025. Neurosymbolic AI for Natural Language Inference in French : combining LLMs and theorem provers for semantic parsing and natural language reasoning. In Proceedings of the 16th International Conference on Computational Semantics, pages 252–263, Düsseldorf, Germany. Association for Computational Linguistics.
- Cite (Informal):
- Neurosymbolic AI for Natural Language Inference in French : combining LLMs and theorem provers for semantic parsing and natural language reasoning (Skandalis et al., IWCS 2025)
- PDF:
- https://preview.aclanthology.org/iwcs-25-ingestion/2025.iwcs-1.22.pdf