LLM-Guided Semantic Bootstrapping for Interpretable Text Classification with Tsetlin Machines
Jiechao Gao, Rohan Kumar Yadav, Yuangang Li, Yuandong Pan, Jie Wang, Ying Liu, Michael Lepech
Abstract
Pretrained language models (PLMs) like BERT provide strong semantic representations but are costly and opaque, while symbolic models such as the Tsetlin Machine (TM) offer transparency but lack semantic generalization. We propose a semantic bootstrapping framework that transfers LLM knowledge into symbolic form, combining interpretability with semantic capacity. Given a class label, an LLM generates sub-intents that guide synthetic data creation through a three-stage curriculum (seed, core, enriched), expanding semantic diversity. A Non-Negated TM (NTM) learns from these examples to extract high-confidence literals as interpretable semantic cues. Injecting these cues into real data enables a TM to align clause logic with LLM-inferred semantics. Our method requires no embeddings or runtime LLM calls, yet equips symbolic models with pretrained semantic priors. Across multiple text classification tasks, it improves interpretability and accuracy over vanilla TM, achieving performance comparable to BERT while remaining fully symbolic and efficient.- Anthology ID:
- 2026.findings-acl.1510
- Volume:
- Findings of the Association for Computational Linguistics: ACL 2026
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 30210–30222
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1510/
- DOI:
- Cite (ACL):
- Jiechao Gao, Rohan Kumar Yadav, Yuangang Li, Yuandong Pan, Jie Wang, Ying Liu, and Michael Lepech. 2026. LLM-Guided Semantic Bootstrapping for Interpretable Text Classification with Tsetlin Machines. In Findings of the Association for Computational Linguistics: ACL 2026, pages 30210–30222, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- LLM-Guided Semantic Bootstrapping for Interpretable Text Classification with Tsetlin Machines (Gao et al., Findings 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1510.pdf