Wugnectives: Novel Entity Inferences of Language Models from Discourse Connectives
Daniel Brubaker, William Sheffield, Junyi Jessy Li, Kanishka Misra
Abstract
The role of world knowledge has been particularly crucial to predict the discourse connective that marks the discourse relation between two arguments, with language models (LMs) being generally successful at this task. We flip this premise in our work, and instead study the inverse problem of understanding whether discourse connectives can inform LMs about the world. To this end, we present Wugnectives, a dataset of 8,880 stimuli that evaluates LMs’ inferences about novel entities in contexts where connectives link the entities to particular attributes. On investigating 17 different LMs at various scales, and training regimens, we found that tuning an LM to show reasoning behavior yields noteworthy improvements on most connectives. At the same time, there was a large variation in LMs’ overall performance across connective type, with all models systematically struggling on connectives that express a concessive meaning. Our findings pave the way for more nuanced investigations into the functional role of language cues as captured by LMs.We release Wugnectives at https://github.com/kanishkamisra/wugnectives- Anthology ID:
- 2026.eacl-long.289
- Volume:
- Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
- Month:
- March
- Year:
- 2026
- Address:
- Rabat, Morocco
- Editors:
- Vera Demberg, Kentaro Inui, Lluís Marquez
- Venue:
- EACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 6109–6127
- Language:
- URL:
- https://preview.aclanthology.org/ingest-eacl/2026.eacl-long.289/
- DOI:
- Cite (ACL):
- Daniel Brubaker, William Sheffield, Junyi Jessy Li, and Kanishka Misra. 2026. Wugnectives: Novel Entity Inferences of Language Models from Discourse Connectives. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 6109–6127, Rabat, Morocco. Association for Computational Linguistics.
- Cite (Informal):
- Wugnectives: Novel Entity Inferences of Language Models from Discourse Connectives (Brubaker et al., EACL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-eacl/2026.eacl-long.289.pdf