UERLens: Understanding Event Relations in Large Language Models

Yong Guan, Zhiyuan Li, Shaoru Guo


Abstract
Events exhibit rich semantic relations that are essential for understanding the unfolding of real-world processes. Although large language models (LLMs) have achieved strong performance on event relation extraction, how event relations are internally represented and utilized remains unclear. In this paper, we present UERLens, an interpretability framework for understanding event relations in LLMs. Specifically, we first construct UERBench, a counterfactual dataset for event relation analysis that covers causal, temporal, and sub-event relations. Based on counterfactual pairs, we identify relation-sensitive internal features by comparing model activations. We then examine the functional role of these features through model manipulation, including model intervention and model training. Experimental results show that event relations are encoded through structured and layer-specific internal features. Disabling relation-sensitive features leads to performance drops of over 22%, while enhancing them yields improvements of up to 7%. Furthermore, leveraging these interpretable features to train a lightweight classifier significantly improves event relation extraction, achieving F1 gains of up to 24% for causal relations.
Anthology ID:
2026.acl-short.38
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
463–471
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-short.38/
DOI:
Bibkey:
Cite (ACL):
Yong Guan, Zhiyuan Li, and Shaoru Guo. 2026. UERLens: Understanding Event Relations in Large Language Models. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 463–471, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
UERLens: Understanding Event Relations in Large Language Models (Guan et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-short.38.pdf
Checklist:
 2026.acl-short.38.checklist.pdf