Missing Links: LLM-Augmentation of Event Triggers of State Changes in the OpenPI Dataset

Kyeongmin Rim, James Pustejovsky


Abstract
Effective computational understanding of procedural text requires modeling not just the state changes that occur (entity transformations), but also the specific actions that cause them (event triggers). A lack of datasets that explicitly link these two primary information sources has hindered progress in theory-oriented research and applications of NLP. This paper presents two primary contributions: (i) a new silver-standard dataset where event trigger annotations are added to existing state-change data on task-oriented procedural text, enabling both theoretical investigation and practical benchmarking; and (ii) inverse annotation, a framework for recovering missing linguistic annotations from existing semantic annotations—which we apply to recover event triggers from OpenPI’s state-change outcomes. We provide detailed pipeline analysis including error modes and quality filtering, and validate the dataset through comprehensive baseline evaluation of diverse trigger detection systems. Our work delivers both a reusable methodological framework applicable to other annotation recovery tasks and a new benchmark resource for modeling the relationship between linguistic actions and their semantic outcomes in procedural domains.
Anthology ID:
2026.lrec-main.939
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
11992–12006
Language:
URL:
https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.939/
DOI:
Bibkey:
Cite (ACL):
Kyeongmin Rim and James Pustejovsky. 2026. Missing Links: LLM-Augmentation of Event Triggers of State Changes in the OpenPI Dataset. International Conference on Language Resources and Evaluation, main:11992–12006.
Cite (Informal):
Missing Links: LLM-Augmentation of Event Triggers of State Changes in the OpenPI Dataset (Rim & Pustejovsky, LREC 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.939.pdf