A Self-Reflective LLM-based Architecture for Semi-Open Event Extraction

Hristo Tanev, Michel de Bollivier, Bertrand De Longueville


Abstract
We present a multi-agent reflective architecture for event extraction based on generativelarge language models (LLMs). Our architecture is the first of its kind to perform Semi-Open Event Extraction (SOEE), a hybrid framework that combines a fixed set of event template fields with dynamically generated attributes. Another novel feature of this system is the self-reflection. This type of LLM-based reasoning is the other novel feature of our system. It is defined as the generation of questions about missing or implicit event information and finding their answers within the system itself. We model event extraction as an iterative dialogue between a reflective LLM based agent, which generates questions to uncover missing event information and a set ofexpert agents, which provide domain-aware answers to these questions. The expert agents alsogenerate the initial event template using a generative LLM. Evaluated in the health domain, our event extraction system shows very promising results, demonstrating that LLM-based reflective multi-agent reasoning can accurately perform event extraction and expand the eventtemplate in a creative and comprehensive manner
Anthology ID:
2026.eeuca-1.8
Volume:
Proceedings of the 9th Workshop on Event Extraction and Understanding: Challenges and Applications (EEUCA 2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ali Hürriyetoğlu, Surendrabikram Thapa, Hristo Tanev
Venues:
EEUCA | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
72–82
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.eeuca-1.8/
DOI:
Bibkey:
Cite (ACL):
Hristo Tanev, Michel de Bollivier, and Bertrand De Longueville. 2026. A Self-Reflective LLM-based Architecture for Semi-Open Event Extraction. In Proceedings of the 9th Workshop on Event Extraction and Understanding: Challenges and Applications (EEUCA 2026), pages 72–82, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
A Self-Reflective LLM-based Architecture for Semi-Open Event Extraction (Tanev et al., EEUCA 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.eeuca-1.8.pdf