Generate-then-Revise: An Effective Synthetic Training Data Generation Framework For Event Detection Retrieval

Huidong Du, Hao Sun, Pengyuan Liu, Dong Yu


Abstract
“Large language models (LLMs) struggle with event detection (ED) due to the structured and vari-able number of events in the output. Existing supervised approaches rely on a large amount ofmanually annotated corpora, facing challenges in practice when event types are diverse and theannotated data is scarce. We propose Generate-then-Revise (GtR), a framework that leveragesLLMs in the opposite direction to address these challenges in ED. GtR utilizes an LLM to gen-erate high-quality training data in three stages, including a novel data revision step to minimizenoise in the synthetic data. The generated data is then used to train a smaller model for evalua-tion. Our approach demonstrates significant improvements on the low-resource ED. We furtheranalyze the generated data, highlighting the potential of synthetic data generation for enhancingED performance.Introduction”
Anthology ID:
2024.ccl-1.78
Volume:
Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 1: Main Conference)
Month:
July
Year:
2024
Address:
Taiyuan, China
Editors:
Sun Maosong, Liang Jiye, Han Xianpei, Liu Zhiyuan, He Yulan
Venue:
CCL
SIG:
Publisher:
Chinese Information Processing Society of China
Note:
Pages:
1011–1022
Language:
English
URL:
https://preview.aclanthology.org/author-degibert/2024.ccl-1.78/
DOI:
Bibkey:
Cite (ACL):
Huidong Du, Hao Sun, Pengyuan Liu, and Dong Yu. 2024. Generate-then-Revise: An Effective Synthetic Training Data Generation Framework For Event Detection Retrieval. In Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 1: Main Conference), pages 1011–1022, Taiyuan, China. Chinese Information Processing Society of China.
Cite (Informal):
Generate-then-Revise: An Effective Synthetic Training Data Generation Framework For Event Detection Retrieval (Du et al., CCL 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-degibert/2024.ccl-1.78.pdf