Abstract
In recent years, the use of synthetic data, either as a complement or a substitute for original data, has emerged as a solution to challenges such as data scarcity and security risks. This paper is an initial attempt to automatically generate such data for Information Extraction tasks. We accomplished this by developing a novel synthetic data generation framework called KGAST, which leverages Knowledge Graphs and Large Language Models. In our preliminary study, we conducted simple experiments to generate synthetic versions of two datasets—a French security defense dataset and an English general domain dataset, after which we evaluated them both intrinsically and extrinsically. The results indicated that synthetic data can effectively complement original data, improving the performance of models on classes with limited training samples. This highlights KGAST’s potential as a tool for generating synthetic data for Information Extraction tasks.- Anthology ID:
- 2024.kallm-1.5
- Volume:
- Proceedings of the 1st Workshop on Knowledge Graphs and Large Language Models (KaLLM 2024)
- Month:
- August
- Year:
- 2024
- Address:
- Bangkok, Thailand
- Editors:
- Russa Biswas, Lucie-Aimée Kaffee, Oshin Agarwal, Pasquale Minervini, Sameer Singh, Gerard de Melo
- Venues:
- KaLLM | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 43–55
- Language:
- URL:
- https://aclanthology.org/2024.kallm-1.5
- DOI:
- 10.18653/v1/2024.kallm-1.5
- Cite (ACL):
- Nakanyseth Vuth, Gilles Sérasset, and Didier Schwab. 2024. KGAST: From Knowledge Graphs to Annotated Synthetic Texts. In Proceedings of the 1st Workshop on Knowledge Graphs and Large Language Models (KaLLM 2024), pages 43–55, Bangkok, Thailand. Association for Computational Linguistics.
- Cite (Informal):
- KGAST: From Knowledge Graphs to Annotated Synthetic Texts (Vuth et al., KaLLM-WS 2024)
- PDF:
- https://preview.aclanthology.org/dois-2013-emnlp/2024.kallm-1.5.pdf