Relation Classification via Bidirectional Prompt Learning with Data Augmentation by Large Language Model

Yizhi Jiang, Jinlong Li, Huanhuan Chen


Abstract
The Relation Extraction (RE) task aims to extract the relation between two entities in a sentence. As the performance of methods on RE task depends on datasets’ quantity and quality, in this paper, we propose to use the Large Language Model (LLM) to do data augmentation. Moreover, compared to traditional fine-tuning methods, more research focuses on prompt learning. However, all of their prompt templates ignore the relative order of entities, which we believe will affect the prediction error. Due to that, we propose novel bidirectional prompt templates for prompt learning and design a training strategy for utilizing the templates. Then we try to fit the probability distributions of both prompt learning and fine-tuning methods into our model. To this end, we propose Relation Classification via Bidirectional Prompt learning with data augmentation by LLM (RCBP) and conduct experiments on four datasets: TACRED, RETACRED, TACREV and Semeval. The results show that RCBP performs well on these datasets and outperforms the state-of-the-art in the TACREV, RETACRED datasets.
Anthology ID:
2024.lrec-main.1212
Volume:
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
Venues:
LREC | COLING
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
13885–13897
Language:
URL:
https://aclanthology.org/2024.lrec-main.1212
DOI:
Bibkey:
Cite (ACL):
Yizhi Jiang, Jinlong Li, and Huanhuan Chen. 2024. Relation Classification via Bidirectional Prompt Learning with Data Augmentation by Large Language Model. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 13885–13897, Torino, Italia. ELRA and ICCL.
Cite (Informal):
Relation Classification via Bidirectional Prompt Learning with Data Augmentation by Large Language Model (Jiang et al., LREC-COLING 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-2/2024.lrec-main.1212.pdf
Optional supplementary material:
 2024.lrec-main.1212.OptionalSupplementaryMaterial.zip