Few-Shot Semantic Dependency Parsing via Graph Contrastive Learning
Bin Li, Yunlong Fan, Yikemaiti Sataer, Chuanqi Shi, Miao Gao, Zhiqiang Gao
Abstract
Graph neural networks (GNNs) have achieved promising performance on semantic dependency parsing (SDP), owing to their powerful graph representation learning ability. However, training a high-performing GNN-based model requires a large amount of labeled data and it is prone to over-fitting in the absence of sufficient labeled data. To address this drawback, we propose a syntax-guided graph contrastive learning framework to pre-train GNNs with plenty of unlabeled data and fine-tune pre-trained GNNs with few-shot labeled SDP data. Through extensive experiments conducted on the SemEval-2015 Task 18 English dataset in three formalisms (DM, PAS, and PSD), we demonstrate that our framework achieves promising results when few-shot training samples are available. Furthermore, benefiting from the pre-training process, our framework exhibits notable advantages in the out-of-domain test sets.- Anthology ID:
- 2024.lrec-main.636
- Volume:
- Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
- Month:
- May
- Year:
- 2024
- Address:
- Torino, Italia
- Editors:
- Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
- Venues:
- LREC | COLING
- SIG:
- Publisher:
- ELRA and ICCL
- Note:
- Pages:
- 7248–7258
- Language:
- URL:
- https://aclanthology.org/2024.lrec-main.636
- DOI:
- Cite (ACL):
- Bin Li, Yunlong Fan, Yikemaiti Sataer, Chuanqi Shi, Miao Gao, and Zhiqiang Gao. 2024. Few-Shot Semantic Dependency Parsing via Graph Contrastive Learning. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 7248–7258, Torino, Italia. ELRA and ICCL.
- Cite (Informal):
- Few-Shot Semantic Dependency Parsing via Graph Contrastive Learning (Li et al., LREC-COLING 2024)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2024.lrec-main.636.pdf