CycleGT: Unsupervised Graph-to-Text and Text-to-Graph Generation via Cycle Training
Qipeng Guo, Zhijing Jin, Xipeng Qiu, Weinan Zhang, David Wipf, Zheng Zhang
Abstract
Two important tasks at the intersection of knowledge graphs and natural language processing are graph-to-text (G2T) and text-tograph (T2G) conversion. Due to the difficulty and high cost of data collection, the supervised data available in the two fields are usually on the magnitude of tens of thousands, for example, 18K in the WebNLG 2017 dataset after preprocessing, which is far fewer than the millions of data for other tasks such as machine translation. Consequently, deep learning models for G2T and T2G suffer largely from scarce training data. We present CycleGT, an unsupervised training method that can bootstrap from fully non-parallel graph and text data, and iteratively back translate between the two forms. Experiments on WebNLG datasets show that our unsupervised model trained on the same number of data achieves performance on par with several fully supervised models. Further experiments on the non-parallel GenWiki dataset verify that our method performs the best among unsupervised baselines. This validates our framework as an effective approach to overcome the data scarcity problem in the fields of G2T and T2G.- Anthology ID:
- 2020.webnlg-1.8
- Volume:
- Proceedings of the 3rd International Workshop on Natural Language Generation from the Semantic Web (WebNLG+)
- Month:
- 12
- Year:
- 2020
- Address:
- Dublin, Ireland (Virtual)
- Editors:
- Thiago Castro Ferreira, Claire Gardent, Nikolai Ilinykh, Chris van der Lee, Simon Mille, Diego Moussallem, Anastasia Shimorina
- Venue:
- WebNLG
- SIG:
- SIGGEN
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 77–88
- Language:
- URL:
- https://aclanthology.org/2020.webnlg-1.8
- DOI:
- Cite (ACL):
- Qipeng Guo, Zhijing Jin, Xipeng Qiu, Weinan Zhang, David Wipf, and Zheng Zhang. 2020. CycleGT: Unsupervised Graph-to-Text and Text-to-Graph Generation via Cycle Training. In Proceedings of the 3rd International Workshop on Natural Language Generation from the Semantic Web (WebNLG+), pages 77–88, Dublin, Ireland (Virtual). Association for Computational Linguistics.
- Cite (Informal):
- CycleGT: Unsupervised Graph-to-Text and Text-to-Graph Generation via Cycle Training (Guo et al., WebNLG 2020)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2020.webnlg-1.8.pdf
- Code
- QipengGuo/CycleGT + additional community code