Densely Connected Graph Convolutional Networks for Graph-to-Sequence Learning

Zhijiang Guo, Yan Zhang, Zhiyang Teng, Wei Lu


Abstract
We focus on graph-to-sequence learning, which can be framed as transducing graph structures to sequences for text generation. To capture structural information associated with graphs, we investigate the problem of encoding graphs using graph convolutional networks (GCNs). Unlike various existing approaches where shallow architectures were used for capturing local structural information only, we introduce a dense connection strategy, proposing a novel Densely Connected Graph Convolutional Network (DCGCN). Such a deep architecture is able to integrate both local and non-local features to learn a better structural representation of a graph. Our model outperforms the state-of-the-art neural models significantly on AMR-to-text generation and syntax-based neural machine translation.
Anthology ID:
Q19-1019
Volume:
Transactions of the Association for Computational Linguistics, Volume 7
Month:
Year:
2019
Address:
Cambridge, MA
Editors:
Lillian Lee, Mark Johnson, Brian Roark, Ani Nenkova
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
297–312
Language:
URL:
https://aclanthology.org/Q19-1019
DOI:
10.1162/tacl_a_00269
Bibkey:
Cite (ACL):
Zhijiang Guo, Yan Zhang, Zhiyang Teng, and Wei Lu. 2019. Densely Connected Graph Convolutional Networks for Graph-to-Sequence Learning. Transactions of the Association for Computational Linguistics, 7:297–312.
Cite (Informal):
Densely Connected Graph Convolutional Networks for Graph-to-Sequence Learning (Guo et al., TACL 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-bitext-workshop/Q19-1019.pdf
Video:
 https://preview.aclanthology.org/ingest-bitext-workshop/Q19-1019.mp4
Code
 Cartus/DCGCN