Graph Convolutions over Constituent Trees for Syntax-Aware Semantic Role Labeling

Diego Marcheggiani, Ivan Titov


Abstract
Semantic role labeling (SRL) is the task of identifying predicates and labeling argument spans with semantic roles. Even though most semantic-role formalisms are built upon constituent syntax, and only syntactic constituents can be labeled as arguments (e.g., FrameNet and PropBank), all the recent work on syntax-aware SRL relies on dependency representations of syntax. In contrast, we show how graph convolutional networks (GCNs) can be used to encode constituent structures and inform an SRL system. Nodes in our SpanGCN correspond to constituents. The computation is done in 3 stages. First, initial node representations are produced by ‘composing’ word representations of the first and last words in the constituent. Second, graph convolutions relying on the constituent tree are performed, yielding syntactically-informed constituent representations. Finally, the constituent representations are ‘decomposed’ back into word representations, which are used as input to the SRL classifier. We evaluate SpanGCN against alternatives, including a model using GCNs over dependency trees, and show its effectiveness on standard English SRL benchmarks CoNLL-2005, CoNLL-2012, and FrameNet.
Anthology ID:
2020.emnlp-main.322
Volume:
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
Month:
November
Year:
2020
Address:
Online
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3915–3928
Language:
URL:
https://aclanthology.org/2020.emnlp-main.322
DOI:
10.18653/v1/2020.emnlp-main.322
Bibkey:
Cite (ACL):
Diego Marcheggiani and Ivan Titov. 2020. Graph Convolutions over Constituent Trees for Syntax-Aware Semantic Role Labeling. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 3915–3928, Online. Association for Computational Linguistics.
Cite (Informal):
Graph Convolutions over Constituent Trees for Syntax-Aware Semantic Role Labeling (Marcheggiani & Titov, EMNLP 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/update-css-js/2020.emnlp-main.322.pdf
Code
 diegma/span-gcn
Data
FrameNet