Abstract
Current end-to-end semantic role labeling is mostly accomplished via graph-based neural models. However, these all are first-order models, where each decision for detecting any predicate-argument pair is made in isolation with local features. In this paper, we present a high-order refining mechanism to perform interaction between all predicate-argument pairs. Based on the baseline graph model, our high-order refining module learns higher-order features between all candidate pairs via attention calculation, which are later used to update the original token representations. After several iterations of refinement, the underlying token representations can be enriched with globally interacted features. Our high-order model achieves state-of-the-art results on Chinese SRL data, including CoNLL09 and Universal Proposition Bank, meanwhile relieving the long-range dependency issues.- Anthology ID:
- 2020.aacl-main.13
- Volume:
- Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing
- Month:
- December
- Year:
- 2020
- Address:
- Suzhou, China
- Editors:
- Kam-Fai Wong, Kevin Knight, Hua Wu
- Venue:
- AACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 100–105
- Language:
- URL:
- https://aclanthology.org/2020.aacl-main.13
- DOI:
- Cite (ACL):
- Hao Fei, Yafeng Ren, and Donghong Ji. 2020. High-order Refining for End-to-end Chinese Semantic Role Labeling. In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, pages 100–105, Suzhou, China. Association for Computational Linguistics.
- Cite (Informal):
- High-order Refining for End-to-end Chinese Semantic Role Labeling (Fei et al., AACL 2020)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-2/2020.aacl-main.13.pdf