Can predicate-argument relationships be extracted from UD trees?

Adam Ek, Jean-Philippe Bernardy, Stergios Chatzikyriakidis


Abstract
In this paper we investigate the possibility of extracting predicate-argument relations from UD trees (and enhanced UD graphs). Con- cretely, we apply UD parsers on an En- glish question answering/semantic-role label- ing data set (FitzGerald et al., 2018) and check if the annotations reflect the relations in the resulting parse trees, using a small number of rules to extract this information. We find that 79.1% of the argument-predicate pairs can be found in this way, on the basis of Ud- ify (Kondratyuk and Straka, 2019). Error anal- ysis reveals that half of the error cases are at- tributable to shortcomings in the dataset. The remaining errors are mostly due to predicate- argument relations not being extractible algo- rithmically from the UD trees (requiring se- mantic reasoning to be resolved). The parser itself is only responsible for a small portion of errors. Our analysis suggests a number of improvements to the UD annotation schema: we propose to enhance the schema in four ways, in order to capture argument-predicate relations. Additionally, we propose improve- ments regarding data collection for question answering/semantic-role labeling data.
Anthology ID:
2021.law-1.5
Volume:
Proceedings of the Joint 15th Linguistic Annotation Workshop (LAW) and 3rd Designing Meaning Representations (DMR) Workshop
Month:
November
Year:
2021
Address:
Punta Cana, Dominican Republic
Editors:
Claire Bonial, Nianwen Xue
Venue:
LAW
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
46–55
Language:
URL:
https://aclanthology.org/2021.law-1.5
DOI:
10.18653/v1/2021.law-1.5
Bibkey:
Cite (ACL):
Adam Ek, Jean-Philippe Bernardy, and Stergios Chatzikyriakidis. 2021. Can predicate-argument relationships be extracted from UD trees?. In Proceedings of the Joint 15th Linguistic Annotation Workshop (LAW) and 3rd Designing Meaning Representations (DMR) Workshop, pages 46–55, Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Can predicate-argument relationships be extracted from UD trees? (Ek et al., LAW 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/add_acl24_videos/2021.law-1.5.pdf
Data
QA-SRLUniversal Dependencies