Integrating knowledge graph embeddings to improve mention representation for bridging anaphora resolution

Onkar Pandit, Pascal Denis, Liva Ralaivola


Abstract
Lexical semantics and world knowledge are crucial for interpreting bridging anaphora. Yet, existing computational methods for acquiring and injecting this type of information into bridging resolution systems suffer important limitations. Based on explicit querying of external knowledge bases, earlier approaches are computationally expensive (hence, hardly scalable) and they map the data to be processed into high-dimensional spaces (careful handling of the curse of dimensionality and overfitting has to be in order). In this work, we take a different and principled approach which naturally addresses these issues. Specifically, we convert the external knowledge source (in this case, WordNet) into a graph, and learn embeddings of the graph nodes of low dimension to capture the crucial features of the graph topology and, at the same time, rich semantic information. Once properly identified from the mention text spans, these low dimensional graph node embeddings are combined with distributional text-based embeddings to provide enhanced mention representations. We illustrate the effectiveness of our approach by evaluating it on commonly used datasets, namely ISNotes and BASHI. Our enhanced mention representations yield significant accuracy improvements on both datasets when compared to different standalone text-based mention representations.
Anthology ID:
2020.crac-1.7
Volume:
Proceedings of the Third Workshop on Computational Models of Reference, Anaphora and Coreference
Month:
December
Year:
2020
Address:
Barcelona, Spain (online)
Venue:
CRAC
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
55–67
Language:
URL:
https://aclanthology.org/2020.crac-1.7
DOI:
Bibkey:
Cite (ACL):
Onkar Pandit, Pascal Denis, and Liva Ralaivola. 2020. Integrating knowledge graph embeddings to improve mention representation for bridging anaphora resolution. In Proceedings of the Third Workshop on Computational Models of Reference, Anaphora and Coreference, pages 55–67, Barcelona, Spain (online). Association for Computational Linguistics.
Cite (Informal):
Integrating knowledge graph embeddings to improve mention representation for bridging anaphora resolution (Pandit et al., CRAC 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/2020.crac-1.7.pdf