Hierarchical Losses and New Resources for Fine-grained Entity Typing and Linking
Shikhar Murty, Patrick Verga, Luke Vilnis, Irena Radovanovic, Andrew McCallum
Abstract
Extraction from raw text to a knowledge base of entities and fine-grained types is often cast as prediction into a flat set of entity and type labels, neglecting the rich hierarchies over types and entities contained in curated ontologies. Previous attempts to incorporate hierarchical structure have yielded little benefit and are restricted to shallow ontologies. This paper presents new methods using real and complex bilinear mappings for integrating hierarchical information, yielding substantial improvement over flat predictions in entity linking and fine-grained entity typing, and achieving new state-of-the-art results for end-to-end models on the benchmark FIGER dataset. We also present two new human-annotated datasets containing wide and deep hierarchies which we will release to the community to encourage further research in this direction: MedMentions, a collection of PubMed abstracts in which 246k mentions have been mapped to the massive UMLS ontology; and TypeNet, which aligns Freebase types with the WordNet hierarchy to obtain nearly 2k entity types. In experiments on all three datasets we show substantial gains from hierarchy-aware training.- Anthology ID:
- P18-1010
- Volume:
- Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Month:
- July
- Year:
- 2018
- Address:
- Melbourne, Australia
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 97–109
- Language:
- URL:
- https://aclanthology.org/P18-1010
- DOI:
- 10.18653/v1/P18-1010
- Cite (ACL):
- Shikhar Murty, Patrick Verga, Luke Vilnis, Irena Radovanovic, and Andrew McCallum. 2018. Hierarchical Losses and New Resources for Fine-grained Entity Typing and Linking. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 97–109, Melbourne, Australia. Association for Computational Linguistics.
- Cite (Informal):
- Hierarchical Losses and New Resources for Fine-grained Entity Typing and Linking (Murty et al., ACL 2018)
- PDF:
- https://preview.aclanthology.org/remove-xml-comments/P18-1010.pdf
- Code
- chanzuckerberg/MedMentions + additional community code
- Data
- FIGER, NCBI Disease