DESCGEN: A Distantly Supervised Datasetfor Generating Entity Descriptions

Weijia Shi, Mandar Joshi, Luke Zettlemoyer


Abstract
Short textual descriptions of entities provide summaries of their key attributes and have been shown to be useful sources of background knowledge for tasks such as entity linking and question answering. However, generating entity descriptions, especially for new and long-tail entities, can be challenging since relevant information is often scattered across multiple sources with varied content and style. We introduce DESCGEN: given mentions spread over multiple documents, the goal is to generate an entity summary description. DESCGEN consists of 37K entity descriptions from Wikipedia and Fandom, each paired with nine evidence documents on average. The documents were collected using a combination of entity linking and hyperlinks into the entity pages, which together provide high-quality distant supervision. Compared to other multi-document summarization tasks, our task is entity-centric, more abstractive, and covers a wide range of domains. We also propose a two-stage extract-then-generate baseline and show that there exists a large gap (19.9% in ROUGE-L) between state-of-art models and human performance, suggesting that the data will support significant future work.
Anthology ID:
2021.acl-long.35
Volume:
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
Month:
August
Year:
2021
Address:
Online
Venues:
ACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
415–427
Language:
URL:
https://aclanthology.org/2021.acl-long.35
DOI:
10.18653/v1/2021.acl-long.35
Bibkey:
Cite (ACL):
Weijia Shi, Mandar Joshi, and Luke Zettlemoyer. 2021. DESCGEN: A Distantly Supervised Datasetfor Generating Entity Descriptions. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 415–427, Online. Association for Computational Linguistics.
Cite (Informal):
DESCGEN: A Distantly Supervised Datasetfor Generating Entity Descriptions (Shi et al., ACL 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/update-css-js/2021.acl-long.35.pdf
Code
 swj0419/DESCGEN
Data
RealNewsWikiSum