Bootstrapping Generators from Noisy Data

Laura Perez-Beltrachini, Mirella Lapata


Abstract
A core step in statistical data-to-text generation concerns learning correspondences between structured data representations (e.g., facts in a database) and associated texts. In this paper we aim to bootstrap generators from large scale datasets where the data (e.g., DBPedia facts) and related texts (e.g., Wikipedia abstracts) are loosely aligned. We tackle this challenging task by introducing a special-purpose content selection mechanism. We use multi-instance learning to automatically discover correspondences between data and text pairs and show how these can be used to enhance the content signal while training an encoder-decoder architecture. Experimental results demonstrate that models trained with content-specific objectives improve upon a vanilla encoder-decoder which solely relies on soft attention.
Anthology ID:
N18-1137
Volume:
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)
Month:
June
Year:
2018
Address:
New Orleans, Louisiana
Editors:
Marilyn Walker, Heng Ji, Amanda Stent
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1516–1527
Language:
URL:
https://preview.aclanthology.org/build-pipeline-with-new-library/N18-1137/
DOI:
10.18653/v1/N18-1137
Bibkey:
Cite (ACL):
Laura Perez-Beltrachini and Mirella Lapata. 2018. Bootstrapping Generators from Noisy Data. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pages 1516–1527, New Orleans, Louisiana. Association for Computational Linguistics.
Cite (Informal):
Bootstrapping Generators from Noisy Data (Perez-Beltrachini & Lapata, NAACL 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/build-pipeline-with-new-library/N18-1137.pdf
Video:
 https://preview.aclanthology.org/build-pipeline-with-new-library/N18-1137.mp4
Code
 EdinburghNLP/wikigen
Data
DBpedia