Neural Text Generation from Rich Semantic Representations
Valerie Hajdik, Jan Buys, Michael Wayne Goodman, Emily M. Bender
Abstract
We propose neural models to generate high-quality text from structured representations based on Minimal Recursion Semantics (MRS). MRS is a rich semantic representation that encodes more precise semantic detail than other representations such as Abstract Meaning Representation (AMR). We show that a sequence-to-sequence model that maps a linearization of Dependency MRS, a graph-based representation of MRS, to text can achieve a BLEU score of 66.11 when trained on gold data. The performance of the model can be improved further using a high-precision, broad coverage grammar-based parser to generate a large silver training corpus, achieving a final BLEU score of 77.17 on the full test set, and 83.37 on the subset of test data most closely matching the silver data domain. Our results suggest that MRS-based representations are a good choice for applications that need both structured semantics and the ability to produce natural language text as output.- Anthology ID:
- N19-1235
- Volume:
- Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)
- Month:
- June
- Year:
- 2019
- Address:
- Minneapolis, Minnesota
- Editors:
- Jill Burstein, Christy Doran, Thamar Solorio
- Venue:
- NAACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 2259–2266
- Language:
- URL:
- https://aclanthology.org/N19-1235
- DOI:
- 10.18653/v1/N19-1235
- Cite (ACL):
- Valerie Hajdik, Jan Buys, Michael Wayne Goodman, and Emily M. Bender. 2019. Neural Text Generation from Rich Semantic Representations. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 2259–2266, Minneapolis, Minnesota. Association for Computational Linguistics.
- Cite (Informal):
- Neural Text Generation from Rich Semantic Representations (Hajdik et al., NAACL 2019)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-3/N19-1235.pdf
- Code
- shlurbee/dmrs-text-generation-naacl2019