Designing a Symbolic Intermediate Representation for Neural Surface Realization

Henry Elder, Jennifer Foster, James Barry, Alexander O’Connor


Abstract
Generated output from neural NLG systems often contain errors such as hallucination, repetition or contradiction. This work focuses on designing a symbolic intermediate representation to be used in multi-stage neural generation with the intention of reducing the frequency of failed outputs. We show that surface realization from this intermediate representation is of high quality and when the full system is applied to the E2E dataset it outperforms the winner of the E2E challenge. Furthermore, by breaking out the surface realization step from typically end-to-end neural systems, we also provide a framework for non-neural based content selection and planning systems to potentially take advantage of semi-supervised pretraining of neural surface realization models.
Anthology ID:
W19-2308
Volume:
Proceedings of the Workshop on Methods for Optimizing and Evaluating Neural Language Generation
Month:
June
Year:
2019
Address:
Minneapolis, Minnesota
Venues:
NAACL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
65–73
Language:
URL:
https://aclanthology.org/W19-2308
DOI:
10.18653/v1/W19-2308
Bibkey:
Cite (ACL):
Henry Elder, Jennifer Foster, James Barry, and Alexander O’Connor. 2019. Designing a Symbolic Intermediate Representation for Neural Surface Realization. In Proceedings of the Workshop on Methods for Optimizing and Evaluating Neural Language Generation, pages 65–73, Minneapolis, Minnesota. Association for Computational Linguistics.
Cite (Informal):
Designing a Symbolic Intermediate Representation for Neural Surface Realization (Elder et al., 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/update-css-js/W19-2308.pdf