Knowledge-Enriched Natural Language Generation
Wenhao Yu, Meng Jiang, Zhiting Hu, Qingyun Wang, Heng Ji, Nazneen Rajani
Abstract
Knowledge-enriched text generation poses unique challenges in modeling and learning, driving active research in several core directions, ranging from integrated modeling of neural representations and symbolic information in the sequential/hierarchical/graphical structures, learning without direct supervisions due to the cost of structured annotation, efficient optimization and inference with massive and global constraints, to language grounding on multiple modalities, and generative reasoning with implicit commonsense knowledge and background knowledge. In this tutorial we will present a roadmap to line up the state-of-the-art methods to tackle these challenges on this cutting-edge problem. We will dive deep into various technical components: how to represent knowledge, how to feed knowledge into a generation model, how to evaluate generation results, and what are the remaining challenges?- Anthology ID:
- 2021.emnlp-tutorials.3
- Volume:
- Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing: Tutorial Abstracts
- Month:
- November
- Year:
- 2021
- Address:
- Punta Cana, Dominican Republic & Online
- Venue:
- EMNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 11–16
- Language:
- URL:
- https://aclanthology.org/2021.emnlp-tutorials.3
- DOI:
- 10.18653/v1/2021.emnlp-tutorials.3
- Cite (ACL):
- Wenhao Yu, Meng Jiang, Zhiting Hu, Qingyun Wang, Heng Ji, and Nazneen Rajani. 2021. Knowledge-Enriched Natural Language Generation. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing: Tutorial Abstracts, pages 11–16, Punta Cana, Dominican Republic & Online. Association for Computational Linguistics.
- Cite (Informal):
- Knowledge-Enriched Natural Language Generation (Yu et al., EMNLP 2021)
- PDF:
- https://preview.aclanthology.org/ingestion-script-update/2021.emnlp-tutorials.3.pdf
- Code
- wyu97/KENLG-Reading