Dialogue Generation on Infrequent Sentence Functions via Structured Meta-Learning
Yifan Gao, Piji Li, Wei Bi, Xiaojiang Liu, Michael Lyu, Irwin King
Abstract
Sentence function is an important linguistic feature indicating the communicative purpose in uttering a sentence. Incorporating sentence functions into conversations has shown improvements in the quality of generated responses. However, the number of utterances for different types of fine-grained sentence functions is extremely imbalanced. Besides a small number of high-resource sentence functions, a large portion of sentence functions is infrequent. Consequently, dialogue generation conditioned on these infrequent sentence functions suffers from data deficiency. In this paper, we investigate a structured meta-learning (SML) approach for dialogue generation on infrequent sentence functions. We treat dialogue generation conditioned on different sentence functions as separate tasks, and apply model-agnostic meta-learning to high-resource sentence functions data. Furthermore, SML enhances meta-learning effectiveness by promoting knowledge customization among different sentence functions but simultaneously preserving knowledge generalization for similar sentence functions. Experimental results demonstrate that SML not only improves the informativeness and relevance of generated responses, but also can generate responses consistent with the target sentence functions. Code will be public to facilitate the research along this line.- Anthology ID:
- 2020.findings-emnlp.40
- Volume:
- Findings of the Association for Computational Linguistics: EMNLP 2020
- Month:
- November
- Year:
- 2020
- Address:
- Online
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 431–440
- Language:
- URL:
- https://aclanthology.org/2020.findings-emnlp.40
- DOI:
- 10.18653/v1/2020.findings-emnlp.40
- Cite (ACL):
- Yifan Gao, Piji Li, Wei Bi, Xiaojiang Liu, Michael Lyu, and Irwin King. 2020. Dialogue Generation on Infrequent Sentence Functions via Structured Meta-Learning. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 431–440, Online. Association for Computational Linguistics.
- Cite (Informal):
- Dialogue Generation on Infrequent Sentence Functions via Structured Meta-Learning (Gao et al., Findings 2020)
- PDF:
- https://preview.aclanthology.org/ingestion-script-update/2020.findings-emnlp.40.pdf