Answer-Supervised Question Reformulation for Enhancing Conversational Machine Comprehension
Qian Li, Hui Su, Cheng Niu, Daling Wang, Zekang Li, Shi Feng, Yifei Zhang
Abstract
In conversational machine comprehension, it has become one of the research hotspots integrating conversational history information through question reformulation for obtaining better answers. However, the existing question reformulation models are trained only using supervised question labels annotated by annotators without considering any feedback information from answers. In this paper, we propose a novel Answer-Supervised Question Reformulation (ASQR) model for enhancing conversational machine comprehension with reinforcement learning technology. ASQR utilizes a pointer-copy-based question reformulation model as an agent, takes an action to predict the next word, and observes a reward for the whole sentence state after generating the end-of-sequence token. The experimental results on QuAC dataset prove that our ASQR model is more effective in conversational machine comprehension. Moreover, pretraining is essential in reinforcement learning models, so we provide a high-quality annotated dataset for question reformulation by sampling a part of QuAC dataset.- Anthology ID:
- D19-5805
- Volume:
- Proceedings of the 2nd Workshop on Machine Reading for Question Answering
- Month:
- November
- Year:
- 2019
- Address:
- Hong Kong, China
- Editors:
- Adam Fisch, Alon Talmor, Robin Jia, Minjoon Seo, Eunsol Choi, Danqi Chen
- Venue:
- WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 38–47
- Language:
- URL:
- https://aclanthology.org/D19-5805
- DOI:
- 10.18653/v1/D19-5805
- Cite (ACL):
- Qian Li, Hui Su, Cheng Niu, Daling Wang, Zekang Li, Shi Feng, and Yifei Zhang. 2019. Answer-Supervised Question Reformulation for Enhancing Conversational Machine Comprehension. In Proceedings of the 2nd Workshop on Machine Reading for Question Answering, pages 38–47, Hong Kong, China. Association for Computational Linguistics.
- Cite (Informal):
- Answer-Supervised Question Reformulation for Enhancing Conversational Machine Comprehension (Li et al., 2019)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-5/D19-5805.pdf