Sequential Attention with Keyword Mask Model for Community-based Question Answering

Jianxin Yang, Wenge Rong, Libin Shi, Zhang Xiong


Abstract
In Community-based Question Answering system(CQA), Answer Selection(AS) is a critical task, which focuses on finding a suitable answer within a list of candidate answers. For neural network models, the key issue is how to model the representations of QA text pairs and calculate the interactions between them. We propose a Sequential Attention with Keyword Mask model(SAKM) for CQA to imitate human reading behavior. Question and answer text regard each other as context within keyword-mask attention when encoding the representations, and repeat multiple times(hops) in a sequential style. So the QA pairs capture features and information from both question text and answer text, interacting and improving vector representations iteratively through hops. The flexibility of the model allows to extract meaningful keywords from the sentences and enhance diverse mutual information. We perform on answer selection tasks and multi-level answer ranking tasks. Experiment results demonstrate the superiority of our proposed model on community-based QA datasets.
Anthology ID:
N19-1228
Volume:
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)
Month:
June
Year:
2019
Address:
Minneapolis, Minnesota
Editors:
Jill Burstein, Christy Doran, Thamar Solorio
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2201–2211
Language:
URL:
https://aclanthology.org/N19-1228
DOI:
10.18653/v1/N19-1228
Bibkey:
Cite (ACL):
Jianxin Yang, Wenge Rong, Libin Shi, and Zhang Xiong. 2019. Sequential Attention with Keyword Mask Model for Community-based Question Answering. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 2201–2211, Minneapolis, Minnesota. Association for Computational Linguistics.
Cite (Informal):
Sequential Attention with Keyword Mask Model for Community-based Question Answering (Yang et al., NAACL 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/autopr/N19-1228.pdf
Code
 sheep-for/question_answer_matching