Decomposing Complex Questions Makes Multi-Hop QA Easier and More Interpretable

Ruiliu Fu, Han Wang, Xuejun Zhang, Jun Zhou, Yonghong Yan


Abstract
Multi-hop QA requires the machine to answer complex questions through finding multiple clues and reasoning, and provide explanatory evidence to demonstrate the machine’s reasoning process. We propose Relation Extractor-Reader and Comparator (RERC), a three-stage framework based on complex question decomposition. The Relation Extractor decomposes the complex question, and then the Reader answers the sub-questions in turn, and finally the Comparator performs numerical comparison and summarizes all to get the final answer, where the entire process itself constitutes a complete reasoning evidence path. In the 2WikiMultiHopQA dataset, our RERC model has achieved the state-of-the-art performance, with a winning joint F1 score of 53.58 on the leaderboard. All indicators of our RERC are close to human performance, with only 1.95 behind the human level in F1 score of support fact. At the same time, the evidence path provided by our RERC framework has excellent readability and faithfulness.
Anthology ID:
2021.findings-emnlp.17
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2021
Month:
November
Year:
2021
Address:
Punta Cana, Dominican Republic
Venues:
EMNLP | Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
169–180
Language:
URL:
https://aclanthology.org/2021.findings-emnlp.17
DOI:
10.18653/v1/2021.findings-emnlp.17
Bibkey:
Cite (ACL):
Ruiliu Fu, Han Wang, Xuejun Zhang, Jun Zhou, and Yonghong Yan. 2021. Decomposing Complex Questions Makes Multi-Hop QA Easier and More Interpretable. In Findings of the Association for Computational Linguistics: EMNLP 2021, pages 169–180, Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Decomposing Complex Questions Makes Multi-Hop QA Easier and More Interpretable (Fu et al., Findings 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/update-css-js/2021.findings-emnlp.17.pdf
Code
 Alab-NII/2wikimultihop
Data
2WikiMultiHopQAHotpotQASQuAD