IJCNLP-2017 Task 5: Multi-choice Question Answering in Examinations
Shangmin Guo, Kang Liu, Shizhu He, Cao Liu, Jun Zhao, Zhuoyu Wei
Abstract
The IJCNLP-2017 Multi-choice Question Answering(MCQA) task aims at exploring the performance of current Question Answering(QA) techniques via the realworld complex questions collected from Chinese Senior High School Entrance Examination papers and CK12 website1. The questions are all 4-way multi-choice questions writing in Chinese and English respectively that cover a wide range of subjects, e.g. Biology, History, Life Science and etc. And, all questions are restrained within the elementary and middle school level. During the whole procedure of this task, 7 teams submitted 323 runs in total. This paper describes the collected data, the format and size of these questions, formal run statistics and results, overview and performance statistics of different methods- Anthology ID:
- I17-4005
- Volume:
- Proceedings of the IJCNLP 2017, Shared Tasks
- Month:
- December
- Year:
- 2017
- Address:
- Taipei, Taiwan
- Venue:
- IJCNLP
- SIG:
- Publisher:
- Asian Federation of Natural Language Processing
- Note:
- Pages:
- 34–40
- Language:
- URL:
- https://aclanthology.org/I17-4005
- DOI:
- Cite (ACL):
- Shangmin Guo, Kang Liu, Shizhu He, Cao Liu, Jun Zhao, and Zhuoyu Wei. 2017. IJCNLP-2017 Task 5: Multi-choice Question Answering in Examinations. In Proceedings of the IJCNLP 2017, Shared Tasks, pages 34–40, Taipei, Taiwan. Asian Federation of Natural Language Processing.
- Cite (Informal):
- IJCNLP-2017 Task 5: Multi-choice Question Answering in Examinations (Guo et al., IJCNLP 2017)
- PDF:
- https://preview.aclanthology.org/auto-file-uploads/I17-4005.pdf
- Data
- IGC