A Detailed Account of The First Question Generation Shared Task Evaluation Challenge
Vasile Rus, Brendan Wyse, Paul Piwek, Mihai Lintean, Svetlana Stoyanchev, Cristian Moldovan
Abstract
The paper provides a detailed account of the First Shared Task Evaluation Challenge on Question Generation that took place in 2010. The campaign included two tasks that take text as input and produce text, i.e. questions, as output: Task A - “ Question Generation from Paragraphs and Task B - “ Question Generation from Sentences. Motivation, data sets, evaluation criteria, guidelines for judges, and results are presented for the two tasks. Lessons learned and advice for future Question Generation Shared Task Evaluation Challenges (QG-STEC) are also offered.- Anthology ID:
- 2012.dnd-3.1
- Volume:
- Dialogue Discourse Volume 3
- Month:
- Year:
- 2012
- Address:
- Editors:
- Gregory Aist, Paul Piwek, Kristy Elizabeth Boyer
- Venue:
- DND
- SIG:
- SIGDIAL
- Publisher:
- Note:
- Pages:
- 177–204
- Language:
- URL:
- https://preview.aclanthology.org/ingest-dnd/2012.dnd-3.1/
- DOI:
- 10.5087/dad.2012.208
- Cite (ACL):
- Vasile Rus, Brendan Wyse, Paul Piwek, Mihai Lintean, Svetlana Stoyanchev, and Cristian Moldovan. 2012. A Detailed Account of The First Question Generation Shared Task Evaluation Challenge. Dialogue & Discourse, 3:177–204.
- Cite (Informal):
- A Detailed Account of The First Question Generation Shared Task Evaluation Challenge (Rus et al., DND 2012)
- PDF:
- https://preview.aclanthology.org/ingest-dnd/2012.dnd-3.1.pdf