Creating Conversational Characters Using Question Generation Tools

Xuchen Yao, Emma Tosch, Grace Chen, Elnaz Nouri, Ron Artstein, Anton Leuski, Kenji Sagae, David Traum


Abstract
This article describes a new tool for extracting question-answer pairs from text articles, and reports three experiments which investigate how suitable this technique is for supplying knowledge to conversational characters. Experiment 1 demonstrates the feasibility of our method by creating characters for 14 distinct topics and evaluating them using hand-authored questions. Experiment 2 evaluates three of these characters using questions collected from naive participants, showing that the generated characters provide full or partial answers to about half of the questions asked. Experiment 3 adds automatically extracted knowledge to an existing, hand-authored character, demonstrating that augmented characters can answer questions about new topics but with some degradation of the ability to answer questions about topics that the original character was trained to answer. Overall, the results show that question generation is a promising method for creating or augmenting a question answering conversational character using an existing text.
Anthology ID:
2012.dnd-3.3
Volume:
Dialogue Discourse Volume 3
Month:
Year:
2012
Address:
Editors:
Gregory Aist, Paul Piwek, Kristy Elizabeth Boyer
Venue:
DND
SIG:
SIGDIAL
Publisher:
Note:
Pages:
125–146
Language:
URL:
https://preview.aclanthology.org/ingest-dnd/2012.dnd-3.3/
DOI:
10.5087/dad.2012.206
Bibkey:
Cite (ACL):
Xuchen Yao, Emma Tosch, Grace Chen, Elnaz Nouri, Ron Artstein, Anton Leuski, Kenji Sagae, and David Traum. 2012. Creating Conversational Characters Using Question Generation Tools. Dialogue & Discourse, 3:125–146.
Cite (Informal):
Creating Conversational Characters Using Question Generation Tools (Yao et al., DND 2012)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-dnd/2012.dnd-3.3.pdf