An Analysis of Older Users’ Interactions with Spoken Dialogue Systems

Jamie Bost, Johanna Moore


Abstract
This study explores communication differences between older and younger users with a task-oriented spoken dialogue system. Previous analyses of the MATCH corpus show that older users have significantly longer dialogues than younger users and that they are less satisfied with the system. Open questions remain regarding the relationship between information recall and cognitive abilities. This study documents a length annotation scheme designed to explore causes of additional length in the dialogues and the relationships between length, cognitive abilities, user satisfaction, and information recall. Results show that primary causes of older users’ additional length include using polite vocabulary, providing additional information relevant to the task, and using full sentences to respond to the system. Regression models were built to predict length from cognitive abilities and user satisfaction from length. Overall, users with higher cognitive ability scores had shorter dialogues than users with lower cognitive ability scores, and users with shorter dialogues were more satisfied with the system than users with longer dialogues. Dialogue length and cognitive abilities were significantly correlated with information recall. Overall, older users tended to use a human-to-human communication style with the system, whereas younger users tended to adopt a factual interaction style.
Anthology ID:
L14-1417
Volume:
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
Month:
May
Year:
2014
Address:
Reykjavik, Iceland
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
1176–1181
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/502_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Jamie Bost and Johanna Moore. 2014. An Analysis of Older Users’ Interactions with Spoken Dialogue Systems. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 1176–1181, Reykjavik, Iceland. European Language Resources Association (ELRA).
Cite (Informal):
An Analysis of Older Users’ Interactions with Spoken Dialogue Systems (Bost & Moore, LREC 2014)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/502_Paper.pdf