Collecting and Analyzing Dialogues in a Tagline Co-Writing Task

Xulin Zhou, Takuma Ichikawa, Ryuichiro Higashinaka

Abstract
The potential usage scenarios of dialogue systems will be greatly expanded if they are able to collaborate more creatively with humans. Many studies have examined ways of building such systems, but most of them focus on problem-solving dialogues, and relatively little research has been done on systems that can engage in creative collaboration with users. In this study, we designed a tagline co-writing task in which two people collaborate to create taglines via text chat, created an interface for data collection, and collected dialogue logs, editing logs, and questionnaire results. In total, we collected 782 Japanese dialogues. We describe the characteristic interactions comprising the tagline co-writing task and report the results of our analysis, in which we examined the kind of utterances that appear in the dialogues as well as the most frequent expressions found in highly rated dialogues in subjective evaluations. We also analyzed the relationship between subjective evaluations and workflow utilized in the dialogues and the interplay between taglines and utterances.
Anthology ID:
2024.lrec-main.311
Volume:
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
Venues:
LREC | COLING
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
3507–3517
Language:
URL:
https://aclanthology.org/2024.lrec-main.311
DOI:
Bibkey:
Cite (ACL):
Xulin Zhou, Takuma Ichikawa, and Ryuichiro Higashinaka. 2024. Collecting and Analyzing Dialogues in a Tagline Co-Writing Task. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 3507–3517, Torino, Italia. ELRA and ICCL.
Cite (Informal):
Collecting and Analyzing Dialogues in a Tagline Co-Writing Task (Zhou et al., LREC-COLING 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-4/2024.lrec-main.311.pdf
PDF Search