Redundancy Localization for the Conversationalization of Unstructured Responses
Sebastian Krause, Mikhail Kozhevnikov, Eric Malmi, Daniele Pighin
Abstract
Conversational agents offer users a natural-language interface to accomplish tasks, entertain themselves, or access information. Informational dialogue is particularly challenging in that the agent has to hold a conversation on an open topic, and to achieve a reasonable coverage it generally needs to digest and present unstructured information from textual sources. Making responses based on such sources sound natural and fit appropriately into the conversation context is a topic of ongoing research, one of the key issues of which is preventing the agent’s responses from sounding repetitive. Targeting this issue, we propose a new task, known as redundancy localization, which aims to pinpoint semantic overlap between text passages. To help address it systematically, we formalize the task, prepare a public dataset with fine-grained redundancy labels, and propose a model utilizing a weak training signal defined over the results of a passage-retrieval system on web texts. The proposed model demonstrates superior performance compared to a state-of-the-art entailment model and yields encouraging results when applied to a real-world dialogue.- Anthology ID:
- W17-5515
- Volume:
- Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue
- Month:
- August
- Year:
- 2017
- Address:
- Saarbrücken, Germany
- Editors:
- Kristiina Jokinen, Manfred Stede, David DeVault, Annie Louis
- Venue:
- SIGDIAL
- SIG:
- SIGDIAL
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 115–126
- Language:
- URL:
- https://aclanthology.org/W17-5515
- DOI:
- 10.18653/v1/W17-5515
- Cite (ACL):
- Sebastian Krause, Mikhail Kozhevnikov, Eric Malmi, and Daniele Pighin. 2017. Redundancy Localization for the Conversationalization of Unstructured Responses. In Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue, pages 115–126, Saarbrücken, Germany. Association for Computational Linguistics.
- Cite (Informal):
- Redundancy Localization for the Conversationalization of Unstructured Responses (Krause et al., SIGDIAL 2017)
- PDF:
- https://preview.aclanthology.org/corrections-2024-07/W17-5515.pdf