I know you are different! Towards Persona Driven Knowledge-infused Dialogue Assistant
Shifali Agrahari, Moushumi Mahato, Abhisek Tiwari, Javaid Nabi
Abstract
Despite advances in large language models (LLMs), Task-Oriented Dialogue (TOD) systems often fall short in delivering personalized, context-rich responses, especially in low-resource, code-mixed, and multimodal settings like Hinglish (Hindi-English). To bridge this gap, we introduce HiVisTask, the first Hinglish multimodal, multidomain, persona-based TOD dataset that captures user-agent interactions across text and visual modalities. We also propose G3 TOD, a generalizable framework that enhances personalization using three structured knowledge graphs: entity context, user persona, and commonsense reasoning, all extracted from conversation history. Extensive experiments with LLMs (e.g., LLaMA3.2, Phi3, GPT4, Mistral7b, Qwen3, Gemma3) show that G3 TOD consistently outperforms both standard and ablated baselines. We observe substantial gains across evaluation metrics (both quantitative: BLEU ↑ and qualitative: Human Eval ↑) over existing models. The observed improvements strongly underscore the value of structured and selective contextualization in generating personalized and engaging multimodal responses.- Anthology ID:
- 2026.eacl-long.96
- Volume:
- Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
- Month:
- March
- Year:
- 2026
- Address:
- Rabat, Morocco
- Editors:
- Vera Demberg, Kentaro Inui, Lluís Marquez
- Venue:
- EACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 2181–2205
- Language:
- URL:
- https://preview.aclanthology.org/manual-author-scripts/2026.eacl-long.96/
- DOI:
- Cite (ACL):
- Shifali Agrahari, Moushumi Mahato, Abhisek Tiwari, and Javaid Nabi. 2026. I know you are different! Towards Persona Driven Knowledge-infused Dialogue Assistant. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2181–2205, Rabat, Morocco. Association for Computational Linguistics.
- Cite (Informal):
- I know you are different! Towards Persona Driven Knowledge-infused Dialogue Assistant (Agrahari et al., EACL 2026)
- PDF:
- https://preview.aclanthology.org/manual-author-scripts/2026.eacl-long.96.pdf