I know you are different! Towards Persona Driven Knowledge-infused Dialogue Assistant

Shifali Agrahari, Moushumi Mahato, Abhisek Tiwari, Javaid Nabi


Abstract
Despite advances in large language models (LLMs), Task-Oriented Dialogue (TOD) systems often fall short in delivering personalized, context-rich responses, especially in low-resource, code-mixed, and multimodal settings like Hinglish (Hindi-English). To bridge this gap, we introduce HiVisTask, the first Hinglish multimodal, multidomain, persona-based TOD dataset that captures user-agent interactions across text and visual modalities. We also propose G3 TOD, a generalizable framework that enhances personalization using three structured knowledge graphs: entity context, user persona, and commonsense reasoning, all extracted from conversation history. Extensive experiments with LLMs (e.g., LLaMA3.2, Phi3, GPT4, Mistral7b, Qwen3, Gemma3) show that G3 TOD consistently outperforms both standard and ablated baselines. We observe substantial gains across evaluation metrics (both quantitative: BLEU ↑ and qualitative: Human Eval ↑) over existing models. The observed improvements strongly underscore the value of structured and selective contextualization in generating personalized and engaging multimodal responses.
Anthology ID:
2026.eacl-long.96
Volume:
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Vera Demberg, Kentaro Inui, Lluís Marquez
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2181–2205
Language:
URL:
https://preview.aclanthology.org/manual-author-scripts/2026.eacl-long.96/
DOI:
Bibkey:
Cite (ACL):
Shifali Agrahari, Moushumi Mahato, Abhisek Tiwari, and Javaid Nabi. 2026. I know you are different! Towards Persona Driven Knowledge-infused Dialogue Assistant. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2181–2205, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
I know you are different! Towards Persona Driven Knowledge-infused Dialogue Assistant (Agrahari et al., EACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/manual-author-scripts/2026.eacl-long.96.pdf
Checklist:
 2026.eacl-long.96.checklist.pdf