A Dataset for Building Code-Mixed Goal Oriented Conversation Systems

Suman Banerjee, Nikita Moghe, Siddhartha Arora, Mitesh M. Khapra

Abstract
There is an increasing demand for goal-oriented conversation systems which can assist users in various day-to-day activities such as booking tickets, restaurant reservations, shopping, etc. Most of the existing datasets for building such conversation systems focus on monolingual conversations and there is hardly any work on multilingual and/or code-mixed conversations. Such datasets and systems thus do not cater to the multilingual regions of the world, such as India, where it is very common for people to speak more than one language and seamlessly switch between them resulting in code-mixed conversations. For example, a Hindi speaking user looking to book a restaurant would typically ask, “Kya tum is restaurant mein ek table book karne mein meri help karoge?” (“Can you help me in booking a table at this restaurant?”). To facilitate the development of such code-mixed conversation models, we build a goal-oriented dialog dataset containing code-mixed conversations. Specifically, we take the text from the DSTC2 restaurant reservation dataset and create code-mixed versions of it in Hindi-English, Bengali-English, Gujarati-English and Tamil-English. We also establish initial baselines on this dataset using existing state of the art models. This dataset along with our baseline implementations will be made publicly available for research purposes.
Anthology ID:
C18-1319
Volume:
Proceedings of the 27th International Conference on Computational Linguistics
Month:
August
Year:
2018
Address:
Santa Fe, New Mexico, USA
Editors:
Emily M. Bender, Leon Derczynski, Pierre Isabelle
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3766–3780
Language:
URL:
https://aclanthology.org/C18-1319
DOI:
Bibkey:
Cite (ACL):
Suman Banerjee, Nikita Moghe, Siddhartha Arora, and Mitesh M. Khapra. 2018. A Dataset for Building Code-Mixed Goal Oriented Conversation Systems. In Proceedings of the 27th International Conference on Computational Linguistics, pages 3766–3780, Santa Fe, New Mexico, USA. Association for Computational Linguistics.
Cite (Informal):
A Dataset for Building Code-Mixed Goal Oriented Conversation Systems (Banerjee et al., COLING 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/fix-dup-bibkey/C18-1319.pdf
PDF Search