Annobot: Platform for Annotating and Creating Datasets through Conversation with a Chatbot

Rafał Poświata, Michał Perełkiewicz

Abstract
In this paper, we introduce Annobot: a platform for annotating and creating datasets through conversation with a chatbot. This natural form of interaction has allowed us to create a more accessible and flexible interface, especially for mobile devices. Our solution has a wide range of applications such as data labelling for binary, multi-class/label classification tasks, preparing data for regression problems, or creating sets for issues such as machine translation, question answering or text summarization. Additional features include pre-annotation, active sampling, online learning and real-time inter-annotator agreement. The system is integrated with the popular messaging platform: Facebook Messanger. Usability experiment showed the advantages of the proposed platform compared to other labelling tools. The source code of Annobot is available under the GNU LGPL license at https://github.com/rafalposwiata/annobot.
Anthology ID:
2020.coling-demos.14
Volume:
Proceedings of the 28th International Conference on Computational Linguistics: System Demonstrations
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Editors:
Michal Ptaszynski, Bartosz Ziolko
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics (ICCL)
Note:
Pages:
75–79
Language:
URL:
https://aclanthology.org/2020.coling-demos.14
DOI:
10.18653/v1/2020.coling-demos.14
Bibkey:
Cite (ACL):
Rafał Poświata and Michał Perełkiewicz. 2020. Annobot: Platform for Annotating and Creating Datasets through Conversation with a Chatbot. In Proceedings of the 28th International Conference on Computational Linguistics: System Demonstrations, pages 75–79, Barcelona, Spain (Online). International Committee on Computational Linguistics (ICCL).
Cite (Informal):
Annobot: Platform for Annotating and Creating Datasets through Conversation with a Chatbot (Poświata & Perełkiewicz, COLING 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/naacl24-info/2020.coling-demos.14.pdf
Code
 rafalposwiata/annobot
PDF Search Code