GATE Teamware 2: An open-source tool for collaborative document classification annotation
David Wilby, Twin Karmakharm, Ian Roberts, Xingyi Song, Kalina Bontcheva
Abstract
We present GATE Teamware 2: an open-source web-based platform for managing teams of annotators working on document classification tasks. GATE Teamware 2 is an entirely re-engineered successor to GATE Teamware, using contemporary web frameworks. The software allows the management of teams of multiple annotators, project managers and administrators - including the management of annotators - across multiple projects. Projects can be configured to control and monitor the annotation statistics and have a highly flexible JSON-configurable annotation display which can include arbitrary HTML. Optionally, documents can be uploaded with pre-existing annotations and documents are served to annotators in a random order by default to reduce bias. Crucially, annotators can be trained on applying the annotation guidelines correctly and then screened for quality assurance purposes, prior to being cleared for independent annotation. GATE Teamware 2 can be self-deployed, including in container orchestration environments, or provided as private, hosted cloud instances.GATE Teamware 2 is an open-source software and can be downloaded from https://github.com/GATENLP/gate-teamware.A demonstration video of the system has also been made available at https://youtu.be/KoXkuhc4fmM.- Anthology ID:
- 2023.eacl-demo.17
- Volume:
- Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations
- Month:
- May
- Year:
- 2023
- Address:
- Dubrovnik, Croatia
- Editors:
- Danilo Croce, Luca Soldaini
- Venue:
- EACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 145–151
- Language:
- URL:
- https://aclanthology.org/2023.eacl-demo.17
- DOI:
- 10.18653/v1/2023.eacl-demo.17
- Cite (ACL):
- David Wilby, Twin Karmakharm, Ian Roberts, Xingyi Song, and Kalina Bontcheva. 2023. GATE Teamware 2: An open-source tool for collaborative document classification annotation. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations, pages 145–151, Dubrovnik, Croatia. Association for Computational Linguistics.
- Cite (Informal):
- GATE Teamware 2: An open-source tool for collaborative document classification annotation (Wilby et al., EACL 2023)
- PDF:
- https://preview.aclanthology.org/naacl24-info/2023.eacl-demo.17.pdf