CHAMP: Efficient Annotation and Consolidation of Cluster Hierarchies
Arie Cattan, Tom Hope, Doug Downey, Roy Bar-Haim, Lilach Eden, Yoav Kantor, Ido Dagan
Abstract
Various NLP tasks require a complex hierarchical structure over nodes, where each node is a cluster of items. Examples include generating entailment graphs, hierarchical cross-document coreference resolution, annotating event and subevent relations, etc. To enable efficient annotation of such hierarchical structures, we release CHAMP, an open source tool allowing to incrementally construct both clusters and hierarchy simultaneously over any type of texts. This incremental approach significantly reduces annotation time compared to the common pairwise annotation approach and also guarantees maintaining transitivity at the cluster and hierarchy levels. Furthermore, CHAMP includes a consolidation mode, where an adjudicator can easily compare multiple cluster hierarchy annotations and resolve disagreements.- Anthology ID:
- 2023.emnlp-demo.37
- Volume:
- Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
- Month:
- December
- Year:
- 2023
- Address:
- Singapore
- Editors:
- Yansong Feng, Els Lefever
- Venue:
- EMNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 403–412
- Language:
- URL:
- https://preview.aclanthology.org/icon-24-ingestion/2023.emnlp-demo.37/
- DOI:
- 10.18653/v1/2023.emnlp-demo.37
- Cite (ACL):
- Arie Cattan, Tom Hope, Doug Downey, Roy Bar-Haim, Lilach Eden, Yoav Kantor, and Ido Dagan. 2023. CHAMP: Efficient Annotation and Consolidation of Cluster Hierarchies. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 403–412, Singapore. Association for Computational Linguistics.
- Cite (Informal):
- CHAMP: Efficient Annotation and Consolidation of Cluster Hierarchies (Cattan et al., EMNLP 2023)
- PDF:
- https://preview.aclanthology.org/icon-24-ingestion/2023.emnlp-demo.37.pdf