Abstract
This paper presents RST-Tace, a tool for automatic comparison and evaluation of RST trees. RST-Tace serves as an implementation of Iruskieta’s comparison method, which allows trees to be compared and evaluated without the influence of decisions at lower levels in a tree in terms of four factors: constituent, attachment point, nuclearity as well as relation. RST-Tace can be used regardless of the language or the size of rhetorical trees. This tool aims to measure the agreement between two annotators. The result is reflected by F-measure and inter-annotator agreement. Both the comparison table and the result of the evaluation can be obtained automatically.- Anthology ID:
- W19-2712
- Volume:
- Proceedings of the Workshop on Discourse Relation Parsing and Treebanking 2019
- Month:
- June
- Year:
- 2019
- Address:
- Minneapolis, MN
- Editors:
- Amir Zeldes, Debopam Das, Erick Maziero Galani, Juliano Desiderato Antonio, Mikel Iruskieta
- Venue:
- NAACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 88–96
- Language:
- URL:
- https://aclanthology.org/W19-2712
- DOI:
- 10.18653/v1/W19-2712
- Cite (ACL):
- Shujun Wan, Tino Kutschbach, Anke Lüdeling, and Manfred Stede. 2019. RST-Tace A tool for automatic comparison and evaluation of RST trees. In Proceedings of the Workshop on Discourse Relation Parsing and Treebanking 2019, pages 88–96, Minneapolis, MN. Association for Computational Linguistics.
- Cite (Informal):
- RST-Tace A tool for automatic comparison and evaluation of RST trees (Wan et al., NAACL 2019)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/W19-2712.pdf
- Code
- tkutschbach/RST-Tace