TS-ANNO: An Annotation Tool to Build, Annotate and Evaluate Text Simplification Corpora

Regina Stodden, Laura Kallmeyer


Abstract
We introduce TS-ANNO, an open-source web application for manual creation and for evaluation of parallel corpora for text simplification. TS-ANNO can be used for i) sentence–wise alignment, ii) rating alignment pairs (e.g., w.r.t. grammaticality, meaning preservation, ...), iii) annotating alignment pairs w.r.t. simplification transformations (e.g., lexical substitution, sentence splitting, ...), and iv) manual simplification of complex documents. For evaluation, TS-ANNO calculates inter-annotator agreement of alignments (i) and annotations (ii).
Anthology ID:
2022.acl-demo.14
Volume:
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: System Demonstrations
Month:
May
Year:
2022
Address:
Dublin, Ireland
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
145–155
Language:
URL:
https://aclanthology.org/2022.acl-demo.14
DOI:
10.18653/v1/2022.acl-demo.14
Bibkey:
Cite (ACL):
Regina Stodden and Laura Kallmeyer. 2022. TS-ANNO: An Annotation Tool to Build, Annotate and Evaluate Text Simplification Corpora. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pages 145–155, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
TS-ANNO: An Annotation Tool to Build, Annotate and Evaluate Text Simplification Corpora (Stodden & Kallmeyer, ACL 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/2022.acl-demo.14.pdf
Video:
 https://preview.aclanthology.org/ingestion-script-update/2022.acl-demo.14.mp4
Code
 rstodden/TS_annotation_tool
Data
ASSETASSET Corpus