BATS: BenchmArking Text Simplicity 🦇
Christin Kreutz, Fabian Haak, Björn Engelmann, Philipp Schaer
Abstract
Evaluation of text simplification currently focuses on the difference of a source text to its simplified variant. Datasets for this evaluation base on a specific topic and group of readers for which is simplified. The broad applicability of text simplification and specifics that come with intended target audiences (e.g., children compared to adult non-experts) are disregarded. An explainable assessment of the overall simplicity of text is missing. This work is BenchmArking Text Simplicity (BATS): we provide an explainable method to assess practical and concrete rules from literature describing features of simplicity and complexity of text. Our experiments on 15 datasets for text simplification highlight differences in features that are important in different domains of text and for different intended target audiences.- Anthology ID:
- 2024.findings-acl.712
- Volume:
- Findings of the Association for Computational Linguistics ACL 2024
- Month:
- August
- Year:
- 2024
- Address:
- Bangkok, Thailand and virtual meeting
- Editors:
- Lun-Wei Ku, Andre Martins, Vivek Srikumar
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 11968–11989
- Language:
- URL:
- https://aclanthology.org/2024.findings-acl.712
- DOI:
- 10.18653/v1/2024.findings-acl.712
- Cite (ACL):
- Christin Kreutz, Fabian Haak, Björn Engelmann, and Philipp Schaer. 2024. BATS: BenchmArking Text Simplicity 🦇. In Findings of the Association for Computational Linguistics ACL 2024, pages 11968–11989, Bangkok, Thailand and virtual meeting. Association for Computational Linguistics.
- Cite (Informal):
- BATS: BenchmArking Text Simplicity 🦇 (Kreutz et al., Findings 2024)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-5/2024.findings-acl.712.pdf