Analyzing register variation in web texts through automatic segmentation

Erik Henriksson, Saara Hellström, Veronika Laippala


Abstract
This study introduces a novel method for analyzing register variation in web texts through classification-based register segmentation. While traditional text-linguistic register analysis treats web documents as single units, we present a recursive binary segmentation approach that automatically identifies register shifts within web documents without labeled segment data, using a ModernBERT classifier fine-tuned on full web documents. Manual evaluation shows our approach to be reliable, and our experimental results reveal that register segmentation leads to more accurate register classification, helps models learn more distinct register categories, and produces text units with more consistent linguistic characteristics. The approach offers new insights into documentinternal register variation in online discourse.
Anthology ID:
2025.nlp4dh-1.2
Volume:
Proceedings of the 5th International Conference on Natural Language Processing for Digital Humanities
Month:
May
Year:
2025
Address:
Albuquerque, USA
Editors:
Mika Hämäläinen, Emily Öhman, Yuri Bizzoni, So Miyagawa, Khalid Alnajjar
Venues:
NLP4DH | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7–19
Language:
URL:
https://preview.aclanthology.org/author-page-yuqing-yang-usc/2025.nlp4dh-1.2/
DOI:
10.18653/v1/2025.nlp4dh-1.2
Bibkey:
Cite (ACL):
Erik Henriksson, Saara Hellström, and Veronika Laippala. 2025. Analyzing register variation in web texts through automatic segmentation. In Proceedings of the 5th International Conference on Natural Language Processing for Digital Humanities, pages 7–19, Albuquerque, USA. Association for Computational Linguistics.
Cite (Informal):
Analyzing register variation in web texts through automatic segmentation (Henriksson et al., NLP4DH 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-page-yuqing-yang-usc/2025.nlp4dh-1.2.pdf