Label Bias in Symbolic Representation of Meaning

Marie Mikulová, Jan Štěpánek, Jan Hajič


Abstract
This paper contributes to the trend of building semantic representations and exploring the relations between a language and the world it represents. We analyse alternative approaches to semantic representation, focusing on methodology of determining meaning categories, their arrangement and granularity, and annotation consistency and reliability. Using the task of semantic classification of circumstantial meanings within the Prague Dependency Treebank framework, we present our principles for analyzing meaning categories. Compared with the discussed projects, the unique aspect of our approach is its focus on how a language, in its structure, reflects reality. We employ a two-level classification: a higher, coarse-grained set of general semantic concepts (defined by questions: where, how, why, etc.) and a fine-grained set of circumstantial meanings based on data-driven analysis, reflecting meanings fixed in the language. We highlight that the inherent vagueness of linguistic meaning is crucial for capturing the limitless variety of the world but it can lead to label biases in datasets. Therefore, besides semantically clear categories, we also use fuzzy meaning categories.
Anthology ID:
2025.law-1.12
Volume:
Proceedings of the 19th Linguistic Annotation Workshop (LAW-XIX-2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Siyao Peng, Ines Rehbein
Venues:
LAW | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
142–159
Language:
URL:
https://preview.aclanthology.org/landing_page/2025.law-1.12/
DOI:
10.18653/v1/2025.law-1.12
Bibkey:
Cite (ACL):
Marie Mikulová, Jan Štěpánek, and Jan Hajič. 2025. Label Bias in Symbolic Representation of Meaning. In Proceedings of the 19th Linguistic Annotation Workshop (LAW-XIX-2025), pages 142–159, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Label Bias in Symbolic Representation of Meaning (Mikulová et al., LAW 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/landing_page/2025.law-1.12.pdf