Understanding Disagreement: An Annotation Study of Sentiment and Emotional Language in Environmental Communication

Christina Barz, Melanie Siegel, Daniel Hanss, Michael Wiegand


Abstract
Emotional language is central to how environmental issues are communicated and received by the public. To better understand how such language is interpreted, we conducted an annotation study on sentiment and emotional language in texts from the environmental activist group Extinction Rebellion. The annotation process revealed substantial disagreement among annotators, highlighting the complexity and subjectivity involved in interpreting emotional language. In this paper, we analyze the sources of these disagreements, offering insights into how individual perspectives shape annotation outcomes. Our work contributes to ongoing discussions on perspectivism in NLP and emphasizes the importance of human-centered approaches and citizen science in analyzing environmental communication.
Anthology ID:
2025.law-1.1
Volume:
Proceedings of the 19th Linguistic Annotation Workshop (LAW-XIX-2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Siyao Peng, Ines Rehbein
Venues:
LAW | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–20
Language:
URL:
https://preview.aclanthology.org/landing_page/2025.law-1.1/
DOI:
10.18653/v1/2025.law-1.1
Bibkey:
Cite (ACL):
Christina Barz, Melanie Siegel, Daniel Hanss, and Michael Wiegand. 2025. Understanding Disagreement: An Annotation Study of Sentiment and Emotional Language in Environmental Communication. In Proceedings of the 19th Linguistic Annotation Workshop (LAW-XIX-2025), pages 1–20, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Understanding Disagreement: An Annotation Study of Sentiment and Emotional Language in Environmental Communication (Barz et al., LAW 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/landing_page/2025.law-1.1.pdf
Dataset:
 2025.law-1.1.dataset.zip