Annotating argumentation in Swedish social media

Anna Lindahl


Abstract
This paper presents a small study of annotating argumentation in Swedish social media. Annotators were asked to annotate spans of argumentation in 9 threads from two discussion forums. At the post level, Cohen’s k and Krippendorff’s alpha 0.48 was achieved. When manually inspecting the annotations the annotators seemed to agree when conditions in the guidelines were explicitly met, but implicit argumentation and opinions, resulting in annotators having to interpret what’s missing in the text, caused disagreements.
Anthology ID:
2020.argmining-1.11
Volume:
Proceedings of the 7th Workshop on Argument Mining
Month:
December
Year:
2020
Address:
Online
Editors:
Elena Cabrio, Serena Villata
Venue:
ArgMining
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
100–105
Language:
URL:
https://aclanthology.org/2020.argmining-1.11
DOI:
Bibkey:
Cite (ACL):
Anna Lindahl. 2020. Annotating argumentation in Swedish social media. In Proceedings of the 7th Workshop on Argument Mining, pages 100–105, Online. Association for Computational Linguistics.
Cite (Informal):
Annotating argumentation in Swedish social media (Lindahl, ArgMining 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-4/2020.argmining-1.11.pdf