Electoral Agitation Dataset: The Use Case of the Polish Election

Mateusz Baran, Mateusz Wójcik, Piotr Kolebski, Michał Bernaczyk, Krzysztof Rajda, Lukasz Augustyniak, Tomasz Kajdanowicz

Abstract
The popularity of social media makes politicians use it for political advertisement. Therefore, social media is full of electoral agitation (electioneering), especially during the election campaigns. The election administration cannot track the spread and quantity of messages that count as agitation under the election code. It addresses a crucial problem, while also uncovering a niche that has not been effectively targeted so far. Hence, we present the first publicly open data set for detecting electoral agitation in the Polish language. It contains 6,112 human-annotated tweets tagged with four legally conditioned categories. We achieved a 0.66 inter-annotator agreement (Cohen’s kappa score). An additional annotator resolved the mismatches between the first two improving the consistency and complexity of the annotation process. The newly created data set was used to fine-tune a Polish Language Model called HerBERT (achieving a 68% F1 score). We also present a number of potential use cases for such data sets and models, enriching the paper with an analysis of the Polish 2020 Presidential Election on Twitter.
Anthology ID:
2022.politicalnlp-1.5
Volume:
Proceedings of the LREC 2022 workshop on Natural Language Processing for Political Sciences
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Haithem Afli, Mehwish Alam, Houda Bouamor, Cristina Blasi Casagran, Colleen Boland, Sahar Ghannay
Venue:
PoliticalNLP
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
32–36
Language:
URL:
https://aclanthology.org/2022.politicalnlp-1.5
DOI:
Bibkey:
Cite (ACL):
Mateusz Baran, Mateusz Wójcik, Piotr Kolebski, Michał Bernaczyk, Krzysztof Rajda, Lukasz Augustyniak, and Tomasz Kajdanowicz. 2022. Electoral Agitation Dataset: The Use Case of the Polish Election. In Proceedings of the LREC 2022 workshop on Natural Language Processing for Political Sciences, pages 32–36, Marseille, France. European Language Resources Association.
Cite (Informal):
Electoral Agitation Dataset: The Use Case of the Polish Election (Baran et al., PoliticalNLP 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/improve-issue-templates/2022.politicalnlp-1.5.pdf
PDF Search