Ideology Takes Multiple Looks: A High-Quality Dataset for Multifaceted Ideology Detection
Songtao Liu, Ziling Luo, Minghua Xu, Lixiao Wei, Ziyao Wei, Han Yu, Wei Xiang, Bang Wang
Abstract
Ideology detection (ID) is important for gaining insights about peoples’ opinions and stances on our world and society, which can find many applications in politics, economics and social sciences. It is not uncommon that a piece of text can contain descriptions of various issues. It is also widely accepted that a person can take different ideological stances in different facets. However, existing datasets for the ID task only label a text as ideologically left- or right-leaning as a whole, regardless whether the text containing one or more different issues. Moreover, most prior work annotates texts from data resources with known ideological bias through distant supervision approaches, which may result in many false labels. With some theoretical help from social sciences, this work first designs an ideological schema containing five domains and twelve facets for a new multifaceted ideology detection (MID) task to provide a more complete and delicate description of ideology. We construct a MITweet dataset for the MID task, which contains 12,594 English Twitter posts, each annotated with a Relevance and an Ideology label for all twelve facets. We also design and test a few of strong baselines for the MID task under in-topic and cross-topic settings, which can serve as benchmarks for further research.- Anthology ID:
- 2023.emnlp-main.256
- Volume:
- Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- Month:
- December
- Year:
- 2023
- Address:
- Singapore
- Editors:
- Houda Bouamor, Juan Pino, Kalika Bali
- Venue:
- EMNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 4200–4213
- Language:
- URL:
- https://preview.aclanthology.org/build-pipeline-with-new-library/2023.emnlp-main.256/
- DOI:
- 10.18653/v1/2023.emnlp-main.256
- Cite (ACL):
- Songtao Liu, Ziling Luo, Minghua Xu, Lixiao Wei, Ziyao Wei, Han Yu, Wei Xiang, and Bang Wang. 2023. Ideology Takes Multiple Looks: A High-Quality Dataset for Multifaceted Ideology Detection. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 4200–4213, Singapore. Association for Computational Linguistics.
- Cite (Informal):
- Ideology Takes Multiple Looks: A High-Quality Dataset for Multifaceted Ideology Detection (Liu et al., EMNLP 2023)
- PDF:
- https://preview.aclanthology.org/build-pipeline-with-new-library/2023.emnlp-main.256.pdf