Challenge or Empower: Revisiting Argumentation Quality in a News Editorial Corpus
Roxanne El Baff, Henning Wachsmuth, Khalid Al-Khatib, Benno Stein
Abstract
News editorials are said to shape public opinion, which makes them a powerful tool and an important source of political argumentation. However, rarely do editorials change anyone’s stance on an issue completely, nor do they tend to argue explicitly (but rather follow a subtle rhetorical strategy). So, what does argumentation quality mean for editorials then? We develop the notion that an effective editorial challenges readers with opposing stance, and at the same time empowers the arguing skills of readers that share the editorial’s stance — or even challenges both sides. To study argumentation quality based on this notion, we introduce a new corpus with 1000 editorials from the New York Times, annotated for their perceived effect along with the annotators’ political orientations. Analyzing the corpus, we find that annotators with different orientation disagree on the effect significantly. While only 1% of all editorials changed anyone’s stance, more than 5% meet our notion. We conclude that our corpus serves as a suitable resource for studying the argumentation quality of news editorials.- Anthology ID:
- K18-1044
- Volume:
- Proceedings of the 22nd Conference on Computational Natural Language Learning
- Month:
- October
- Year:
- 2018
- Address:
- Brussels, Belgium
- Editors:
- Anna Korhonen, Ivan Titov
- Venue:
- CoNLL
- SIG:
- SIGNLL
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 454–464
- Language:
- URL:
- https://aclanthology.org/K18-1044
- DOI:
- 10.18653/v1/K18-1044
- Cite (ACL):
- Roxanne El Baff, Henning Wachsmuth, Khalid Al-Khatib, and Benno Stein. 2018. Challenge or Empower: Revisiting Argumentation Quality in a News Editorial Corpus. In Proceedings of the 22nd Conference on Computational Natural Language Learning, pages 454–464, Brussels, Belgium. Association for Computational Linguistics.
- Cite (Informal):
- Challenge or Empower: Revisiting Argumentation Quality in a News Editorial Corpus (El Baff et al., CoNLL 2018)
- PDF:
- https://preview.aclanthology.org/emnlp22-frontmatter/K18-1044.pdf