Feasible Annotation Scheme for Capturing Policy Argument Reasoning using Argument Templates
Paul Reisert, Naoya Inoue, Tatsuki Kuribayashi, Kentaro Inui
Abstract
Most of the existing works on argument mining cast the problem of argumentative structure identification as classification tasks (e.g. attack-support relations, stance, explicit premise/claim). This paper goes a step further by addressing the task of automatically identifying reasoning patterns of arguments using predefined templates, which is called argument template (AT) instantiation. The contributions of this work are three-fold. First, we develop a simple, yet expressive set of easily annotatable ATs that can represent a majority of writer’s reasoning for texts with diverse policy topics while maintaining the computational feasibility of the task. Second, we create a small, but highly reliable annotated corpus of instantiated ATs on top of reliably annotated support and attack relations and conduct an annotation study. Third, we formulate the task of AT instantiation as structured prediction constrained by a feasible set of templates. Our evaluation demonstrates that we can annotate ATs with a reasonably high inter-annotator agreement, and the use of template-constrained inference is useful for instantiating ATs with only partial reasoning comprehension clues.- Anthology ID:
- W18-5210
- Volume:
- Proceedings of the 5th Workshop on Argument Mining
- Month:
- November
- Year:
- 2018
- Address:
- Brussels, Belgium
- Editors:
- Noam Slonim, Ranit Aharonov
- Venue:
- ArgMining
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 79–89
- Language:
- URL:
- https://aclanthology.org/W18-5210
- DOI:
- 10.18653/v1/W18-5210
- Cite (ACL):
- Paul Reisert, Naoya Inoue, Tatsuki Kuribayashi, and Kentaro Inui. 2018. Feasible Annotation Scheme for Capturing Policy Argument Reasoning using Argument Templates. In Proceedings of the 5th Workshop on Argument Mining, pages 79–89, Brussels, Belgium. Association for Computational Linguistics.
- Cite (Informal):
- Feasible Annotation Scheme for Capturing Policy Argument Reasoning using Argument Templates (Reisert et al., ArgMining 2018)
- PDF:
- https://preview.aclanthology.org/improve-issue-templates/W18-5210.pdf
- Code
- preisert/argument-reasoning-patterns