Data Augmentation for Improving the Prediction of Validity and Novelty of Argumentative Conclusions
Philipp Heinisch, Moritz Plenz, Juri Opitz, Anette Frank, Philipp Cimiano
Abstract
We address the problem of automatically predicting the quality of a conclusion given a set of (textual) premises of an argument, focusing in particular on the task of predicting the validity and novelty of the argumentative conclusion. We propose a multi-task approach that jointly predicts the validity and novelty of the textual conclusion, relying on pre-trained language models fine-tuned on the task. As training data for this task is scarce and costly to obtain, we experimentally investigate the impact of data augmentation approaches for improving the accuracy of prediction compared to a baseline that relies on task-specific data only. We consider the generation of synthetic data as well as the integration of datasets from related argument tasks. We show that especially our synthetic data, combined with class-balancing and instance-specific learning rates, substantially improves classification results (+15.1 points in F1-score). Using only training data retrieved from related datasets by automatically labeling them for validity and novelty, combined with synthetic data, outperforms the baseline by 11.5 points in F1-score.- Anthology ID:
- 2022.argmining-1.2
- Volume:
- Proceedings of the 9th Workshop on Argument Mining
- Month:
- October
- Year:
- 2022
- Address:
- Online and in Gyeongju, Republic of Korea
- Editors:
- Gabriella Lapesa, Jodi Schneider, Yohan Jo, Sougata Saha
- Venue:
- ArgMining
- SIG:
- Publisher:
- International Conference on Computational Linguistics
- Note:
- Pages:
- 19–33
- Language:
- URL:
- https://aclanthology.org/2022.argmining-1.2
- DOI:
- Cite (ACL):
- Philipp Heinisch, Moritz Plenz, Juri Opitz, Anette Frank, and Philipp Cimiano. 2022. Data Augmentation for Improving the Prediction of Validity and Novelty of Argumentative Conclusions. In Proceedings of the 9th Workshop on Argument Mining, pages 19–33, Online and in Gyeongju, Republic of Korea. International Conference on Computational Linguistics.
- Cite (Informal):
- Data Augmentation for Improving the Prediction of Validity and Novelty of Argumentative Conclusions (Heinisch et al., ArgMining 2022)
- PDF:
- https://preview.aclanthology.org/proper-vol2-ingestion/2022.argmining-1.2.pdf