FORECAST2023: A Forecast and Reasoning Corpus of Argumentation Structures

Kamila Górska, John Lawrence, Chris Reed

Abstract
It is known from large-scale crowd experimentation that some people are innately better at analysing complex situations and making justified predictions – the so-called ‘superforecasters’. Surprisingly, however, there has to date been no work exploring the role played by the reasoning in those justifications. Bag-of-words analyses might tell us something, but the real value lies in understanding what features of reasoning and argumentation lead to better forecasts – both in providing an objective measure for argument quality, and even more importantly, in providing guidance on how to improve forecasting performance. The work presented here covers the creation of a unique dataset of such prediction rationales, the structure of which naturally lends itself to partially automated annotation which in turn is used as the basis for subsequent manual enhancement that provides a uniquely fine-grained and close characterisation of the structure of argumentation, with potential impact on forecasting domains from intelligence analysis to investment decision-making.
Anthology ID:
2024.lrec-main.652
Volume:
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
Venues:
LREC | COLING
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
7395–7405
Language:
URL:
https://aclanthology.org/2024.lrec-main.652
DOI:
Bibkey:
Cite (ACL):
Kamila Górska, John Lawrence, and Chris Reed. 2024. FORECAST2023: A Forecast and Reasoning Corpus of Argumentation Structures. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 7395–7405, Torino, Italia. ELRA and ICCL.
Cite (Informal):
FORECAST2023: A Forecast and Reasoning Corpus of Argumentation Structures (Górska et al., LREC-COLING 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/landing_page/2024.lrec-main.652.pdf
PDF Search