IMHO Fine-Tuning Improves Claim Detection

Tuhin Chakrabarty, Christopher Hidey, Kathy McKeown


Abstract
Claims are the central component of an argument. Detecting claims across different domains or data sets can often be challenging due to their varying conceptualization. We propose to alleviate this problem by fine-tuning a language model using a Reddit corpus of 5.5 million opinionated claims. These claims are self-labeled by their authors using the internet acronyms IMO/IMHO (in my (humble) opinion). Empirical results show that using this approach improves the state of art performance across four benchmark argumentation data sets by an average of 4 absolute F1 points in claim detection. As these data sets include diverse domains such as social media and student essays this improvement demonstrates the robustness of fine-tuning on this novel corpus.
Anthology ID:
N19-1054
Volume:
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)
Month:
June
Year:
2019
Address:
Minneapolis, Minnesota
Editors:
Jill Burstein, Christy Doran, Thamar Solorio
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
558–563
Language:
URL:
https://aclanthology.org/N19-1054
DOI:
10.18653/v1/N19-1054
Bibkey:
Cite (ACL):
Tuhin Chakrabarty, Christopher Hidey, and Kathy McKeown. 2019. IMHO Fine-Tuning Improves Claim Detection. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 558–563, Minneapolis, Minnesota. Association for Computational Linguistics.
Cite (Informal):
IMHO Fine-Tuning Improves Claim Detection (Chakrabarty et al., NAACL 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/naacl-24-ws-corrections/N19-1054.pdf
Presentation:
 N19-1054.Presentation.pdf
Video:
 https://preview.aclanthology.org/naacl-24-ws-corrections/N19-1054.mp4
Code
 tuhinch/imho-naacl2019