Abstract
In this paper, we apply Item Response Theory, popular in education and political science research, to the analysis of argument persuasiveness in language. We empirically evaluate the model’s performance on three datasets, including a novel dataset in the area of political advocacy. We show the advantages of separating these components under several style and content representations, including evaluating the ability of the speaker embeddings generated by the model to parallel real-world observations about persuadability.- Anthology ID:
- 2022.findings-naacl.7
- Volume:
- Findings of the Association for Computational Linguistics: NAACL 2022
- Month:
- July
- Year:
- 2022
- Address:
- Seattle, United States
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 77–86
- Language:
- URL:
- https://aclanthology.org/2022.findings-naacl.7
- DOI:
- 10.18653/v1/2022.findings-naacl.7
- Cite (ACL):
- Anastassia Kornilova, Vladimir Eidelman, and Daniel Douglass. 2022. An Item Response Theory Framework for Persuasion. In Findings of the Association for Computational Linguistics: NAACL 2022, pages 77–86, Seattle, United States. Association for Computational Linguistics.
- Cite (Informal):
- An Item Response Theory Framework for Persuasion (Kornilova et al., Findings 2022)
- PDF:
- https://preview.aclanthology.org/ingestion-script-update/2022.findings-naacl.7.pdf