Discovering and Articulating Frames of Communication from Social Media Using Chain-of-Thought Reasoning

Maxwell Weinzierl, Sanda Harabagiu


Abstract
Frames of Communication (FoCs) are ubiquitous in social media discourse. They define what counts as a problem, diagnose what is causing the problem, elicit moral judgments and imply remedies for resolving the problem. Most research on automatic frame detection involved the recognition of the problems addressed by frames, but did not consider the articulation of frames. Articulating an FoC involves reasoning with salient problems, their cause and eventual solution. In this paper we present a method for Discovering and Articulating FoCs (DA-FoC) that relies on a combination of Chain-of-Thought prompting of large language models (LLMs) with In-Context Active Curriculum Learning. Very promising evaluation results indicate that 86.72% of the FoCs encoded by communication experts on the same reference dataset were also uncovered by DA-FoC. Moreover, DA-FoC uncovered many new FoCs, which escaped the experts. Interestingly, 55.1% of the known FoCs were judged as being better articulated than the human-written ones, while 93.8% of the new FoCs were judged as having sound rationale and being clearly articulated.
Anthology ID:
2024.eacl-long.97
Volume:
Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
March
Year:
2024
Address:
St. Julian’s, Malta
Editors:
Yvette Graham, Matthew Purver
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1617–1631
Language:
URL:
https://aclanthology.org/2024.eacl-long.97
DOI:
Bibkey:
Cite (ACL):
Maxwell Weinzierl and Sanda Harabagiu. 2024. Discovering and Articulating Frames of Communication from Social Media Using Chain-of-Thought Reasoning. In Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1617–1631, St. Julian’s, Malta. Association for Computational Linguistics.
Cite (Informal):
Discovering and Articulating Frames of Communication from Social Media Using Chain-of-Thought Reasoning (Weinzierl & Harabagiu, EACL 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-2/2024.eacl-long.97.pdf
Video:
 https://preview.aclanthology.org/nschneid-patch-2/2024.eacl-long.97.mp4