CUET320 at SemEval-2026 Task 10: Few-Shot Large Language Models for Psycholinguistic Marker Extraction and Conspiracy Detection

Faozia Fariha, Lamia Khan, Madiha Ahmed Chowdhury, Kawsar Ahmed, Mohammed Moshiul Hoque


Abstract
Conspiracy theories widely spread on social media and can harm society by increasing mistrust, vaccine hesitancy, and political radicalization. However, most automated detection systems have traditionally relied on topic-specific classifiers, which often struggle to generalize across domains and provide little explanation for why a text is considered conspiratorial. To address these limitations, this paper explores various LLMs on the SemEval-2026 Task 10: psycholinguistic conspiracy marker extraction and binary conspiracy detection from Reddit submission statements. Specifically, we adopt a training-free few-shot prompting approach using different instruction-tuned large language models under a variety of few-shot settings (k in {0,1,5,10,15, 20}). Within this framework, the proposed prompting strategy incorporates psychology-informed instructions to guide the models in identifying conspiracy-related signals. As a result, the presented system achieves an F1 score of 0.21 for marker extraction and 0.81 for conspiracy detection, ranking 16th out of 30 teams in Subtask~1 and 36th out of 52 in Subtask~2 without any task-specific fine-tuning. These results suggest that psycholinguistically grounded prompting can support interpretable conspiracy analysis; however, challenges remain in identifying implicit markers.
Anthology ID:
2026.semeval-1.432
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3495–3507
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.432/
DOI:
Bibkey:
Cite (ACL):
Faozia Fariha, Lamia Khan, Madiha Ahmed Chowdhury, Kawsar Ahmed, and Mohammed Moshiul Hoque. 2026. CUET320 at SemEval-2026 Task 10: Few-Shot Large Language Models for Psycholinguistic Marker Extraction and Conspiracy Detection. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 3495–3507, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
CUET320 at SemEval-2026 Task 10: Few-Shot Large Language Models for Psycholinguistic Marker Extraction and Conspiracy Detection (Fariha et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.432.pdf