HU at SemEval-2026 Task 10: Psycholinguistic Conspiracy Marker Extraction and Detection

Muhammad Quddussi Kashaf, Shahmir Mustafa Chaudhry, Marium Zeeshan, Nahyan Javed, Sandesh Kumar, Abdul Samad


Abstract
Modern media poses a complex challenge to verifying the credibility of information and public discourse due to the advent of conspiracy theory content. This paper presents our methodology in "SemEval-2026 Task 10: Psycholinguistic Conspiracy Marker Extraction and Detection". It consists of two subtasks: extracting psycholinguistic markers from text using Named Entity Recognition (NER) techniques, and classifying Reddit comments as conspiratorial or non-conspiratorial. Our approach involved: (1) diverse extraction methodologies, including traditional bio tagging schemes, the GlobalPointer framework, and the GLiNER2 architecture, (2) data augmentation and synthetic data generation via Large Language Models (LLMs), and (3) evaluating various transformer-based models, such as DistilBERT and Covid Twitter-BERT. Our final system achieves a macro F1 score of 0.26 on Subtask 1 and 0.76 on Subtask 2.
Anthology ID:
2026.semeval-1.215
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1672–1677
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.215/
DOI:
Bibkey:
Cite (ACL):
Muhammad Quddussi Kashaf, Shahmir Mustafa Chaudhry, Marium Zeeshan, Nahyan Javed, Sandesh Kumar, and Abdul Samad. 2026. HU at SemEval-2026 Task 10: Psycholinguistic Conspiracy Marker Extraction and Detection. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 1672–1677, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
HU at SemEval-2026 Task 10: Psycholinguistic Conspiracy Marker Extraction and Detection (Kashaf et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.215.pdf
Supplementarymaterial:
 2026.semeval-1.215.SupplementaryMaterial.zip