HU at SemEval-2026 Task 10: Psycholinguistic Conspiracy Marker Extraction and Detection
Muhammad Quddussi Kashaf, Shahmir Mustafa Chaudhry, Marium Zeeshan, Nahyan Javed, Sandesh Kumar, Abdul Samad
Abstract
Modern media poses a complex challenge to verifying the credibility of information and public discourse due to the advent of conspiracy theory content. This paper presents our methodology in "SemEval-2026 Task 10: Psycholinguistic Conspiracy Marker Extraction and Detection". It consists of two subtasks: extracting psycholinguistic markers from text using Named Entity Recognition (NER) techniques, and classifying Reddit comments as conspiratorial or non-conspiratorial. Our approach involved: (1) diverse extraction methodologies, including traditional bio tagging schemes, the GlobalPointer framework, and the GLiNER2 architecture, (2) data augmentation and synthetic data generation via Large Language Models (LLMs), and (3) evaluating various transformer-based models, such as DistilBERT and Covid Twitter-BERT. Our final system achieves a macro F1 score of 0.26 on Subtask 1 and 0.76 on Subtask 2.- Anthology ID:
- 2026.semeval-1.215
- Volume:
- Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, USA
- Editors:
- Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
- Venues:
- SemEval | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1672–1677
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.215/
- DOI:
- Cite (ACL):
- Muhammad Quddussi Kashaf, Shahmir Mustafa Chaudhry, Marium Zeeshan, Nahyan Javed, Sandesh Kumar, and Abdul Samad. 2026. HU at SemEval-2026 Task 10: Psycholinguistic Conspiracy Marker Extraction and Detection. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 1672–1677, San Diego, California, USA. Association for Computational Linguistics.
- Cite (Informal):
- HU at SemEval-2026 Task 10: Psycholinguistic Conspiracy Marker Extraction and Detection (Kashaf et al., SemEval 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.215.pdf