JIA at SemEval-2026 Task 10: A Dual-Track System with BERT-based Encoders and LLMs for Conspiracy Analysis

Jiayue Zhu


Abstract
This paper presents a dual-track system for conspiracy theory detection and psycholinguistic marker extraction. We evaluate multiple architectures, including DistilBERT, BERT-Base, DeBERTa-V3, RoBERTa, and instruction-tuned Qwen2.5 models. Qwen2.5-14B (full-shot) achieves the best performance with a Weighted F1-score of 0.80 in the detection task. Marker extraction remains challenging: while the fine-tuned LLM performs best on "Actors," its limited generalization in categories such as "Evidence" and "Effect" highlights persistent semantic ambiguity.
Anthology ID:
2026.semeval-1.174
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1332–1339
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.174/
DOI:
Bibkey:
Cite (ACL):
Jiayue Zhu. 2026. JIA at SemEval-2026 Task 10: A Dual-Track System with BERT-based Encoders and LLMs for Conspiracy Analysis. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 1332–1339, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
JIA at SemEval-2026 Task 10: A Dual-Track System with BERT-based Encoders and LLMs for Conspiracy Analysis (Zhu, SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.174.pdf