Team Macaroni at SemEval-2026 Task 10: PsyCoMark: Psycholinguistic Conspiracy Marker Extraction and Detection

Rofaida Rabehi, Nicolai Plenk, Miriam Han


Abstract
This paper describes our submission to SemEval-2026 Task 10: PsyCoMark, which addresses span-level identification of psycholinguistic conspiracy markers and document-level conspiracy classification. For Subtask 1, we fine-tune several pretrained transformer encoders and analyse their behaviour under different training configurations. For Subtask 2, we develop a hybrid system that combines ModernBERT-large with surface-level linguistic features.Our results show that straightforward fine-tuning of strong pretrained models is more effective than more complex pipelines and that additional handcrafted features do not yield consistent improvements. On the official test set, we rank 18th in Subtask 1 (overlap-based macro F1 = 0.16) and 20th in Subtask 2 (macro F1 = 0.76).
Anthology ID:
2026.semeval-1.50
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
338–342
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.50/
DOI:
Bibkey:
Cite (ACL):
Rofaida Rabehi, Nicolai Plenk, and Miriam Han. 2026. Team Macaroni at SemEval-2026 Task 10: PsyCoMark: Psycholinguistic Conspiracy Marker Extraction and Detection. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 338–342, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Team Macaroni at SemEval-2026 Task 10: PsyCoMark: Psycholinguistic Conspiracy Marker Extraction and Detection (Rabehi et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.50.pdf
Supplementarymaterial:
 2026.semeval-1.50.SupplementaryMaterial.zip