YNU-HPCC at SemEval-2026 Task 11: Mitigating Content Effects in Syllogistic Reasoning with Qwen2-1.5B-Instruct and XLM-RoBERTa-Large for English and Multilingual TasksMultilingual Tasks

Rongchuan Luo, Jin Wang, Xuejie Zhang


Abstract
This paper addresses SemEval-2026 Task 11, which focused on mitigating content effects in syllogistic reasoning. Logical validity is often conflated with semantic plausibility in large language models.Prior methods rely on standard fine-tuning or prompting, without explicit bias control.A rule- and template-based symbolic data augmentation framework is proposed for fine-tuning the \texttt{Qwen2-1.5B-Instruct} model and instruction-tuning the \texttt{XLM-RoBERTa-large} model. Logic-preserving synthetic data are generated through lexical rules. The system is ranked 1st in Task 1 with a perfect overall score of 100, and 6th in Task 3 with a score of 56.97. Code is publicly available at: \url{https://github.com/YNU-HPCC/semeval-2026-task11}.
Anthology ID:
2026.semeval-1.40
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
277–283
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.40/
DOI:
Bibkey:
Cite (ACL):
Rongchuan Luo, Jin Wang, and Xuejie Zhang. 2026. YNU-HPCC at SemEval-2026 Task 11: Mitigating Content Effects in Syllogistic Reasoning with Qwen2-1.5B-Instruct and XLM-RoBERTa-Large for English and Multilingual TasksMultilingual Tasks. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 277–283, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
YNU-HPCC at SemEval-2026 Task 11: Mitigating Content Effects in Syllogistic Reasoning with Qwen2-1.5B-Instruct and XLM-RoBERTa-Large for English and Multilingual TasksMultilingual Tasks (Luo et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.40.pdf
Supplementarymaterial:
 2026.semeval-1.40.SupplementaryMaterial.zip