JCT 2026 - SemEval Task 5

Chava Laufer, Batel Turjeman, Chaya Liebeskind


Abstract
The system integrates a generative Large Language Model (Llama-3 8B, fine-tuned via LoRA) with a dual-expert bidirectional cross-encoder (DeBERTa-v3-large) optimized for both semantic similarity and Natural Language Inference (NLI). By aggregating these complementary models, the system effectively captures complex contextual dependencies. In the official test set, our architecture ranked 22nd out of 79 systems, achieving a Spearman Rank Correlation of 0.71 and an accuracy within the standard deviation of 82.04%.
Anthology ID:
2026.semeval-1.115
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
826–831
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.115/
DOI:
Bibkey:
Cite (ACL):
Chava Laufer, Batel Turjeman, and Chaya Liebeskind. 2026. JCT 2026 - SemEval Task 5. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 826–831, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
JCT 2026 - SemEval Task 5 (Laufer et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.115.pdf