JCT at SemEval-2026 Task 4: A Multi-Method Approach to Narrative Story Similarity

Dvori Rosenfeld, Rinat Walles, Chaya Liebeskind


Abstract
Narrative similarity detection involves under-standing the underlying structure of a storyrather than just matching similar words orphrases. This paper details our multi-strategyapproach to the SemEval-2026 Task on Nar-rative Similarity, which requires identifyingwhich of two candidate stories most closelyresembles an anchor story based on three di-mensions: abstract themes, the sequence ofevents, and the final outcomes.We developed three distinct but complemen-tary methods to address this challenge. First,we fine-tuned a specialized story-embeddingmodel using parameter-efficient techniques onsynthetic data. Second, we utilized a "Distill-then-Embed" workflow, where a large languagemodel extracts the essential narrative core ofeach story before computing similarity. Third,we employed direct zero-shot prompting to al-low a high-reasoning model to compare thestories organically.Our analysis reveals that each approach excelsat different types of narrative comparisons, andtheir combination leads to robust performance.We demonstrate the importance of narrative dis-tillation in removing surface-level distractorsand the effectiveness of carefully engineeredprompts in guiding language models to focuson narrative structure
Anthology ID:
2026.semeval-1.387
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3089–3094
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.387/
DOI:
Bibkey:
Cite (ACL):
Dvori Rosenfeld, Rinat Walles, and Chaya Liebeskind. 2026. JCT at SemEval-2026 Task 4: A Multi-Method Approach to Narrative Story Similarity. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 3089–3094, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
JCT at SemEval-2026 Task 4: A Multi-Method Approach to Narrative Story Similarity (Rosenfeld et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.387.pdf