Sushmitha M
2026
Cryptix at SemEval-2026 Task 4: Zero-Shot Bi-Encoder Modeling for Narrative Story Similarity - A Sentence Transformer Approach
Sushmitha M | Sarath Kumar P | Thanalaxmi S | Beulah A
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Sushmitha M | Sarath Kumar P | Thanalaxmi S | Beulah A
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
This submission presents a zero-shot embedding-based approach for SemEval-2026 Task 4 on Narrative Story Similarity. The system employs the pretrained sentence-transformers/all-mpnet-base-v2 model within a bi-encoder architecture to generate 768-dimensional story embeddings. Narrative similarity is modeled using cosine similarity in embedding space for comparative prediction in Track A and representation generation in Track B. The approach does not involve task-specific fine-tuning and treats narrative comparison as a geometric proximity problem. Experimental results and error analysis highlight the strengths of pretrained semantic encoders in capturing thematic similarity, while revealing limitations in modeling deeper narrative structure and causal progression.