ConTexT at SemEval-2026 Task 5: Rating Plausibility of Word Senses in Ambiguous Stories through Narrative Understanding

Fakeha Faisal, Rubab Shah, Syeda Zaidi, Azkaa Nasir, Sandesh Kumar, Abdul Samad


Abstract
In this paper, we report our system for SemEval-2026 Task 5, which predicts graded plausibility scores for target word senses in narrative context. We explore embedding-based similarity, transformer fine tuning, and a three-stage curriculum combining WiC pretraining, Wasserstein distribution learning, and KL-based calibration. Our best model, DeBERTa-XLarge with curriculum training, achieves 78% accu-racy within one standard deviation and a Spear-man correlation of 0.70, with an overall test score of 0.74. Results show that distribution modeling better aligns with human plausibility judgments than single-score prediction
Anthology ID:
2026.semeval-1.232
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1840–1845
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.232/
DOI:
Bibkey:
Cite (ACL):
Fakeha Faisal, Rubab Shah, Syeda Zaidi, Azkaa Nasir, Sandesh Kumar, and Abdul Samad. 2026. ConTexT at SemEval-2026 Task 5: Rating Plausibility of Word Senses in Ambiguous Stories through Narrative Understanding. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 1840–1845, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
ConTexT at SemEval-2026 Task 5: Rating Plausibility of Word Senses in Ambiguous Stories through Narrative Understanding (Faisal et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.232.pdf
Supplementarymaterial:
 2026.semeval-1.232.SupplementaryMaterial.zip