Rating Plausibility of Word Senses in Ambiguous Sentences Using Multi-Architecture Analysis

Naina Jain, Nidhi Arora, Pal Thakkar, Siba Sahu


Abstract
Word sense disambiguation in narrative contexts requires systems to reason about subtle semantic relationships between candidate senses and discourse context. This paper addresses SemEval 2026 Task 5, which reformulates WSD as a graded plausibility prediction problem on a 1–5 Likert scale using the AmbiStory dataset. We present two complementary approaches: (1) a DeBERTa-v3-Large encoder with attention-weighted pooling and ordinal regression, achieving a Spearman correlation of 0.718, and (2) a rank-based ensemble combining FLAN-T5 and RoBERTa, achieving 0.692. Through ablation studies, we show that explicitly modeling ordinal structure improves performance over standard regression by 17.3%. We further analyze the strengths of each approach, showing that fine-tuned encoders capture fine-grained semantic relationships, while ensemble methods provide robustness through complementary modeling biases. Our results provide a detailed empirical analysis of design choices for graded plausibility prediction in narrative understanding.
Anthology ID:
2026.semeval-1.292
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2307–2313
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.292/
DOI:
Bibkey:
Cite (ACL):
Naina Jain, Nidhi Arora, Pal Thakkar, and Siba Sahu. 2026. Rating Plausibility of Word Senses in Ambiguous Sentences Using Multi-Architecture Analysis. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2307–2313, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Rating Plausibility of Word Senses in Ambiguous Sentences Using Multi-Architecture Analysis (Jain et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.292.pdf
Supplementarymaterial:
 2026.semeval-1.292.SupplementaryMaterial.zip