GuysLLM at SemEval-2026 Task 5: NLI-Informed Regression for Graded Word-Sense Plausibility in Narrative Contexts

Niccoló Antonelli-Dziri, Sixtine Marcotte, Emanuele Rosapepe, Gabriele Santona, Omar Wafaay, Lorenzo Vaiani, Riccardo Coppola, Flavio Giobergia


Abstract
While large language models (LLMs) excel at semantic reasoning, their discrete token-based outputs introduce limitations for fine-grained regression tasks requiring continuous scoring. We address graded word-sense plausibility estimation by reformulating it as a Natural Language Inference (NLI) regression problem, adapting DeBERTa-v3-large with NLI pretraining and a regression head to predict continuous plausibility scores from story-sense pairs. We compare this model against BERT, vanilla DeBERTa, SmolLM variants and state-of-the art LLMs under various prompting strategies, and show that the NLI-finetuned model achieves superior rank correlation and alignment with human judgments. While several baselines collapse toward mean predictions and LLMs show unstable prompting sensitivity, our findings establish NLI-informed pretraining as highly effective for narrative plausibility regression, highlighting fundamental LLM limitations for word sense disambiguation.
Anthology ID:
2026.semeval-1.314
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2487–2494
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.314/
DOI:
Bibkey:
Cite (ACL):
Niccoló Antonelli-Dziri, Sixtine Marcotte, Emanuele Rosapepe, Gabriele Santona, Omar Wafaay, Lorenzo Vaiani, Riccardo Coppola, and Flavio Giobergia. 2026. GuysLLM at SemEval-2026 Task 5: NLI-Informed Regression for Graded Word-Sense Plausibility in Narrative Contexts. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2487–2494, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
GuysLLM at SemEval-2026 Task 5: NLI-Informed Regression for Graded Word-Sense Plausibility in Narrative Contexts (Antonelli-Dziri et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.314.pdf