GuysLLM at SemEval-2026 Task 5: NLI-Informed Regression for Graded Word-Sense Plausibility in Narrative Contexts
Niccoló Antonelli-Dziri, Sixtine Marcotte, Emanuele Rosapepe, Gabriele Santona, Omar Wafaay, Lorenzo Vaiani, Riccardo Coppola, Flavio Giobergia
Abstract
While large language models (LLMs) excel at semantic reasoning, their discrete token-based outputs introduce limitations for fine-grained regression tasks requiring continuous scoring. We address graded word-sense plausibility estimation by reformulating it as a Natural Language Inference (NLI) regression problem, adapting DeBERTa-v3-large with NLI pretraining and a regression head to predict continuous plausibility scores from story-sense pairs. We compare this model against BERT, vanilla DeBERTa, SmolLM variants and state-of-the art LLMs under various prompting strategies, and show that the NLI-finetuned model achieves superior rank correlation and alignment with human judgments. While several baselines collapse toward mean predictions and LLMs show unstable prompting sensitivity, our findings establish NLI-informed pretraining as highly effective for narrative plausibility regression, highlighting fundamental LLM limitations for word sense disambiguation.- Anthology ID:
- 2026.semeval-1.314
- Volume:
- Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, USA
- Editors:
- Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
- Venues:
- SemEval | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 2487–2494
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.314/
- DOI:
- Cite (ACL):
- Niccoló Antonelli-Dziri, Sixtine Marcotte, Emanuele Rosapepe, Gabriele Santona, Omar Wafaay, Lorenzo Vaiani, Riccardo Coppola, and Flavio Giobergia. 2026. GuysLLM at SemEval-2026 Task 5: NLI-Informed Regression for Graded Word-Sense Plausibility in Narrative Contexts. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2487–2494, San Diego, California, USA. Association for Computational Linguistics.
- Cite (Informal):
- GuysLLM at SemEval-2026 Task 5: NLI-Informed Regression for Graded Word-Sense Plausibility in Narrative Contexts (Antonelli-Dziri et al., SemEval 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.314.pdf