CiNet-Handai-Kyodai at SemEval-2026 Task 5: Combining LLM Prompting, Semantic Similarity, and Synthetic Gaze for Graded Sense Plausibility

Lis Kanashiro Pereira, Fei Cheng


Abstract
We present a hybrid system for SemEval-2026 Task 5 on graded word-sense plausibility in narrative contexts. Our approach combines prompt-based large language model (LLM) scoring with three complementary features: semantic embedding similarity, story-conditioned definition generation, and a synthetic gaze signal based on predicted fixation time. We combine these signals using an ordinary least squares regressor. On the official test set, our best system achieves 90.10 Acc±SD and 79.19 Spearman correlation. The system surpasses the reported human reference score on Acc±SD, highlighting the value of combining LLM-based judgments with targeted linguistic and cognitive-inspired features.
Anthology ID:
2026.semeval-1.245
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1950–1956
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.245/
DOI:
Bibkey:
Cite (ACL):
Lis Kanashiro Pereira and Fei Cheng. 2026. CiNet-Handai-Kyodai at SemEval-2026 Task 5: Combining LLM Prompting, Semantic Similarity, and Synthetic Gaze for Graded Sense Plausibility. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 1950–1956, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
CiNet-Handai-Kyodai at SemEval-2026 Task 5: Combining LLM Prompting, Semantic Similarity, and Synthetic Gaze for Graded Sense Plausibility (Kanashiro Pereira & Cheng, SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.semeval-1.245.pdf