Team HITS at SemEval-2026 Task 4:Enhancing narrative text embedding model training with hard negatives generation and self-distillation

Qian Zhou, Yi Fan, Wei Liu, Michael Strube


Abstract
Narrative text embedding is the basis for machines to understand and represent stories. However, it is challenging because it depends on similarities in theme, course of action, and outcomes. To target this challenge, we present a task-aligned system for SemEval-2026 Task 4 Track B. We first use Qwen2.5-32B-Instruct model to generate hard negatives from three narrative dimensions. We then train a Qwen3-Embedding-8B model with a multi-negative contrastive objective and use a teacher model that has the same architecture as the training model. The model achieves the best result in the current training phase by introducing "soft label" via KL Divergence.
Anthology ID:
2026.semeval-1.338
Volume:
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Month:
July
Year:
2026
Address:
San Diego, California, USA
Editors:
Ekaterina Kochmar, Debanjan Ghosh, Kai North, Mamoru Komachi
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2679–2688
Language:
URL:
https://preview.aclanthology.org/acl-awards/2026.semeval-1.338/
DOI:
10.18653/v1/2026.semeval-1.338
Bibkey:
Cite (ACL):
Qian Zhou, Yi Fan, Wei Liu, and Michael Strube. 2026. Team HITS at SemEval-2026 Task 4:Enhancing narrative text embedding model training with hard negatives generation and self-distillation. In Proceedings of the 20th International Workshop on Semantic Evaluation (2026), pages 2679–2688, San Diego, California, USA. Association for Computational Linguistics.
Cite (Informal):
Team HITS at SemEval-2026 Task 4:Enhancing narrative text embedding model training with hard negatives generation and self-distillation (Zhou et al., SemEval 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/acl-awards/2026.semeval-1.338.pdf