silp_nlp at SemEval-2025 Task 5: Subject Recommendation With Sentence Transformer

Sumit Singh, Pankaj Goyal, Uma Tiwary


Abstract
This work explored subject recommendation using sentence transformers within the SemEval-2025 Task 5 (LLMs4Subjects) challenge. Our approach leveraged embedding-based cosine similarity and hierarchical clustering to predict relevant GND subjects for TIB technical records in English and German. By experimenting with different models, including JinaAi, Distiluse-base-multilingual, and TF-IDF, we found that the JinaAi sentence transformer consistently outperformed other methods in terms of precision, recall, and F1-score.Our results highlight the effectiveness of transformer-based embeddings in semantic similarity tasks for subject classification. Additionally, hierarchical clustering helped reduce computational complexity by narrowing down candidate subjects efficiently. Despite the improvements, future work can focus on fine-tuning domain-specific embeddings, exploring knowledge graph integration, and enhancing multilingual capabilities for better generalization.
Anthology ID:
2025.semeval-1.320
Volume:
Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Sara Rosenthal, Aiala Rosá, Debanjan Ghosh, Marcos Zampieri
Venues:
SemEval | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2455–2460
Language:
URL:
https://preview.aclanthology.org/transition-to-people-yaml/2025.semeval-1.320/
DOI:
Bibkey:
Cite (ACL):
Sumit Singh, Pankaj Goyal, and Uma Tiwary. 2025. silp_nlp at SemEval-2025 Task 5: Subject Recommendation With Sentence Transformer. In Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), pages 2455–2460, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
silp_nlp at SemEval-2025 Task 5: Subject Recommendation With Sentence Transformer (Singh et al., SemEval 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/transition-to-people-yaml/2025.semeval-1.320.pdf