Hierarchical Level-Wise News Article Clustering via Multilingual Matryoshka Embeddings

Hans William Alexander Hanley, Zakir Durumeric


Abstract
Contextual large language model embeddings are increasingly utilized for topic modeling and clustering. However, current methods often scale poorly, rely on opaque similarity metrics, and struggle in multilingual settings. In this work, we present a novel, scalable, interpretable, hierarchical, and multilingual approach to clustering news articles and social media data. To do this, we first train multilingual Matryoshka embeddings that can determine story similarity at varying levels of granularity based on which subset of the dimensions of the embeddings is examined. This embedding model achieves state-of-the-art performance on the SemEval 2022 Task 8 test dataset (Pearson 𝜌 = 0.816). Once trained, we develop an efficient hierarchical clustering algorithm that leverages the hierarchical nature of Matryoshka embeddings to identify unique news stories, narratives, and themes. We conclude by illustrating how our approach can identify and cluster stories, narratives, and overarching themes within real-world news datasets.
Anthology ID:
2025.acl-long.124
Volume:
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Wanxiang Che, Joyce Nabende, Ekaterina Shutova, Mohammad Taher Pilehvar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2476–2492
Language:
URL:
https://preview.aclanthology.org/ingestion-acl-25/2025.acl-long.124/
DOI:
Bibkey:
Cite (ACL):
Hans William Alexander Hanley and Zakir Durumeric. 2025. Hierarchical Level-Wise News Article Clustering via Multilingual Matryoshka Embeddings. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2476–2492, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Hierarchical Level-Wise News Article Clustering via Multilingual Matryoshka Embeddings (Hanley & Durumeric, ACL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-acl-25/2025.acl-long.124.pdf