SCDTour: Embedding Axis Ordering and Merging for Interpretable Semantic Change Detection

Taichi Aida, Danushka Bollegala


Abstract
In Semantic Change Detection (SCD), it is a common problem to obtain embeddings that are both interpretable and high-performing. However, improving interpretability often leads to a loss in the SCD performance, and vice versa. To address this problem, we propose SCDTour, a method that orders and merges interpretable axes to alleviate the performance degradation of SCD. SCDTour considers both (a) semantic similarity between axes in the embedding space, as well as (b) the degree to which each axis contributes to semantic change. Experimental results show that SCDTour preserves performance in semantic change detection while maintaining high interpretability. Moreover, agglomerating the sorted axes produces a more refined set of word senses, which achieves comparable or improved performance against the original full-dimensional embeddings in the SCD task. These findings demonstrate that SCDTour effectively balances interpretability and SCD performance, enabling meaningful interpretation of semantic shifts through a small number of refined axes.
Anthology ID:
2025.findings-emnlp.797
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
14775–14785
Language:
URL:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.797/
DOI:
10.18653/v1/2025.findings-emnlp.797
Bibkey:
Cite (ACL):
Taichi Aida and Danushka Bollegala. 2025. SCDTour: Embedding Axis Ordering and Merging for Interpretable Semantic Change Detection. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 14775–14785, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
SCDTour: Embedding Axis Ordering and Merging for Interpretable Semantic Change Detection (Aida & Bollegala, Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.797.pdf
Checklist:
 2025.findings-emnlp.797.checklist.pdf