LGSA: Label Geometry Structuring and Aligning for Hierarchical Text Classification

Shuai Zhang, Weibo Xu, Jiahao Nie, Kecheng Huang


Abstract
Existing hierarchical text classification (HTC) methods typically use prompt tuning or contrastive learning to inject the label hierarchy into a model as prior knowledge to implicitly learn label embeddings for classification. However, such implicit learning fails to accurately reflect label geometry (i.e., feature spatial distribution of label embeddings), as it does not model hierarchy-aware geometric relations among labels. To address this issue, we propose a novel two-stage label geometry structuring and aligning framework, termed LGSA, which transforms the label hierarchy from an implicit prior into an explicit embedding. First, we propose a hierarchical geometric structuring (HGS) module that leverages a general orthogonal frame (GOF) to reconstruct an explicit label geometry conforming to the label hierarchy. The label geometry is then treated as a label prototype to guide model training. To facilitate the guidance, we thereby propose a hierarchical geometric aligning (HGA) module as a regularization term to align label geometry learned by the model with the explicit label prototype. Experiments on three real-world HTC datasets confirm that LGSA consistently outperforms existing state-of-the-art methods. The code and models are available at https://anonymous.4open.science/r/LGSA-1E0C.
Anthology ID:
2026.acl-long.1322
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
28654–28665
Language:
URL:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.1322/
DOI:
Bibkey:
Cite (ACL):
Shuai Zhang, Weibo Xu, Jiahao Nie, and Kecheng Huang. 2026. LGSA: Label Geometry Structuring and Aligning for Hierarchical Text Classification. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 28654–28665, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
LGSA: Label Geometry Structuring and Aligning for Hierarchical Text Classification (Zhang et al., ACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl/2026.acl-long.1322.pdf
Checklist:
 2026.acl-long.1322.checklist.pdf