Solving Feature Sparseness in Text Classification using Core-Periphery Decomposition

Xia Cui, Sadamori Kojaku, Naoki Masuda, Danushka Bollegala

Abstract
Feature sparseness is a problem common to cross-domain and short-text classification tasks. To overcome this feature sparseness problem, we propose a novel method based on graph decomposition to find candidate features for expanding feature vectors. Specifically, we first create a feature-relatedness graph, which is subsequently decomposed into core-periphery (CP) pairs and use the peripheries as the expansion candidates of the cores. We expand both training and test instances using the computed related features and use them to train a text classifier. We observe that prioritising features that are common to both training and test instances as cores during the CP decomposition to further improve the accuracy of text classification. We evaluate the proposed CP-decomposition-based feature expansion method on benchmark datasets for cross-domain sentiment classification and short-text classification. Our experimental results show that the proposed method consistently outperforms all baselines on short-text classification tasks, and perform competitively with pivot-based cross-domain sentiment classification methods.
Anthology ID:
S18-2030
Volume:
Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics
Month:
June
Year:
2018
Address:
New Orleans, Louisiana
Editors:
Malvina Nissim, Jonathan Berant, Alessandro Lenci
Venue:
*SEM
SIGs:
SIGLEX | SIGSEM
Publisher:
Association for Computational Linguistics
Note:
Pages:
255–264
Language:
URL:
https://aclanthology.org/S18-2030
DOI:
10.18653/v1/S18-2030
Bibkey:
Cite (ACL):
Xia Cui, Sadamori Kojaku, Naoki Masuda, and Danushka Bollegala. 2018. Solving Feature Sparseness in Text Classification using Core-Periphery Decomposition. In Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics, pages 255–264, New Orleans, Louisiana. Association for Computational Linguistics.
Cite (Informal):
Solving Feature Sparseness in Text Classification using Core-Periphery Decomposition (Cui et al., *SEM 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/add_acl24_videos/S18-2030.pdf
PDF Search