Abstract
Graph-based text representation focuses on how text documents are represented as graphs for exploiting dependency information between tokens and documents within a corpus. Despite the increasing interest in graph representation learning, there is limited research in exploring new ways for graph-based text representation, which is important in downstream natural language processing tasks. In this paper, we first propose a new heterogeneous word-character text graph that combines word and character n-gram nodes together with document nodes, allowing us to better learn dependencies among these entities. Additionally, we propose two new graph-based neural models, WCTextGCN and WCTextGAT, for modeling our proposed text graph. Extensive experiments in text classification and automatic text summarization benchmarks demonstrate that our proposed models consistently outperform competitive baselines and state-of-the-art graph-based models.- Anthology ID:
- 2022.aacl-short.29
- Volume:
- Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 2: Short Papers)
- Month:
- November
- Year:
- 2022
- Address:
- Online only
- Editors:
- Yulan He, Heng Ji, Sujian Li, Yang Liu, Chua-Hui Chang
- Venues:
- AACL | IJCNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 228–233
- Language:
- URL:
- https://aclanthology.org/2022.aacl-short.29
- DOI:
- Cite (ACL):
- Wenzhe Li and Nikolaos Aletras. 2022. Improving Graph-Based Text Representations with Character and Word Level N-grams. In Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pages 228–233, Online only. Association for Computational Linguistics.
- Cite (Informal):
- Improving Graph-Based Text Representations with Character and Word Level N-grams (Li & Aletras, AACL-IJCNLP 2022)
- PDF:
- https://preview.aclanthology.org/naacl-24-ws-corrections/2022.aacl-short.29.pdf