Abstract
Coherence is an important aspect of text quality, and various approaches have been applied to coherence modeling. However, existing methods solely focus on a single document’s coherence patterns, ignoring the underlying correlation between documents. We investigate a GCN-based coherence model that is capable of capturing structural similarities between documents. Our model first creates a graph structure for each document, from where we mine different subgraph patterns. We then construct a heterogeneous graph for the training corpus, connecting documents based on their shared subgraphs. Finally, a GCN is applied to the heterogeneous graph to model the connectivity relationships. We evaluate our method on two tasks, assessing discourse coherence and automated essay scoring. Results show that our GCN-based model outperforms all baselines, achieving a new state-of-the-art on both tasks.- Anthology ID:
- 2023.acl-long.431
- Volume:
- Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Month:
- July
- Year:
- 2023
- Address:
- Toronto, Canada
- Editors:
- Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 7792–7808
- Language:
- URL:
- https://aclanthology.org/2023.acl-long.431
- DOI:
- 10.18653/v1/2023.acl-long.431
- Cite (ACL):
- Wei Liu, Xiyan Fu, and Michael Strube. 2023. Modeling Structural Similarities between Documents for Coherence Assessment with Graph Convolutional Networks. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7792–7808, Toronto, Canada. Association for Computational Linguistics.
- Cite (Informal):
- Modeling Structural Similarities between Documents for Coherence Assessment with Graph Convolutional Networks (Liu et al., ACL 2023)
- PDF:
- https://preview.aclanthology.org/corrections-2024-04/2023.acl-long.431.pdf