A Neural Local Coherence Analysis Model for Clarity Text Scoring

Panitan Muangkammuen, Sheng Xu, Fumiyo Fukumoto, Kanda Runapongsa Saikaew, Jiyi Li

Abstract
Local coherence relation between two phrases/sentences such as cause-effect and contrast gives a strong influence of whether a text is well-structured or not. This paper follows the assumption and presents a method for scoring text clarity by utilizing local coherence between adjacent sentences. We hypothesize that the contextual features of coherence relations learned by utilizing different data from the target training data are also possible to discriminate well-structured of the target text and thus help to score the text clarity. We propose a text clarity scoring method that utilizes local coherence analysis with an out-domain setting, i.e. the training data for the source and target tasks are different from each other. The method with language model pre-training BERT firstly trains the local coherence model as an auxiliary manner and then re-trains it together with clarity text scoring model. The experimental results by using the PeerRead benchmark dataset show the improvement compared with a single model, scoring text clarity model. Our source codes are available online.
Anthology ID:
2020.coling-main.194
Volume:
Proceedings of the 28th International Conference on Computational Linguistics
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
2138–2143
Language:
URL:
https://aclanthology.org/2020.coling-main.194
DOI:
10.18653/v1/2020.coling-main.194
Bibkey:
Cite (ACL):
Panitan Muangkammuen, Sheng Xu, Fumiyo Fukumoto, Kanda Runapongsa Saikaew, and Jiyi Li. 2020. A Neural Local Coherence Analysis Model for Clarity Text Scoring. In Proceedings of the 28th International Conference on Computational Linguistics, pages 2138–2143, Barcelona, Spain (Online). International Committee on Computational Linguistics.
Cite (Informal):
A Neural Local Coherence Analysis Model for Clarity Text Scoring (Muangkammuen et al., COLING 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/2020.coling-main.194.pdf
Data
PeerRead
PDF Search