Self-Supervised Sentence Polishing by Adding Engaging Modifiers

Zhexin Zhang, Jian Guan, Xin Cui, Yu Ran, Bo Liu, Minlie Huang

Abstract
Teachers often guide students to improve their essays by adding engaging modifiers to polish the sentences. In this work, we present the first study on automatic sentence polishing by adding modifiers. Since there is no available dataset for the new task, we first automatically construct a large number of parallel data by removing modifiers in the engaging sentences collected from public resources. Then we fine-tune LongLM to reconstruct the original sentences from the corrupted ones. Considering that much overlap between inputs and outputs may bias the model to completely copy the inputs, we split each source sentence into sub-sentences and only require the model to generate the modified sub-sentences. Furthermore, we design a retrieval augmentation algorithm to prompt the model to add suitable modifiers. Automatic and manual evaluation on the auto-constructed test set and real human texts show that our model can generate more engaging sentences with suitable modifiers than strong baselines while keeping fluency. We deploy the model at http://coai.cs.tsinghua.edu.cn/static/polishSent/. A demo video is available at https://youtu.be/Y6gFHOgSv8Y.
Anthology ID:
2023.acl-demo.48
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)
Month:
July
Year:
2023
Address:
Toronto, Canada
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
499–507
Language:
URL:
https://aclanthology.org/2023.acl-demo.48
DOI:
10.18653/v1/2023.acl-demo.48
Bibkey:
Cite (ACL):
Zhexin Zhang, Jian Guan, Xin Cui, Yu Ran, Bo Liu, and Minlie Huang. 2023. Self-Supervised Sentence Polishing by Adding Engaging Modifiers. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations), pages 499–507, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Self-Supervised Sentence Polishing by Adding Engaging Modifiers (Zhang et al., ACL 2023)
Copy Citation:
PDF:
https://preview.aclanthology.org/remove-xml-comments/2023.acl-demo.48.pdf
PDF Search