Abstract
Headline generation is a task of generating an appropriate headline for a given article, which can be further used for machine-aided writing or enhancing the click-through ratio. Current works only use the article itself in the generation, but have not taken the writing style of headlines into consideration. In this paper, we propose a novel Seq2Seq model called CLH3G (Contrastive Learning enhanced Historical Headlines based Headline Generation) which can use the historical headlines of the articles that the author wrote in the past to improve the headline generation of current articles. By taking historical headlines into account, we can integrate the stylistic features of the author into our model, and generate a headline not only appropriate for the article, but also consistent with the author’s style. In order to efficiently learn the stylistic features of the author, we further introduce a contrastive learning based auxiliary task for the encoder of our model. Besides, we propose two methods to use the learned stylistic features to guide both the pointer and the decoder during the generation. Experimental results show that historical headlines of the same user can improve the headline generation significantly, and both the contrastive learning module and the two style features fusion methods can further boost the performance.- Anthology ID:
- 2022.emnlp-main.338
- Volume:
- Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
- Month:
- December
- Year:
- 2022
- Address:
- Abu Dhabi, United Arab Emirates
- Editors:
- Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
- Venue:
- EMNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 5063–5072
- Language:
- URL:
- https://aclanthology.org/2022.emnlp-main.338
- DOI:
- 10.18653/v1/2022.emnlp-main.338
- Cite (ACL):
- Hui Liu, Weidong Guo, Yige Chen, and Xiangyang Li. 2022. Contrastive Learning enhanced Author-Style Headline Generation. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 5063–5072, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
- Cite (Informal):
- Contrastive Learning enhanced Author-Style Headline Generation (Liu et al., EMNLP 2022)
- PDF:
- https://preview.aclanthology.org/ingest-acl-2023-videos/2022.emnlp-main.338.pdf