Abstract
Human experts write summaries using different techniques, including extracting a sentence from the document and rewriting it, or fusing various information from the document to abstract it. These techniques are flexible and thus difficult to be imitated by any single method. To address this issue, we propose an adaptive model, GEMINI, that integrates a rewriter and a generator to mimic the sentence rewriting and abstracting techniques, respectively. GEMINI adaptively chooses to rewrite a specific document sentence or generate a summary sentence from scratch. Experiments demonstrate that our adaptive approach outperforms the pure abstractive and rewriting baselines on three benchmark datasets, achieving the best results on WikiHow. Interestingly, empirical results show that the human summary styles of summary sentences are consistently predictable given their context. We release our code and model at https://github.com/baoguangsheng/gemini.- Anthology ID:
- 2023.emnlp-main.53
- Volume:
- Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- Month:
- December
- Year:
- 2023
- Address:
- Singapore
- Editors:
- Houda Bouamor, Juan Pino, Kalika Bali
- Venue:
- EMNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 831–842
- Language:
- URL:
- https://aclanthology.org/2023.emnlp-main.53
- DOI:
- 10.18653/v1/2023.emnlp-main.53
- Cite (ACL):
- Guangsheng Bao, Zebin Ou, and Yue Zhang. 2023. GEMINI: Controlling The Sentence-Level Summary Style in Abstractive Text Summarization. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 831–842, Singapore. Association for Computational Linguistics.
- Cite (Informal):
- GEMINI: Controlling The Sentence-Level Summary Style in Abstractive Text Summarization (Bao et al., EMNLP 2023)
- PDF:
- https://preview.aclanthology.org/naacl24-info/2023.emnlp-main.53.pdf