๐’œ3: Automatic Alignment Framework for Attributed Text Generation

Yue Wang, Haoke Zhang, Juntao Li, Jinxiong Chang, Min Zhang


Abstract
Attributed text generation aims to enhance the reliability of content generated from large language models by providing citations for each claim, which thereby enables users to easily verify the correctness of the responses.However, the scarcity of high-quality training samples presents a significant challenge in aligning large language models to generate texts with citations, revealing considerable room for improvement in existing attribution systems.Besides, existing approaches of aligning large language models to follow user instructions can lead to an undue emphasis on irrelevant documents, which in turn reduces the quality of responses.To address the above problems, we propose Automatic Alignment Framework for Attributed Text Generation ( ๐’œ3), a novel framework designed to automatically generate high-quality attributed query-response pairs for both supervised fine-tuning and preference optimization stages without human annotation.With the help of ๐’œ3, Mistral-7B can achieve a citation recall of 84.4 and a precision of 87.0 precision on ASQA, which notably surpasses GPT-4โ€™s citation recall of 73.0 and precision of 76.5.
Anthology ID:
2025.acl-long.1407
Volume:
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Wanxiang Che, Joyce Nabende, Ekaterina Shutova, Mohammad Taher Pilehvar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
28975โ€“28990
Language:
URL:
https://preview.aclanthology.org/ingestion-acl-25/2025.acl-long.1407/
DOI:
Bibkey:
Cite (ACL):
Yue Wang, Haoke Zhang, Juntao Li, Jinxiong Chang, and Min Zhang. 2025. ๐’œ3: Automatic Alignment Framework for Attributed Text Generation. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 28975โ€“28990, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
๐’œ3: Automatic Alignment Framework for Attributed Text Generation (Wang et al., ACL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-acl-25/2025.acl-long.1407.pdf