Exploring Knowledge Filtering for Retrieval-Augmented Discriminative Tasks

Minjie Qiang, Zhongqing Wang, Xiaoyi Bao, HaoYuan Ma, Shoushan Li, Guodong Zhou


Abstract
Retrieval-augmented methods have achieved remarkable advancements in alleviating the hallucination of large language models.Nevertheless, the introduction of external knowledge does not always lead to the expected improvement in model performance, as irrelevant or harmful information present in the retrieved knowledge can compromise the prediction process.To address these challenges, we propose a novel framework aimed at improving model performance by incorporating knowledge filtering and prediction fusion mechanisms.In particular, our approach first employs a perplexity-based annotation method to collect training data.Then, we design four distinct strategies to filter out harmful retrieved knowledge.Finally, we integrate the filtered knowledge to generate the final result via batch-wise predictions.We conduct extensive experiments across multiple discriminative task datasets to evaluate the proposed framework.The results demonstrate that our framework can significantly enhance the performance of models on discriminative tasks.
Anthology ID:
2025.findings-acl.86
Volume:
Findings of the Association for Computational Linguistics: ACL 2025
Month:
July
Year:
2025
Address:
Vienna, Austria
Editors:
Wanxiang Che, Joyce Nabende, Ekaterina Shutova, Mohammad Taher Pilehvar
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1716–1729
Language:
URL:
https://preview.aclanthology.org/display_plenaries/2025.findings-acl.86/
DOI:
Bibkey:
Cite (ACL):
Minjie Qiang, Zhongqing Wang, Xiaoyi Bao, HaoYuan Ma, Shoushan Li, and Guodong Zhou. 2025. Exploring Knowledge Filtering for Retrieval-Augmented Discriminative Tasks. In Findings of the Association for Computational Linguistics: ACL 2025, pages 1716–1729, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
Exploring Knowledge Filtering for Retrieval-Augmented Discriminative Tasks (Qiang et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/display_plenaries/2025.findings-acl.86.pdf