STACKFEED: Structured Textual Actor-Critic Knowledge base editing with FEEDback

Shashank Kirtania, Naman Gupta, Priyanshu Gupta, Sumit Gulwani, Arun Iyer, Suresh Parthasarathy Iyengar, Arjun Radhakrishna, Sriram K. Rajamani, Gustavo Soares


Abstract
Large Language Models (LLMs) often generate incorrect or outdated information, especially in low-resource settings or when dealing with private data. To address this, Retrieval-Augmented Generation (RAG) uses external knowledge bases (KBs), but these can also suffer from inaccuracies. We introduce STACKFEED, a novel Structured Textual Actor-Critic Knowledge base editing with Feedback approach that iteratively refines the KB based on expert feedback using a multi-actor, centralized critic reinforcement learning framework. STACKFEED defines a ReACT actor agent on each document to perform structured edits based on document-specific targeted instructions. Experimental results showcase that STACKFEED significantly improves KB quality and performance of the RAG system. We evaluate STACKFEED on low-resource programming problems, modified Python packages, and factual question-answering tasks.
Anthology ID:
2025.emnlp-industry.176
Volume:
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
November
Year:
2025
Address:
Suzhou (China)
Editors:
Saloni Potdar, Lina Rojas-Barahona, Sebastien Montella
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2588–2606
Language:
URL:
https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-industry.176/
DOI:
Bibkey:
Cite (ACL):
Shashank Kirtania, Naman Gupta, Priyanshu Gupta, Sumit Gulwani, Arun Iyer, Suresh Parthasarathy Iyengar, Arjun Radhakrishna, Sriram K. Rajamani, and Gustavo Soares. 2025. STACKFEED: Structured Textual Actor-Critic Knowledge base editing with FEEDback. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 2588–2606, Suzhou (China). Association for Computational Linguistics.
Cite (Informal):
STACKFEED: Structured Textual Actor-Critic Knowledge base editing with FEEDback (Kirtania et al., EMNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-emnlp/2025.emnlp-industry.176.pdf