CoRAC: Integrating Selective API Document Retrieval with Question Semantic Intent for Code Question Answering

YunSeok Choi, CheolWon Na, Jee-Hyong Lee


Abstract
Automatic code question answering aims to generate precise answers to questions about code by analyzing code snippets. To provide an appropriate answer, it is necessary to accurately understand the relevant part of the code and correctly interpret the intent of the question. However, in real-world scenarios, the questioner often provides only a portion of the code along with the question, making it challenging to find an answer. The responder should be capable of providing a suitable answer using such limited information. We propose a knowledge-based framework, CoRAC, an automatic code question responder that enhances understanding through selective API document retrieval and question semantic intent clustering. We evaluate our method on three real-world benchmark datasets and demonstrate its effectiveness through various experiments. We also show that our method can generate high-quality answers compared to large language models, such as ChatGPT.
Anthology ID:
2025.naacl-long.628
Volume:
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Month:
April
Year:
2025
Address:
Albuquerque, New Mexico
Editors:
Luis Chiruzzo, Alan Ritter, Lu Wang
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
12620–12635
Language:
URL:
https://preview.aclanthology.org/fix-sig-urls/2025.naacl-long.628/
DOI:
Bibkey:
Cite (ACL):
YunSeok Choi, CheolWon Na, and Jee-Hyong Lee. 2025. CoRAC: Integrating Selective API Document Retrieval with Question Semantic Intent for Code Question Answering. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 12620–12635, Albuquerque, New Mexico. Association for Computational Linguistics.
Cite (Informal):
CoRAC: Integrating Selective API Document Retrieval with Question Semantic Intent for Code Question Answering (Choi et al., NAACL 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/fix-sig-urls/2025.naacl-long.628.pdf