KR Labs at ArchEHR-QA 2025: A Verbatim Approach for Evidence-Based Question Answering

Adam Kovacs, Paul Schmitt, Gabor Recski


Abstract
We present a lightweight, domain‐agnostic verbatim pipeline for evidence‐grounded question answering. Our pipeline operates in two steps: first, a sentence-level extractor flags relevant note sentences using either zero-shot LLM prompts or supervised ModernBERT classifiers. Next, an LLM drafts a question-specific template, which is filled verbatim with sentences from the extraction step. This prevents hallucinations and ensures traceability. In the ArchEHR‐QA 2025 shared task, our system scored 42.01%, ranking top‐10 in core metrics and outperforming the organiser’s 70B‐parameter Llama‐3.3 baseline. We publicly release our code and inference scripts under an MIT license.
Anthology ID:
2025.bionlp-share.8
Volume:
Proceedings of the 24th Workshop on Biomedical Language Processing (Shared Tasks)
Month:
August
Year:
2025
Address:
Vienna, Austria
Editors:
Sarvesh Soni, Dina Demner-Fushman
Venues:
BioNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
69–74
Language:
URL:
https://preview.aclanthology.org/landing_page/2025.bionlp-share.8/
DOI:
10.18653/v1/2025.bionlp-share.8
Bibkey:
Cite (ACL):
Adam Kovacs, Paul Schmitt, and Gabor Recski. 2025. KR Labs at ArchEHR-QA 2025: A Verbatim Approach for Evidence-Based Question Answering. In Proceedings of the 24th Workshop on Biomedical Language Processing (Shared Tasks), pages 69–74, Vienna, Austria. Association for Computational Linguistics.
Cite (Informal):
KR Labs at ArchEHR-QA 2025: A Verbatim Approach for Evidence-Based Question Answering (Kovacs et al., BioNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/landing_page/2025.bionlp-share.8.pdf