QA Analysis in Medical and Legal Domains: A Survey of Data Augmentation in Low-Resource Settings
Benedictus Kent Rachmat, Thomas Gerald, Zheng Zhang Slb, Cyril Grouin
Abstract
Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP), but their success remains largely confined to high-resource, general-purpose domains. In contrast, applying LLMs to low-resource domains poses significant challenges due to limited training data, domain drift, and strict terminology constraints. This survey provides an overview of the current landscape in domain-specific, low-resource QA with LLMs. We begin by analyzing the coverage and representativeness of specialized-domain QA datasets against large-scale reference datasets what we refer to as ParentQA. Building on this analysis, we survey data-centric strategies to enhance input diversity, including data augmentation techniques. We further discuss evaluation metrics for specialized tasks and consider ethical concerns. By mapping current methodologies and outlining open research questions, this survey aims to guide future efforts in adapting LLMs for robust and responsible use in resource-constrained, domain-specific environments. To facilitate reproducibility, we make our code available at https://github.com/kentrachmat/survey-da.- Anthology ID:
- 2025.acl-srw.89
- Volume:
- Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)
- Month:
- July
- Year:
- 2025
- Address:
- Vienna, Austria
- Editors:
- Jin Zhao, Mingyang Wang, Zhu Liu
- Venues:
- ACL | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1132–1144
- Language:
- URL:
- https://preview.aclanthology.org/landing_page/2025.acl-srw.89/
- DOI:
- Cite (ACL):
- Benedictus Kent Rachmat, Thomas Gerald, Zheng Zhang Slb, and Cyril Grouin. 2025. QA Analysis in Medical and Legal Domains: A Survey of Data Augmentation in Low-Resource Settings. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop), pages 1132–1144, Vienna, Austria. Association for Computational Linguistics.
- Cite (Informal):
- QA Analysis in Medical and Legal Domains: A Survey of Data Augmentation in Low-Resource Settings (Rachmat et al., ACL 2025)
- PDF:
- https://preview.aclanthology.org/landing_page/2025.acl-srw.89.pdf