MedQwen-PE: Medical Qwen for Parameter-Efficient Multilingual Patient-Centric Summarization, Question Answering and Information Extraction

Vinay Babu Ulli, Anindita Mondal


Abstract
This study addresses the Shared Task on Patient-Centric Multilingual Question Answering, which focuses on generating summaries and patient-oriented answers from multi-turn medical dialogues related to Head and Neck Cancer and Cystic Fibrosis across ten languages. The Qwen3-1.7B model is fine-tuned using QLoRA for three tasks—Summarization, Question Answering, and Information Extraction—while updating only approximately 1.6% of parameters through task-specific adapter layers. The resulting system demonstrates strong semantic fidelity, as evidenced by high BERTScore and COMET scores, particularly for Kannada, English, Telugu, and Tamil, with comparatively lower performance in Assamese, Bangla, Gujarati, and Marathi. The modular fine-tuning design enables efficient task adaptation while satisfying the constraints on model size and computational resources.
Anthology ID:
2025.nlpai4health-main.9
Volume:
NLP-AI4Health
Month:
December
Year:
2025
Address:
Mumbai, India
Editors:
Parameswari Krishnamurthy, Vandan Mujadia, Dipti Misra Sharma, Hannah Mary Thomas
Venues:
NLP-AI4Health | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
86–92
Language:
URL:
https://preview.aclanthology.org/ingest-ijcnlp-aacl/2025.nlpai4health-main.9/
DOI:
Bibkey:
Cite (ACL):
Vinay Babu Ulli and Anindita Mondal. 2025. MedQwen-PE: Medical Qwen for Parameter-Efficient Multilingual Patient-Centric Summarization, Question Answering and Information Extraction. In NLP-AI4Health, pages 86–92, Mumbai, India. Association for Computational Linguistics.
Cite (Informal):
MedQwen-PE: Medical Qwen for Parameter-Efficient Multilingual Patient-Centric Summarization, Question Answering and Information Extraction (Ulli & Mondal, NLP-AI4Health 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-ijcnlp-aacl/2025.nlpai4health-main.9.pdf