Beyond One-Size-Fits-All: Multi-Agent Refinement Framework for Persona-Based Biomedical Summarization
Rohan Charudatt Salvi, Chirag Chawla, Md. Shad Akhtar, Shweta Yadav
Abstract
Lay summarization aims to make biomedical research accessible to non-experts, but most approaches assume a uniform audience, overlooking variation in medical literacy and information needs. We present MAPS (Multi-Agent Persona-based Summarization), a framework that generates persona-specific summaries through iterative cross-agent feedback. Human evaluation shows MAPS improves quality over single-agent baselines, while automatic metrics fail to capture these gains. LLM-based judges also exhibit limited sensitivity, assigning inflated scores and misdetecting errors. These findings highlight the need for improved evaluation methods for persona-based summarization.- Anthology ID:
- 2026.cl4health-1.28
- Volume:
- Proceedings of the Third Workshop on Patient-Oriented Language Processing (CL4Health) @ LREC 2026
- Month:
- May
- Year:
- 2026
- Address:
- Palma, Mallorca (Spain)
- Editors:
- Deepak Gupta, Paul Thompson, Sophia Ananiadou, Dina Demner-Fushman
- Venues:
- CL4Health | WS
- SIG:
- Publisher:
- ELRA Language Resources Association (ELRA)
- Note:
- Pages:
- 320–332
- Language:
- External URL:
- https://lrec.elra.info/lrec2026-ws-cl4health-28
- DOI:
- 10.63317/22uei8f8k9za
- Cite (ACL):
- Rohan Charudatt Salvi, Chirag Chawla, Md. Shad Akhtar, and Shweta Yadav. 2026. Beyond One-Size-Fits-All: Multi-Agent Refinement Framework for Persona-Based Biomedical Summarization. In Proceedings of the Third Workshop on Patient-Oriented Language Processing (CL4Health) @ LREC 2026, pages 320–332, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
- Cite (Informal):
- Beyond One-Size-Fits-All: Multi-Agent Refinement Framework for Persona-Based Biomedical Summarization (Salvi et al., CL4Health 2026)