5cNLP at BioLaySumm2025: Prompts, Retrieval, and Multimodal Fusion
Juan Antonio Lossio-Ventura, Callum Chan, Arshitha Basavaraj, Hugo Alatrista-Salas, Francisco Pereira, Diana Inkpen
Abstract
In this work, we present our approach to addressing all subtasks of the BioLaySumm 2025 shared task by leveraging prompting and retrieval strategies, as well as multimodal input fusion. Our method integrates: (1) zero-shot and few-shot prompting with large language models (LLMs); (2) semantic similarity-based dynamic few-shot prompting; (3) retrieval-augmented generation (RAG) incorporating biomedical knowledge from the Unified Medical Language System (UMLS); and (4) a multimodal fusion pipeline that combines images and captions using image-text-to-text generation for enriched lay summarization. Our framework enables lightweight adaptation of pretrained LLMs for generating lay summaries from scientific articles and radiology reports. Using modern LLMs, including Llama-3.3-70B-Instruct and GPT-4.1, our 5cNLP team achieved third place in Subtask 1.2 and second place in Subtask 2.1, among all submissions.- Anthology ID:
- 2025.bionlp-share.27
- Volume:
- Proceedings of the 24th Workshop on Biomedical Language Processing (Shared Tasks)
- Month:
- August
- Year:
- 2025
- Address:
- Vienna, Austria
- Editors:
- Sarvesh Soni, Dina Demner-Fushman
- Venues:
- BioNLP | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 215–231
- Language:
- URL:
- https://preview.aclanthology.org/landing_page/2025.bionlp-share.27/
- DOI:
- Cite (ACL):
- Juan Antonio Lossio-Ventura, Callum Chan, Arshitha Basavaraj, Hugo Alatrista-Salas, Francisco Pereira, and Diana Inkpen. 2025. 5cNLP at BioLaySumm2025: Prompts, Retrieval, and Multimodal Fusion. In Proceedings of the 24th Workshop on Biomedical Language Processing (Shared Tasks), pages 215–231, Vienna, Austria. Association for Computational Linguistics.
- Cite (Informal):
- 5cNLP at BioLaySumm2025: Prompts, Retrieval, and Multimodal Fusion (Lossio-Ventura et al., BioNLP 2025)
- PDF:
- https://preview.aclanthology.org/landing_page/2025.bionlp-share.27.pdf