PolyuCBS at SMM4H 2024: LLM-based Medical Disorder and Adverse Drug Event Detection with Low-rank Adaptation
Zhai Yu, Xiaoyi Bao, Emmanuele Chersoni, Beatrice Portelli, Sophia Lee, Jinghang Gu, Chu-Ren Huang
Abstract
This is the demonstration of systems and results of our team’s participation in the Social Medical Mining for Health (SMM4H) 2024 Shared Task. Our team participated in two tasks: Task 1 and Task 5. Task 5 requires the detection of tweet sentences that claim children’s medical disorders from certain users. Task 1 needs teams to extract and normalize Adverse Drug Event terms in the tweet sentence. The team selected several Pre-trained Language Models and generative Large Language Models to meet the requirements. Strategies to improve the performance include cloze test, prompt engineering, Low Rank Adaptation etc. The test result of our system has an F1 score of 0.935, Precision of 0.954 and Recall of 0.917 in Task 5 and an overall F1 score of 0.08 in Task 1.- Anthology ID:
- 2024.smm4h-1.17
- Volume:
- Proceedings of The 9th Social Media Mining for Health Research and Applications (SMM4H 2024) Workshop and Shared Tasks
- Month:
- August
- Year:
- 2024
- Address:
- Bangkok, Thailand
- Editors:
- Dongfang Xu, Graciela Gonzalez-Hernandez
- Venues:
- SMM4H | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 74–78
- Language:
- URL:
- https://aclanthology.org/2024.smm4h-1.17
- DOI:
- Cite (ACL):
- Zhai Yu, Xiaoyi Bao, Emmanuele Chersoni, Beatrice Portelli, Sophia Lee, Jinghang Gu, and Chu-Ren Huang. 2024. PolyuCBS at SMM4H 2024: LLM-based Medical Disorder and Adverse Drug Event Detection with Low-rank Adaptation. In Proceedings of The 9th Social Media Mining for Health Research and Applications (SMM4H 2024) Workshop and Shared Tasks, pages 74–78, Bangkok, Thailand. Association for Computational Linguistics.
- Cite (Informal):
- PolyuCBS at SMM4H 2024: LLM-based Medical Disorder and Adverse Drug Event Detection with Low-rank Adaptation (Yu et al., SMM4H-WS 2024)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2024.smm4h-1.17.pdf