Want to Identify, Extract and Normalize Adverse Drug Reactions in Tweets? Use RoBERTa

Katikapalli Subramanyam Kalyan, Sivanesan Sangeetha

Abstract
This paper presents our approach for task 2 and task 3 of Social Media Mining for Health (SMM4H) 2020 shared tasks. In task 2, we have to differentiate adverse drug reaction (ADR) tweets from nonADR tweets and is treated as binary classification. Task 3 involves extracting ADR mentions and then mapping them to MedDRA codes. Extracting ADR mentions is treated as sequence labeling and normalizing ADR mentions is treated as multi-class classification. Our system is based on pre-trained language model RoBERTa and it achieves a) F1-score of 58% in task 2 which is 12% more than the average score b) relaxed F1-score of 70.1% in ADR extraction of task 3 which is 13.7% more than the average score and relaxed F1-score of 35% in ADR extraction + normalization of task 3 which is 5.8% more than the average score. Overall, our models achieve promising results in both the tasks with significant improvements over average scores.
Anthology ID:
2020.smm4h-1.20
Volume:
Proceedings of the Fifth Social Media Mining for Health Applications Workshop & Shared Task
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Editors:
Graciela Gonzalez-Hernandez, Ari Z. Klein, Ivan Flores, Davy Weissenbacher, Arjun Magge, Karen O'Connor, Abeed Sarker, Anne-Lyse Minard, Elena Tutubalina, Zulfat Miftahutdinov, Ilseyar Alimova
Venue:
SMM4H
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
121–124
Language:
URL:
https://aclanthology.org/2020.smm4h-1.20
DOI:
Bibkey:
Cite (ACL):
Katikapalli Subramanyam Kalyan and Sivanesan Sangeetha. 2020. Want to Identify, Extract and Normalize Adverse Drug Reactions in Tweets? Use RoBERTa. In Proceedings of the Fifth Social Media Mining for Health Applications Workshop & Shared Task, pages 121–124, Barcelona, Spain (Online). Association for Computational Linguistics.
Cite (Informal):
Want to Identify, Extract and Normalize Adverse Drug Reactions in Tweets? Use RoBERTa (Kalyan & Sangeetha, SMM4H 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/naacl24-info/2020.smm4h-1.20.pdf
Data
SMM4H
PDF Search