NADE: A Benchmark for Robust Adverse Drug Events Extraction in Face of Negations
Simone Scaboro, Beatrice Portelli, Emmanuele Chersoni, Enrico Santus, Giuseppe Serra
Abstract
Adverse Drug Event (ADE) extraction models can rapidly examine large collections of social media texts, detecting mentions of drug-related adverse reactions and trigger medical investigations. However, despite the recent advances in NLP, it is currently unknown if such models are robust in face of negation, which is pervasive across language varieties. In this paper we evaluate three state-of-the-art systems, showing their fragility against negation, and then we introduce two possible strategies to increase the robustness of these models: a pipeline approach, relying on a specific component for negation detection; an augmentation of an ADE extraction dataset to artificially create negated samples and further train the models. We show that both strategies bring significant increases in performance, lowering the number of spurious entities predicted by the models. Our dataset and code will be publicly released to encourage research on the topic.- Anthology ID:
- 2021.wnut-1.26
- Volume:
- Proceedings of the Seventh Workshop on Noisy User-generated Text (W-NUT 2021)
- Month:
- November
- Year:
- 2021
- Address:
- Online
- Editors:
- Wei Xu, Alan Ritter, Tim Baldwin, Afshin Rahimi
- Venue:
- WNUT
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 230–237
- Language:
- URL:
- https://aclanthology.org/2021.wnut-1.26
- DOI:
- 10.18653/v1/2021.wnut-1.26
- Cite (ACL):
- Simone Scaboro, Beatrice Portelli, Emmanuele Chersoni, Enrico Santus, and Giuseppe Serra. 2021. NADE: A Benchmark for Robust Adverse Drug Events Extraction in Face of Negations. In Proceedings of the Seventh Workshop on Noisy User-generated Text (W-NUT 2021), pages 230–237, Online. Association for Computational Linguistics.
- Cite (Informal):
- NADE: A Benchmark for Robust Adverse Drug Events Extraction in Face of Negations (Scaboro et al., WNUT 2021)
- PDF:
- https://preview.aclanthology.org/ingest-acl-2023-videos/2021.wnut-1.26.pdf
- Code
- ailabudinegit/nade-dataset
- Data
- SMM4H