IITK at SemEval-2021 Task 10: Source-Free Unsupervised Domain Adaptation using Class Prototypes
Harshit Kumar, Jinang Shah, Nidhi Hegde, Priyanshu Gupta, Vaibhav Jindal, Ashutosh Modi
Abstract
Recent progress in deep learning has primarily been fueled by the availability of large amounts of annotated data that is obtained from highly expensive manual annotating pro-cesses. To tackle this issue of availability of annotated data, a lot of research has been done on unsupervised domain adaptation that tries to generate systems for an unlabelled target domain data, given labeled source domain data. However, the availability of annotated or labelled source domain dataset can’t always be guaranteed because of data-privacy issues. This is especially the case with medical data, as it may contain sensitive information of the patients. Source-free domain adaptation (SFDA) aims to resolve this issue by us-ing models trained on the source data instead of using the original annotated source data. In this work, we try to build SFDA systems for semantic processing by specifically focusing on the negation detection subtask of the SemEval2021 Task 10. We propose two approaches -ProtoAUGandAdapt-ProtoAUGthat use the idea of self-entropy to choose reliable and high confidence samples, which are then used for data augmentation and subsequent training of the models. Our methods report an improvement of up to 7% in F1 score over the baseline for the Negation Detection subtask.- Anthology ID:
- 2021.semeval-1.53
- Volume:
- Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021)
- Month:
- August
- Year:
- 2021
- Address:
- Online
- Editors:
- Alexis Palmer, Nathan Schneider, Natalie Schluter, Guy Emerson, Aurelie Herbelot, Xiaodan Zhu
- Venue:
- SemEval
- SIG:
- SIGLEX
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 438–444
- Language:
- URL:
- https://aclanthology.org/2021.semeval-1.53
- DOI:
- 10.18653/v1/2021.semeval-1.53
- Cite (ACL):
- Harshit Kumar, Jinang Shah, Nidhi Hegde, Priyanshu Gupta, Vaibhav Jindal, and Ashutosh Modi. 2021. IITK at SemEval-2021 Task 10: Source-Free Unsupervised Domain Adaptation using Class Prototypes. In Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021), pages 438–444, Online. Association for Computational Linguistics.
- Cite (Informal):
- IITK at SemEval-2021 Task 10: Source-Free Unsupervised Domain Adaptation using Class Prototypes (Kumar et al., SemEval 2021)
- PDF:
- https://preview.aclanthology.org/emnlp-22-attachments/2021.semeval-1.53.pdf