BERT 4EVER@LT-EDI-ACL2022-Detecting signs of Depression from Social Media:Detecting Depression in Social Media using Prompt-Learning and Word-Emotion Cluster
Xiaotian Lin, Yingwen Fu, Ziyu Yang, Nankai Lin, Shengyi Jiang
Abstract
In this paper, we report the solution of the team BERT 4EVER for the LT-EDI-2022 shared task2: Homophobia/Transphobia Detection in social media comments in ACL 2022, which aims to classify Youtube comments into one of the following categories: no,moderate, or severe depression. We model the problem as a text classification task and a text generation task and respectively propose two different models for the tasks. To combine the knowledge learned from these two different models, we softly fuse the predicted probabilities of the models above and then select the label with the highest probability as the final output. In addition, multiple augmentation strategies are leveraged to improve the model generalization capability, such as back translation and adversarial training. Experimental results demonstrate the effectiveness of the proposed models and two augmented strategies.- Anthology ID:
- 2022.ltedi-1.27
- Volume:
- Proceedings of the Second Workshop on Language Technology for Equality, Diversity and Inclusion
- Month:
- May
- Year:
- 2022
- Address:
- Dublin, Ireland
- Editors:
- Bharathi Raja Chakravarthi, B Bharathi, John P McCrae, Manel Zarrouk, Kalika Bali, Paul Buitelaar
- Venue:
- LTEDI
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 200–205
- Language:
- URL:
- https://aclanthology.org/2022.ltedi-1.27
- DOI:
- 10.18653/v1/2022.ltedi-1.27
- Cite (ACL):
- Xiaotian Lin, Yingwen Fu, Ziyu Yang, Nankai Lin, and Shengyi Jiang. 2022. BERT 4EVER@LT-EDI-ACL2022-Detecting signs of Depression from Social Media:Detecting Depression in Social Media using Prompt-Learning and Word-Emotion Cluster. In Proceedings of the Second Workshop on Language Technology for Equality, Diversity and Inclusion, pages 200–205, Dublin, Ireland. Association for Computational Linguistics.
- Cite (Informal):
- BERT 4EVER@LT-EDI-ACL2022-Detecting signs of Depression from Social Media:Detecting Depression in Social Media using Prompt-Learning and Word-Emotion Cluster (Lin et al., LTEDI 2022)
- PDF:
- https://preview.aclanthology.org/dois-2013-emnlp/2022.ltedi-1.27.pdf