scubeMSEC@LT-EDI-ACL2022: Detection of Depression using Transformer Models
Sivamanikandan S, Santhosh V, Sanjaykumar N, Jerin Mahibha C, Thenmozhi Durairaj
Abstract
Social media platforms play a major role in our day-to-day life and are considered as a virtual friend by many users, who use the social media to share their feelings all day. Many a time, the content which is shared by users on social media replicate their internal life. Nowadays people love to share their daily life incidents like happy or unhappy moments and their feelings in social media and it makes them feel complete and it has become a habit for many users. Social media provides a new chance to identify the feelings of a person through their posts. The aim of the shared task is to develop a model in which the system is capable of analyzing the grammatical markers related to onset and permanent symptoms of depression. We as a team participated in the shared task Detecting Signs of Depression from Social Media Text at LT-EDI 2022- ACL 2022 and we have proposed a model which predicts depression from English social media posts using the data set shared for the task. The prediction is done based on the labels Moderate, Severe and Not Depressed. We have implemented this using different transformer models like DistilBERT, RoBERTa and ALBERT by which we were able to achieve a Macro F1 score of 0.337, 0.457 and 0.387 respectively. Our code is publicly available in the github- Anthology ID:
- 2022.ltedi-1.29
- Volume:
- Proceedings of the Second Workshop on Language Technology for Equality, Diversity and Inclusion
- Month:
- May
- Year:
- 2022
- Address:
- Dublin, Ireland
- Editors:
- Bharathi Raja Chakravarthi, B Bharathi, John P McCrae, Manel Zarrouk, Kalika Bali, Paul Buitelaar
- Venue:
- LTEDI
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 212–217
- Language:
- URL:
- https://aclanthology.org/2022.ltedi-1.29
- DOI:
- 10.18653/v1/2022.ltedi-1.29
- Cite (ACL):
- Sivamanikandan S, Santhosh V, Sanjaykumar N, Jerin Mahibha C, and Thenmozhi Durairaj. 2022. scubeMSEC@LT-EDI-ACL2022: Detection of Depression using Transformer Models. In Proceedings of the Second Workshop on Language Technology for Equality, Diversity and Inclusion, pages 212–217, Dublin, Ireland. Association for Computational Linguistics.
- Cite (Informal):
- scubeMSEC@LT-EDI-ACL2022: Detection of Depression using Transformer Models (S et al., LTEDI 2022)
- PDF:
- https://preview.aclanthology.org/proper-vol2-ingestion/2022.ltedi-1.29.pdf