CS-Embed at SemEval-2020 Task 9: The Effectiveness of Code-switched Word Embeddings for Sentiment Analysis

Frances Adriana Laureano De Leon, Florimond Guéniat, Harish Tayyar Madabushi


Abstract
The growing popularity and applications of sentiment analysis of social media posts has naturally led to sentiment analysis of posts written in multiple languages, a practice known as code-switching. While recent research into code-switched posts has focused on the use of multilingual word embeddings, these embeddings were not trained on code-switched data. In this work, we present word-embeddings trained on code-switched tweets, specifically those that make use of Spanish and English, known as Spanglish. We explore the embedding space to discover how they capture the meanings of words in both languages. We test the effectiveness of these embeddings by participating in SemEval 2020 Task 9: Sentiment Analysis on Code-Mixed Social Media Text. We utilised them to train a sentiment classifier that achieves an F-1 score of 0.722. This is higher than the baseline for the competition of 0.656, with our team (codalab username francesita) ranking 14 out of 29 participating teams, beating the baseline.
Anthology ID:
2020.semeval-1.117
Volume:
Proceedings of the Fourteenth Workshop on Semantic Evaluation
Month:
December
Year:
2020
Address:
Barcelona (online)
Editors:
Aurelie Herbelot, Xiaodan Zhu, Alexis Palmer, Nathan Schneider, Jonathan May, Ekaterina Shutova
Venue:
SemEval
SIG:
SIGLEX
Publisher:
International Committee for Computational Linguistics
Note:
Pages:
922–927
Language:
URL:
https://aclanthology.org/2020.semeval-1.117
DOI:
10.18653/v1/2020.semeval-1.117
Bibkey:
Cite (ACL):
Frances Adriana Laureano De Leon, Florimond Guéniat, and Harish Tayyar Madabushi. 2020. CS-Embed at SemEval-2020 Task 9: The Effectiveness of Code-switched Word Embeddings for Sentiment Analysis. In Proceedings of the Fourteenth Workshop on Semantic Evaluation, pages 922–927, Barcelona (online). International Committee for Computational Linguistics.
Cite (Informal):
CS-Embed at SemEval-2020 Task 9: The Effectiveness of Code-switched Word Embeddings for Sentiment Analysis (Laureano De Leon et al., SemEval 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/add_acl24_videos/2020.semeval-1.117.pdf
Code
 francesita/CS-Embed-SemEval2020