Hatching Chick at SemEval-2018 Task 2: Multilingual Emoji Prediction

Joël Coster, Reinder Gerard van Dalen, Nathalie Adriënne Jacqueline Stierman


Abstract
As part of a SemEval 2018 shared task an attempt was made to build a system capable of predicting the occurence of a language’s most frequently used emoji in Tweets. Specifically, models for English and Spanish data were created and trained on 500.000 and 100.000 tweets respectively. In order to create these models, first a logistic regressor, a sequential LSTM, a random forest regressor and a SVM were tested. The latter was found to perform best and therefore optimized individually for both languages. During developmet f1-scores of 61 and 82 were obtained for English and Spanish data respectively, in comparison, f1-scores on the official evaluation data were 21 and 18. The significant decrease in performance during evaluation might be explained by overfitting during development and might therefore have partially be prevented by using cross-validation. Over all, emoji which occur in a very specific context such as a Christmas tree were found to be most predictable.
Anthology ID:
S18-1070
Volume:
Proceedings of the 12th International Workshop on Semantic Evaluation
Month:
June
Year:
2018
Address:
New Orleans, Louisiana
Editors:
Marianna Apidianaki, Saif M. Mohammad, Jonathan May, Ekaterina Shutova, Steven Bethard, Marine Carpuat
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
445–448
Language:
URL:
https://aclanthology.org/S18-1070
DOI:
10.18653/v1/S18-1070
Bibkey:
Cite (ACL):
Joël Coster, Reinder Gerard van Dalen, and Nathalie Adriënne Jacqueline Stierman. 2018. Hatching Chick at SemEval-2018 Task 2: Multilingual Emoji Prediction. In Proceedings of the 12th International Workshop on Semantic Evaluation, pages 445–448, New Orleans, Louisiana. Association for Computational Linguistics.
Cite (Informal):
Hatching Chick at SemEval-2018 Task 2: Multilingual Emoji Prediction (Coster et al., SemEval 2018)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-2023-videos/S18-1070.pdf