Discriminating between Similar Languages with Word-level Convolutional Neural Networks

Marcelo Criscuolo, Sandra Maria Aluísio


Abstract
Discriminating between Similar Languages (DSL) is a challenging task addressed at the VarDial Workshop series. We report on our participation in the DSL shared task with a two-stage system. In the first stage, character n-grams are used to separate language groups, then specialized classifiers distinguish similar language varieties. We have conducted experiments with three system configurations and submitted one run for each. Our main approach is a word-level convolutional neural network (CNN) that learns task-specific vectors with minimal text preprocessing. We also experiment with multi-layer perceptron (MLP) networks and another hybrid configuration. Our best run achieved an accuracy of 90.76%, ranking 8th among 11 participants and getting very close to the system that ranked first (less than 2 points). Even though the CNN model could not achieve the best results, it still makes a viable approach to discriminating between similar languages.
Anthology ID:
W17-1215
Volume:
Proceedings of the Fourth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial)
Month:
April
Year:
2017
Address:
Valencia, Spain
Editors:
Preslav Nakov, Marcos Zampieri, Nikola Ljubešić, Jörg Tiedemann, Shevin Malmasi, Ahmed Ali
Venue:
VarDial
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
124–130
Language:
URL:
https://aclanthology.org/W17-1215
DOI:
10.18653/v1/W17-1215
Bibkey:
Cite (ACL):
Marcelo Criscuolo and Sandra Maria Aluísio. 2017. Discriminating between Similar Languages with Word-level Convolutional Neural Networks. In Proceedings of the Fourth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial), pages 124–130, Valencia, Spain. Association for Computational Linguistics.
Cite (Informal):
Discriminating between Similar Languages with Word-level Convolutional Neural Networks (Criscuolo & Aluísio, VarDial 2017)
Copy Citation:
PDF:
https://preview.aclanthology.org/dois-2013-emnlp/W17-1215.pdf