Abstract
Discriminating between Similar Languages (DSL) is a challenging task addressed at the VarDial Workshop series. We report on our participation in the DSL shared task with a two-stage system. In the first stage, character n-grams are used to separate language groups, then specialized classifiers distinguish similar language varieties. We have conducted experiments with three system configurations and submitted one run for each. Our main approach is a word-level convolutional neural network (CNN) that learns task-specific vectors with minimal text preprocessing. We also experiment with multi-layer perceptron (MLP) networks and another hybrid configuration. Our best run achieved an accuracy of 90.76%, ranking 8th among 11 participants and getting very close to the system that ranked first (less than 2 points). Even though the CNN model could not achieve the best results, it still makes a viable approach to discriminating between similar languages.- Anthology ID:
- W17-1215
- Volume:
- Proceedings of the Fourth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial)
- Month:
- April
- Year:
- 2017
- Address:
- Valencia, Spain
- Editors:
- Preslav Nakov, Marcos Zampieri, Nikola Ljubešić, Jörg Tiedemann, Shevin Malmasi, Ahmed Ali
- Venue:
- VarDial
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 124–130
- Language:
- URL:
- https://aclanthology.org/W17-1215
- DOI:
- 10.18653/v1/W17-1215
- Cite (ACL):
- Marcelo Criscuolo and Sandra Maria Aluísio. 2017. Discriminating between Similar Languages with Word-level Convolutional Neural Networks. In Proceedings of the Fourth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial), pages 124–130, Valencia, Spain. Association for Computational Linguistics.
- Cite (Informal):
- Discriminating between Similar Languages with Word-level Convolutional Neural Networks (Criscuolo & Aluísio, VarDial 2017)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-3/W17-1215.pdf