Abstract
We present an analysis of the performance of machine learning classifiers on discriminating between similar languages and language varieties. We carried out a number of experiments using the results of the two editions of the Discriminating between Similar Languages (DSL) shared task. We investigate the progress made between the two tasks, estimate an upper bound on possible performance using ensemble and oracle combination, and provide learning curves to help us understand which languages are more challenging. A number of difficult sentences are identified and investigated further with human annotation- Anthology ID:
- L16-1284
- Volume:
- Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
- Month:
- May
- Year:
- 2016
- Address:
- Portorož, Slovenia
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 1800–1807
- Language:
- URL:
- https://aclanthology.org/L16-1284
- DOI:
- Cite (ACL):
- Cyril Goutte, Serge Léger, Shervin Malmasi, and Marcos Zampieri. 2016. Discriminating Similar Languages: Evaluations and Explorations. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 1800–1807, Portorož, Slovenia. European Language Resources Association (ELRA).
- Cite (Informal):
- Discriminating Similar Languages: Evaluations and Explorations (Goutte et al., LREC 2016)
- PDF:
- https://preview.aclanthology.org/nodalida-main-page/L16-1284.pdf