Abstract
This paper introduces a Czech dataset for semantic similarity and semantic relatedness. The dataset contains word pairs with hand annotated scores that indicate the semantic similarity and semantic relatedness of the words. The dataset contains 953 word pairs compiled from 9 different sources. It contains words and their contexts taken from real text corpora including extra examples when the words are ambiguous. The dataset is annotated by 5 independent annotators. The average Spearman correlation coefficient of the annotation agreement is r = 0.81. We provide reference evaluation experiments with several methods for computing semantic similarity and relatedness.- Anthology ID:
- R17-1053
- Volume:
- Proceedings of the International Conference Recent Advances in Natural Language Processing, RANLP 2017
- Month:
- September
- Year:
- 2017
- Address:
- Varna, Bulgaria
- Editors:
- Ruslan Mitkov, Galia Angelova
- Venue:
- RANLP
- SIG:
- Publisher:
- INCOMA Ltd.
- Note:
- Pages:
- 401–406
- Language:
- URL:
- https://doi.org/10.26615/978-954-452-049-6_053
- DOI:
- 10.26615/978-954-452-049-6_053
- Cite (ACL):
- Miloslav Konopík, Ondřej Pražák, and David Steinberger. 2017. Czech Dataset for Semantic Similarity and Relatedness. In Proceedings of the International Conference Recent Advances in Natural Language Processing, RANLP 2017, pages 401–406, Varna, Bulgaria. INCOMA Ltd..
- Cite (Informal):
- Czech Dataset for Semantic Similarity and Relatedness (Konopík et al., RANLP 2017)
- PDF:
- https://doi.org/10.26615/978-954-452-049-6_053