Towards Bengali Word Embedding: Corpus Creation, Intrinsic and Extrinsic Evaluations

Md. Rajib Hossain, Mohammed Moshiul Hoque

Abstract
Distributional word vector representation or word embedding has become an essential ingredient in many natural language processing (NLP) tasks such as machine translation, document classification, information retrieval and question answering. Investigation of embedding model helps to reduce the feature space and improves textual semantic as well as syntactic relations. This paper presents three embedding techniques (such as Word2Vec, GloVe, and FastText) with different hyperparameters implemented on a Bengali corpus consists of 180 million words. The performance of the embedding techniques is evaluated with extrinsic and intrinsic ways. Extrinsic performance evaluated by text classification, which achieved a maximum of 96.48% accuracy. Intrinsic performance evaluated by word similarity (e.g., semantic, syntactic and relatedness) and analogy tasks. The maximum Pearson (rˆ) correlation accuracy of 60.66% (Ssrˆ) achieved for semantic similarities and 71.64% (Syrˆ) for syntactic similarities whereas the relatedness obtained 79.80% (Rsrˆ). The semantic word analogy tasks achieved 44.00% of accuracy while syntactic word analogy tasks obtained 36.00%.
Anthology ID:
2020.icon-main.61
Volume:
Proceedings of the 17th International Conference on Natural Language Processing (ICON)
Month:
December
Year:
2020
Address:
Indian Institute of Technology Patna, Patna, India
Venue:
ICON
SIG:
Publisher:
NLP Association of India (NLPAI)
Note:
Pages:
453–459
Language:
URL:
https://aclanthology.org/2020.icon-main.61
DOI:
Bibkey:
Cite (ACL):
Md. Rajib Hossain and Mohammed Moshiul Hoque. 2020. Towards Bengali Word Embedding: Corpus Creation, Intrinsic and Extrinsic Evaluations. In Proceedings of the 17th International Conference on Natural Language Processing (ICON), pages 453–459, Indian Institute of Technology Patna, Patna, India. NLP Association of India (NLPAI).
Cite (Informal):
Towards Bengali Word Embedding: Corpus Creation, Intrinsic and Extrinsic Evaluations (Hossain & Hoque, ICON 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/remove-xml-comments/2020.icon-main.61.pdf
PDF Search