Bengali dataset format
======================
<word><TAB><part of speech><TAB><lemma>

End of a sentence is indicated by a blank line.

Hindi dataset format
======================
<word><TAB><part of speech><TAB><lemma>

End of a sentence is indicated by a blank line.


List of POS tags in Bengali dataset:
====================================
NNP	-> proper noun
POSঅব্য	-> a composite tag referring preposition, conjunction and interjection
POSক্রি	-> verb
POSক্রিবিণ	-> adverb
POSবি	-> noun
POSবিণ	-> adjective
POSবিণবিণ	-> a Bengali specific POS tag indicating adjective modifier
POSসর্ব	-> pronoun
UNK	-> unknown token



List of POS tags in Hindi dataset:
==================================
adj	-> adjective
adv	-> adverb
avy	-> a composite tag referring preposition, conjunction and interjection
n	-> noun
nnp	-> proper noun
num	-> number
pn	-> pronoun
sym	-> symbol
unk	-> unknown token
v	-> verb
