Complex Setswana Parts of Speech Tagging
Gabofetswe Malema, Boago Okgetheng, Bopaki Tebalo, Moffat Motlhanka, Goaletsa Rammidi
Abstract
Setswana language is one of the Bantu languages written disjunctively. Some of its parts of speech such as qualificatives and some adverbs are made up of multiple words. That is, the part of speech is made up of a group of words. The disjunctive style of writing poses a challenge when a sentence is tokenized or when tagging. A few studies have been done on identification of multi-word parts of speech. In this study we go further to tokenize complex parts of speech which are formed by extending basic forms of multi-word parts of speech. The parts of speech are extended by recursively concatenating more parts of speech to a basic form of parts of speech. We developed rules for building complex relative parts of speech. A morphological analyzer and Python NLTK are used to tag individual words and basic forms of multi-word parts of speech. Developed rules are then used to identify complex parts of speech. Results from a 300 sentence text files give a performance of 74%. The tagger fails when it encounters expansion rules not implemented and when tagging by the morphological analyzer is incorrect.- Anthology ID:
- 2020.rail-1.4
- Original:
- 2020.rail-1.4v1
- Version 2:
- 2020.rail-1.4v2
- Volume:
- Proceedings of the first workshop on Resources for African Indigenous Languages
- Month:
- May
- Year:
- 2020
- Address:
- Marseille, France
- Editors:
- Rooweither Mabuya, Phathutshedzo Ramukhadi, Mmasibidi Setaka, Valencia Wagner, Menno van Zaanen
- Venue:
- RAIL
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 21–24
- Language:
- English
- URL:
- https://aclanthology.org/2020.rail-1.4
- DOI:
- Cite (ACL):
- Gabofetswe Malema, Boago Okgetheng, Bopaki Tebalo, Moffat Motlhanka, and Goaletsa Rammidi. 2020. Complex Setswana Parts of Speech Tagging. In Proceedings of the first workshop on Resources for African Indigenous Languages, pages 21–24, Marseille, France. European Language Resources Association (ELRA).
- Cite (Informal):
- Complex Setswana Parts of Speech Tagging (Malema et al., RAIL 2020)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2020.rail-1.4.pdf