Arman Sabyrov
2022
Towards Semi-automatic Sign Language Annotation Tool: SLAN-tool
Medet Mukushev
|
Arman Sabyrov
|
Madina Sultanova
|
Vadim Kimmelman
|
Anara Sandygulova
Proceedings of the LREC2022 10th Workshop on the Representation and Processing of Sign Languages: Multilingual Sign Language Resources
This paper presents a semi-automatic annotation tool for sign languages namely SLAN-tool. The SLAN-tool provides a web-based service for the annotation of sign language videos. Researchers can use the SLAN-tool web service to annotate new and existing sign language datasets with different types of annotations, such as gloss, handshape configurations, and signing regions. This is allowed using a custom tier adding functionality. A unique feature of the tool is its automatic annotation functionality which uses several neural network models in order to recognize signing segments from videos and classify handshapes according to HamNoSys handshape inventory. Furthermore, SLAN-tool users can export annotations and import them into ELAN. The SLAN-tool is publicly available at https://slan-tool.com.
2020
Evaluation of Manual and Non-manual Components for Sign Language Recognition
Medet Mukushev
|
Arman Sabyrov
|
Alfarabi Imashev
|
Kenessary Koishybay
|
Vadim Kimmelman
|
Anara Sandygulova
Proceedings of the Twelfth Language Resources and Evaluation Conference
The motivation behind this work lies in the need to differentiate between similar signs that differ in non-manual components present in any sign. To this end, we recorded full sentences signed by five native signers and extracted 5200 isolated sign samples of twenty frequently used signs in Kazakh-Russian Sign Language (K-RSL), which have similar manual components but differ in non-manual components (i.e. facial expressions, eyebrow height, mouth, and head orientation). We conducted a series of evaluations in order to investigate whether non-manual components would improve sign’s recognition accuracy. Among standard machine learning approaches, Logistic Regression produced the best results, 78.2% of accuracy for dataset with 20 signs and 77.9% of accuracy for dataset with 2 classes (statement vs question). Dataset can be downloaded from the following website: https://krslproject.github.io/krsl20/
Search
Co-authors
- Medet Mukushev 2
- Vadim Kimmelman 2
- Anara Sandygulova 2
- Madina Sultanova 1
- Alfarabi Imashev 1
- show all...