Gaia Caligiore
2024
Multisource Approaches to Italian Sign Language (LIS) Recognition: Insights from the MultiMedaLIS Dataset
Gaia Caligiore
|
Raffaele Mineo
|
Concetto Spampinato
|
Egidio Ragonese
|
Simone Palazzo
|
Sabina Fontana
Proceedings of the Tenth Italian Conference on Computational Linguistics (CLiC-it 2024)
Given their status as unwritten visual-gestural languages, research on the automatic recognition of sign languages has increasingly implemented multisource capturing tools for data collection and processing. This paper explores advancements in Italian Sign Language (LIS) recognition using a multimodal dataset in the medical domain: the MultiMedaLIS Dataset. We investigate the integration of RGB frames, depth data, optical flow, and skeletal information to develop and evaluate two computational models: Skeleton-Based Graph Convolutional Network (SL-GCN) and Spatiotemporal Separable Convolutional Network (SSTCN). RADAR data was collected but not included in the testing phase. Our experiments validate the effectiveness of these models in enhancing the accuracy and robustness of isolated LIS signs recognition. Our findings highlight the potential of multisource approaches in computational linguistics to improve linguistic accessibility and inclusivity for members of the signing community.
2020
Building a Treebank in Universal Dependencies for Italian Sign Language
Gaia Caligiore
|
Cristina Bosco
|
Alessandro Mazzei
Proceedings of the Seventh Italian Conference on Computational Linguistics (CLiC-it 2020)
Search
Fix author
Co-authors
- Cristina Bosco 1
- Sabina Fontana 1
- Alessandro Mazzei 1
- Raffaele Mineo 1
- Simone Palazzo 1
- show all...