Did Somebody Say ‘Gest-IT’? A Pilot Exploration of Multimodal Data Management
Ludovica Pannitto, Lorenzo Albanesi, Laura Marion, Federica Martines, Carmelo Caruso, Claudia Bianchini, Francesca Masini, Caterina Mauri
Abstract
The paper presents a pilot exploration of the construction, management and analysis of a multimodal corpus. Through athree-layer annotation that provides orthographic, prosodic, and gestural transcriptions, the gest-IT resource allows oneto investigate the variation of gesture-making patterns in conversations between sighted people and people with visualimpairment. After discussing the transcription methods and technical procedures employed in our study, we will propose aunified CoNLL-U corpus and indicate our future steps.- Anthology ID:
- 2024.clicit-1.80
- Volume:
- Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024)
- Month:
- December
- Year:
- 2024
- Address:
- Pisa, Italy
- Editors:
- Felice Dell'Orletta, Alessandro Lenci, Simonetta Montemagni, Rachele Sprugnoli
- Venue:
- CLiC-it
- SIG:
- Publisher:
- CEUR Workshop Proceedings
- Note:
- Pages:
- 735–745
- Language:
- URL:
- https://preview.aclanthology.org/landing_page/2024.clicit-1.80/
- DOI:
- Cite (ACL):
- Ludovica Pannitto, Lorenzo Albanesi, Laura Marion, Federica Martines, Carmelo Caruso, Claudia Bianchini, Francesca Masini, and Caterina Mauri. 2024. Did Somebody Say ‘Gest-IT’? A Pilot Exploration of Multimodal Data Management. In Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024), pages 735–745, Pisa, Italy. CEUR Workshop Proceedings.
- Cite (Informal):
- Did Somebody Say ‘Gest-IT’? A Pilot Exploration of Multimodal Data Management (Pannitto et al., CLiC-it 2024)
- PDF:
- https://preview.aclanthology.org/landing_page/2024.clicit-1.80.pdf