Multidimensional Coding of Multimodal Languaging in Multi-Party Settings
Christophe Parisse, Marion Blondel, Stéphanie Caët, Claire Danet, Coralie Vincent, Aliyah Morgenstern
Abstract
In natural language settings, many interactions include more than two speakers, and real-life interpretation is based on all types of information available in all modalities. This constitutes a challenge for corpus-based analyses because the information in the audio and visual channels must be included in the coding. The goal of the DINLANG project is to tackle that challenge and analyze spontaneous interactions in family dinner settings (two adults and two to three children). The families use either French, or LSF (French sign language). Our aim is to compare how participants share language across the range of modalities found in vocal and visual languaging in coordination with dining. In order to pinpoint similarities and differences, we had to find a common coding tool for all situations (variations from one family to another) and modalities. Our coding procedure incorporates the use of the ELAN software. We created a template organized around participants, situations, and modalities, rather than around language forms. Spoken language transcription can be integrated, when it exists, but it is not mandatory. Data that has been created with another software can be injected in ELAN files if it is linked using time stamps. Analyses performed with the coded files rely on ELAN’s structured search functionalities, which allow to achieve fine-grained temporal analyses and which can be completed by using spreadsheets or R language.- Anthology ID:
- 2022.lrec-1.297
- Volume:
- Proceedings of the Thirteenth Language Resources and Evaluation Conference
- Month:
- June
- Year:
- 2022
- Address:
- Marseille, France
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association
- Note:
- Pages:
- 2781–2787
- Language:
- URL:
- https://aclanthology.org/2022.lrec-1.297
- DOI:
- Cite (ACL):
- Christophe Parisse, Marion Blondel, Stéphanie Caët, Claire Danet, Coralie Vincent, and Aliyah Morgenstern. 2022. Multidimensional Coding of Multimodal Languaging in Multi-Party Settings. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 2781–2787, Marseille, France. European Language Resources Association.
- Cite (Informal):
- Multidimensional Coding of Multimodal Languaging in Multi-Party Settings (Parisse et al., LREC 2022)
- PDF:
- https://preview.aclanthology.org/ingestion-script-update/2022.lrec-1.297.pdf