K-MIND: Korean Multimodal INteraction Data for Dyadic Conversation Analysis
Jae Hee Yang, Yuha Shin, Saim Shin, Je Woo Kim, Jin Yea Jang
Abstract
We present the Korean Multimodal INteraction Data (K-MIND), a large-scale corpus of dyadic Korean dialogue that is designed to capture the multimodal richness of social interaction. The dataset includes 292 participants and 200 sets (935 clips) spanning 115 hours and 30 minutes, all aligned across verbal, paraverbal, and nonverbal modalities such as transcripts, acoustic features, and visual signals. For these modalities, we propose a comprehensive annotation scheme that enables nuanced yet consistent labeling of complex communicative behaviors, balancing theoretical soundness with practical feasibility. We further report analysis results of the corpus, including label distributions, within- and cross-layer analyses. These analyses illuminate the key properties of dyadic K-MIND and demonstrate its utility for advancing research in human–computer interaction as well as in interdisciplinary domains. To ensure continuous refinement, the corpus and framework are being validated in complementary studies and have been extended to triadic interactions (K-MIND Triadic) that model group dynamics, which will be included in upcoming releases.- Anthology ID:
- 2026.lrec-main.715
- Volume:
- Proceedings of the Fifteenth Language Resources and Evaluation Conference
- Month:
- May
- Year:
- 2026
- Address:
- Palma de Mallorca, Spain
- Editors:
- Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
- Venue:
- LREC
- SIG:
- Publisher:
- ELRA Language Resource Association
- Note:
- Pages:
- 9105–9117
- Language:
- URL:
- https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.715/
- DOI:
- Cite (ACL):
- Jae Hee Yang, Yuha Shin, Saim Shin, Je Woo Kim, and Jin Yea Jang. 2026. K-MIND: Korean Multimodal INteraction Data for Dyadic Conversation Analysis. International Conference on Language Resources and Evaluation, main:9105–9117.
- Cite (Informal):
- K-MIND: Korean Multimodal INteraction Data for Dyadic Conversation Analysis (Yang et al., LREC 2026)
- PDF:
- https://preview.aclanthology.org/ingest-lrec/2026.lrec-main.715.pdf