StandUp4AI: A New Multilingual Dataset for Humor Detection in Stand-up Comedy Videos

Valentin Barriere, Nahuel Gomez, Léo Hemamou, Sofia Callejas, Brian Ravenet


Abstract
Aiming towards improving current computational models of humor detection, we propose a new multimodal dataset of stand-up comedies, in seven languages: English, French, Spanish, Italian, Portuguese, Hungarian and Czech. Our dataset of more than 330 hours %, is at the time of writing the biggest available for this type of task, and the most diverse. The whole dataset is automatically annotated in laughter (from the audience), and the subpart left for model validation is manually annotated.% Contrary to contemporary approaches, we do not frame the task of humor detection as a binary sequence classification, but as word-level sequence labeling, in order to take into account all the context of the sequence and to capture the continuous joke tagging mechanism typically occurring in natural conversations. As par with unimodal baselines results, we propose a method for e propose a method to enhance the automatic laughter detection based on Audio Speech Recognition errors. Our code and data are available online: https://tinyurl.com/EMNLPHumourStandUpAnonym
Anthology ID:
2025.findings-emnlp.919
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
16951–16959
Language:
URL:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.919/
DOI:
10.18653/v1/2025.findings-emnlp.919
Bibkey:
Cite (ACL):
Valentin Barriere, Nahuel Gomez, Léo Hemamou, Sofia Callejas, and Brian Ravenet. 2025. StandUp4AI: A New Multilingual Dataset for Humor Detection in Stand-up Comedy Videos. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 16951–16959, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
StandUp4AI: A New Multilingual Dataset for Humor Detection in Stand-up Comedy Videos (Barriere et al., Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.919.pdf
Checklist:
 2025.findings-emnlp.919.checklist.pdf