One Joke to Rule them All? On the (Im)possibility of Generalizing Humor Detection

Mor Turgeman, Chen Shani, Dafna Shahaf


Abstract
Humor is a complex form of communication that remains challenging for machines. Despite its broadness, most existing research on computational humor traditionally focused on modeling one specific type of humor. In this work, we wish to understand whether competence on specific humor tasks confers any ability to transfer to novel, unseen types; in other words, is this fragmentation inevitable? This question is especially timely as new humor types continuously emerge in online contexts (e.g., memes, anti-humor, AI fails). If LLMs are to keep up with this evolving landscape, they must be able to capture deeper, transferable mechanisms. To investigate this, we conduct a series of transfer learning experiments across four datasets, representing different humor tasks. We explore varied diversity settings (varying between 1-3 datasets in training, testing on a novel one). Experiments show that models are capable of some transfer, reaching up to 75% accuracy on binary unseen datasets; training on diverse sources improves transferability (1.88-4.05%) with minimal-to-no drop in in-domain performance. Somewhat surprisingly, the one dataset (Dad Jokes) emerges as the best enabler of transfer, but the hardest one to transfer to. We release data and code.
Anthology ID:
2026.chum-1.1
Volume:
Proceedings of the 2nd Workshop on Computational Humor (CHum 2026)
Month:
July
Year:
2026
Address:
Online
Editors:
Ori Amir, Christian F. Hempelmann, Julia Rayz, Tiansi Dong, Tristan Miller
Venues:
chum | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–28
Language:
URL:
https://preview.aclanthology.org/ingest-acl-workshops/2026.chum-1.1/
DOI:
Bibkey:
Cite (ACL):
Mor Turgeman, Chen Shani, and Dafna Shahaf. 2026. One Joke to Rule them All? On the (Im)possibility of Generalizing Humor Detection. In Proceedings of the 2nd Workshop on Computational Humor (CHum 2026), pages 1–28, Online. Association for Computational Linguistics.
Cite (Informal):
One Joke to Rule them All? On the (Im)possibility of Generalizing Humor Detection (Turgeman et al., chum 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-acl-workshops/2026.chum-1.1.pdf