DecepBench: Benchmarking Multimodal Deception Detection
Ethan Braverman, Vittesh Maganti, Nysa Lalye, Akhil Ganti, Michael Lu, Kevin Zhu, Vasu Sharma, Sean O’Brien
Abstract
Deception detection is crucial in domains such as security, forensics, and legal proceedings, as well as to ensure the reliability of AI systems. However, current approaches are limited by the lack of generalizable and interpretable benchmarks built on large and diverse datasets. To address this gap, we introduce DecepBench, a comprehensive and robust benchmark for multimodal deception detection. DecepBench includes an enhanced version of the DOLOS dataset, the largest game-show deception dataset (1,700 labeled video clips with audio). We augment each video clip with transcripts, introducing a third modality (text) and incorporating deception-related features identified in psychological research. We employ explainable methods to evaluate the relevance of key deception cues, providing insights into model limitations and guiding future improvements. Our enhancements to DOLOS, combined with these interpretable analyses, yield improved performance and a deeper understanding of multimodal deception detection.- Anthology ID:
- 2025.sicon-1.3
- Volume:
- Proceedings of the Third Workshop on Social Influence in Conversations (SICon 2025)
- Month:
- July
- Year:
- 2025
- Address:
- Vienna, Austria
- Editors:
- James Hale, Brian Deuksin Kwon, Ritam Dutt
- Venues:
- SICon | WS
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 50–64
- Language:
- URL:
- https://preview.aclanthology.org/acl25-workshop-ingestion/2025.sicon-1.3/
- DOI:
- Cite (ACL):
- Ethan Braverman, Vittesh Maganti, Nysa Lalye, Akhil Ganti, Michael Lu, Kevin Zhu, Vasu Sharma, and Sean O’Brien. 2025. DecepBench: Benchmarking Multimodal Deception Detection. In Proceedings of the Third Workshop on Social Influence in Conversations (SICon 2025), pages 50–64, Vienna, Austria. Association for Computational Linguistics.
- Cite (Informal):
- DecepBench: Benchmarking Multimodal Deception Detection (Braverman et al., SICon 2025)
- PDF:
- https://preview.aclanthology.org/acl25-workshop-ingestion/2025.sicon-1.3.pdf