Song-Chun Zhu
Other people with similar names: Song-chun Zhu
2026
v-HUB: A Benchmark for Video Humor Understanding from Vision and Sound
Zhengpeng Shi | Yanpeng Zhao | Jianqun Zhou | Yuxuan Wang | Qinrong Cui | Wei Bi | Song-Chun Zhu | Bo Zhao | Zilong Zheng
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zhengpeng Shi | Yanpeng Zhao | Jianqun Zhou | Yuxuan Wang | Qinrong Cui | Wei Bi | Song-Chun Zhu | Bo Zhao | Zilong Zheng
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
AI models capable of comprehending humor hold real-world promise—for example, enhancing engagement in human-machine interactions. To gauge and diagnose the capacity of multimodal large language models (MLLMs) for humor understanding, we introduce v-HUB, a novel video humor understanding benchmark. v-HUB comprises a curated collection of non-verbal short videos, reflecting real-world scenarios where humor can be appreciated purely through visual cues. We pair each video clip with rich annotations to support a variety of evaluation tasks and analyses, including a novel study of environmental sound that can enhance humor. To broaden its applicability, we construct an open-ended QA task, making v-HUB readily integrable into existing video understanding task suites. We evaluate a diverse set of MLLMs, from specialized Video-LLMs to versatile OmniLLMs that can natively process audio, covering both open-source and proprietary domains. The experimental results expose the difficulties MLLMs face in comprehending humor from visual cues alone. Our findings also demonstrate that incorporating audio helps with video humor understanding, highlighting the promise of integrating richer modalities for complex video understanding tasks.
JurisBench: A Deep Benchmark for Assessing Large Language Models in Professional Legal Practice
Ziang Chen | Guannan Li | Fanlin Ji | Yipeng Kang | Jiaqi Li | Muhan Zhang | Yangtao Zhang | Li Tianjiao | Jiannan Wang | Xin Guo | Song-Chun Zhu | Bin Ling
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Ziang Chen | Guannan Li | Fanlin Ji | Yipeng Kang | Jiaqi Li | Muhan Zhang | Yangtao Zhang | Li Tianjiao | Jiannan Wang | Xin Guo | Song-Chun Zhu | Bin Ling
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large Language Models (LLMs) have demonstrated strong cross-domain capabilities, yet their competence in specialized professional tasks remains underexamined. Existing legal benchmarks evaluate isolated tasks or exam-style questions, failing to capture the procedural interdependencies and adjudicative rigor inherent in professional practice. To bridge this gap, we construct JurisBench, a vertical, depth-oriented, domain-specific benchmark designed to evaluate LLMs across key stages of Chinese civil litigation. JurisBench introduces a Linear Depth Simulation track that mirrors the cognitive workflow of professional judges through four sequential, dependency-aware phases: Cause of Action prediction, Focus of Disputes identification, Rationale of the Judgment generation, and Result of the Judgment determination. Results reveal an “illusion of competence”: state-of-the-art models exhibit marked performance degradation in end-to-end pipelines due to cascading error propagation. We identify precise statutory grounding as a persistent bottleneck, highlighting a critical gap between fluent linguistic output and judicial reliability. JurisBench shifts evaluation from isolated legal knowledge to workflow-level task execution, providing a diagnostic framework for legal AI and a template for benchmark design in specialized domains.