Carlos Busso
2026
Sentipolis: Emotion-Aware Agents for Social Simulations
Chiyuan Fu | Lyuhao Chen | Yunze Xiao | Weihao Xuan | Carlos Busso | Mona T. Diab
Findings of the Association for Computational Linguistics: ACL 2026
Chiyuan Fu | Lyuhao Chen | Yunze Xiao | Weihao Xuan | Carlos Busso | Mona T. Diab
Findings of the Association for Computational Linguistics: ACL 2026
LLM agents are increasingly used for social simulation, yet emotion is often treated as a transient cue, causing emotional amnesia and weak long-horizon continuity. We present Sentipolis, a framework for emotionally stateful agents that integrates continuous Pleasure-Arousal-Dominance (PAD) representation, dual-speed emotion dynamics, and emotion–memory coupling. Across thousands of interactions over multiple base models and evaluators, Sentipolis improves emotionally grounded behavior, boosting communication, and emotional continuity. Gains are model-dependent: believability increases for higher-capacity models but can drop for smaller ones, and emotion-awareness can mildly reduce adherence to social norms, reflecting a human-like tension between emotion-driven behavior and rule compliance in social simulation. Network-level diagnostics show reciprocal, moderately clustered, and temporally stable relationship structures, supporting the study of cumulative social dynamics such as alliance formation and gradual relationship change.
On the Fallacy of Global Token Perplexity in Spoken Language Model Evaluation
Chan-Jan Hsu | Liang-Hsuan Tseng | Yi-Cheng Lin | Yen-Chun Kuo | Ju-Chieh Chou | Kai-Wei Chang | Hung-yi Lee | Carlos Busso
Findings of the Association for Computational Linguistics: ACL 2026
Chan-Jan Hsu | Liang-Hsuan Tseng | Yi-Cheng Lin | Yen-Chun Kuo | Ju-Chieh Chou | Kai-Wei Chang | Hung-yi Lee | Carlos Busso
Findings of the Association for Computational Linguistics: ACL 2026
Generative spoken language models pretrained on large-scale raw audio can continue a speech prompt with appropriate content while preserving attributes like speaker and emotion, serving as foundation models for spoken dialogue. In prior literature, these models are often evaluated using “global token perplexity”, which directly applies the text perplexity formulation to speech tokens. However, this practice overlooks fundamental differences between speech and text modalities, possibly leading to an underestimation of the speech characteristics. In this work, we propose a variety of likelihood- and generative-based evaluation methods that serve in place of naive global token perplexity. We demonstrate that the proposed evaluations more faithfully reflect perceived generation quality, as evidenced by stronger correlations with human-rated mean opinion scores (MOS). When assessed under the new metrics, the relative performance landscape of spoken language models is reshaped, revealing a significantly reduced gap between the best-performing model and the human topline. Together, these results suggest that appropriate evaluation is critical for accurately assessing progress in spoken language modeling.