@inproceedings{hou-etal-2025-scaling,
    title = "Scaling {LLM}s' Social Reasoning: Sprinkle Cognitive ``Aha Moment'' into Fundamental Long-thought Logical Capabilities",
    author = "Hou, Guiyang  and
      Zhang, Wenqi  and
      Zheng, Zhe  and
      Shen, Yongliang  and
      Lu, Weiming",
    editor = "Che, Wanxiang  and
      Nabende, Joyce  and
      Shutova, Ekaterina  and
      Pilehvar, Mohammad Taher",
    booktitle = "Findings of the Association for Computational Linguistics: ACL 2025",
    month = jul,
    year = "2025",
    address = "Vienna, Austria",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingestion-acl-25/2025.findings-acl.162/",
    pages = "3126--3138",
    ISBN = "979-8-89176-256-5",
    abstract = "Humans continually engage in reasoning about others' mental states, a capability known as Theory of Mind (ToM), is essential for social interactions. While this social reasoning capability emerges naturally in human cognitive development, how has the social reasoning capability of Large Language Models (LLMs) evolved during their development process? Various datasets have been proposed to assess LLMs' social reasoning capabilities, but each is designed with a distinct focus, and none have explored how models' social reasoning capabilities evolve during model size scaling or reasoning tokens scaling. In light of this, we optimize the evaluation of LLMs' social reasoning from both data and model perspectives, constructing progressively difficult levels of social reasoning data and systematically exploring how LLMs' social reasoning capabilities evolve. Furthermore, through an in-depth analysis of DeepSeek-R1{'}s reasoning trajectories, we identify notable cognitive ``Aha Moment'' and the reasons for its reasoning errors. Experiments reveal that long-thought logical capabilities and cognitive thinking are key to scaling LLMs' social reasoning capabilities. By equipping the Qwen2.5-32B-Instruct model with long-thought logical capabilities and cognitive thinking, we achieve an improvement of 19.0 points, attaining social reasoning performance comparable to o1-preview model."
}