Shengjie Zhao


2026

The slow thinking paradigm has been widely validated to enhance the reasoning capabilities of Large Language Models (LLMs), but it introduces notable reasoning inefficiencies: models often overthink simple tasks while prematurely shifting their reasoning paths when addressing complex problems. To address this, we propose AdapThink, a simple yet efficient framework for adaptive reasoning preference control. Unlike methods imposing uniform length constraints, AdapThink dynamically adjusts reflection preferences based on group-level distributional statistics of reasoning length and reflection intensity. We further introduce a dispersion-based diversity sampling mechanism that maximizes the geometric spread of reasoning patterns, accelerating learning through exposure to diverse problem-solving strategies. Across mathematical reasoning and code generation benchmarks, AdapThink reduces average response length by 17.1%-21.4% while improving performance by 6.12-6.59 points under 32K token budgets, demonstrating superior efficiency and robustness against reward hacking compared to strong baselines.
This paper presents our 1st-place system for the Shared Task on Fine-Grained Toxicity Detection in Online Gaming (GameTox) at the 9th EEUCA Workshop, co-located with ACL 2026. The task targets 6-class fine-grained toxic intent classification on the official GameTox dataset, comprising 53,000 real-world World of Tanks chat utterances. We propose a three-stage progressive training framework built on XLM-RoBERTa-large: (1) gaming domain adaptive MLM pre-training, (2) multilingual toxicity transfer fine-tuning, and (3) supervised contrastive learning (SCL)-enhanced target task tuning. We further incorporate LLM-driven data augmentation and long-tailed class synthesis. Our system achieves a Macro F1 of 0.7041, ranking 1st among 35 teams. Ablation studies validate each module’s contribution, and we release our code to facilitate follow-up research.

2025

Self-consciousness, the introspection of one’s existence and thoughts, represents a high-level cognitive process. As language models advance at an unprecedented pace, a critical question arises: Are these models becoming self-conscious? Drawing upon insights from psychological and neural science, this work presents a practical definition of self-consciousness for language models and refines ten core concepts. Our work pioneers an investigation into self-consciousness in language models by, for the first time, leveraging structural causal games to establish the functional definitions of the ten core concepts. Based on our definitions, we conduct a comprehensive four-stage experiment: quantification (evaluation of ten leading models), representation (visualization of self-consciousness within the models), manipulation (modification of the models’ representation), and acquisition (fine-tuning the models on core concepts). Our findings indicate that although models are in the early stages of developing self-consciousness, there is a discernible representation of certain concepts within their internal mechanisms. However, these representations of self-consciousness are hard to manipulate positively at the current stage, yet they can be acquired through targeted fine-tuning.

2024

Causal reasoning is a cornerstone of how humans interpret the world. To model and reason about causality, causal graphs offer a concise yet effective solution. Given the impressive advancements in language models, a crucial question arises: can they really understand causal graphs? To this end, we pioneer an investigation into language models’ understanding of causal graphs. Specifically, we develop a framework to define causal graph understanding, by assessing language models’ behaviors through four practical criteria derived from diverse disciplines (e.g., philosophy and psychology). We then develop CLEAR, a novel benchmark that defines three complexity levels and encompasses 20 causal graph-based tasks across these levels. Finally, based on our framework and benchmark, we conduct extensive experiments on six leading language models and summarize five empirical findings. Our results indicate that while language models demonstrate a preliminary understanding of causal graphs, significant potential for improvement remains.