Ziqi Ding
2026
Debiasing LLMs by Masking Unfairness-Driving Attention Heads
Tingxu Han | Wei Song | Ziqi Ding | Ziming Li | Chunrong Fang | Yuekang Li | Dongfang Liu | Zhenyu Chen | Zhenting Wang
Findings of the Association for Computational Linguistics: ACL 2026
Tingxu Han | Wei Song | Ziqi Ding | Ziming Li | Chunrong Fang | Yuekang Li | Dongfang Liu | Zhenyu Chen | Zhenting Wang
Findings of the Association for Computational Linguistics: ACL 2026
Large language models (LLMs) increasingly mediate decisions in domains where unfair treatment of demographic groups is unacceptable. Existing work probes when biased outputs appear, but gives little insight into the mechanisms that generate them, leaving existing mitigations largely fragile. In this paper, we conduct a systematic investigation of LLM unfairness and propose DiffHeads—a lightweight debiasing framework for LLMs. We first compare Direct-Answer (DA) prompting to Chain-of-Thought (CoT) prompting across eight representative open- and closed-source LLMs. DA will trigger the nature-bias component of the LLM and reduce measured unfairness by 391.9%- 534.5% in both one- and two-turn dialogues. Next, we define a token-to-head contribution score that traces each token’s influence back to individual attention heads. This reveals a small cluster of bias heads that activate under DA but stay largely dormant with CoT, providing the first causal link between prompting strategy and bias emergence. Finally, building on this insight, we propose DiffHeads, which identify bias heads through differential activation analysis between DA and CoT and selectively mask only those heads. DiffHeads reduces unfairness by 49.4%, and 40.3% under DA and CoT, respectively, without harming model utility.
2025
TombRaider: Entering the Vault of History to Jailbreak Large Language Models
Junchen Ding | Jiahao Zhang | Yi Liu | Ziqi Ding | Gelei Deng | Yuekang Li
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Junchen Ding | Jiahao Zhang | Yi Liu | Ziqi Ding | Gelei Deng | Yuekang Li
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
**Warning: This paper contains content that may involve potentially harmful behaviours, discussed strictly for research purposes.**Jailbreak attacks can hinder the safety of Large Language Model (LLM) applications, especially chatbots. Studying jailbreak techniques is an important AI red teaming task for improving the safety of these applications. In this paper, we introduce TombRaider, a novel jailbreak technique that exploits the ability to store, retrieve, and use historical knowledge of LLMs. TombRaider employs two agents, the inspector agent to extract relevant historical information and the attacker agent to generate adversarial prompts, enabling effective bypassing of safety filters. We intensively evaluated TombRaider on six popular models. Experimental results showed that TombRaider could outperform state-of-the-art jailbreak techniques, achieving nearly 100% attack success rates (ASRs) on bare models and maintaining over 55.4% ASR against defence mechanisms. Our findings highlight critical vulnerabilities in existing LLM safeguards, underscoring the need for more robust safety defences.
2023
NewsSense: Reference-free Verification via Cross-document Comparison
Jeremiah Milbauer | Ziqi Ding | Zhijin Wu | Tongshuang Wu
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Jeremiah Milbauer | Ziqi Ding | Zhijin Wu | Tongshuang Wu
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
We present NewsSense, a novel sensemaking tool and reading interface designed to collect and integrate information from multiple news articles on a central topic. NewsSense provides “reference-free verification,” augmenting a central grounding article of the user’s choice by: (1) linking to related articles from different sources; and (2) providing inline highlights on how specific claims are either supported or contradicted by information from other articles. Using NewsSense, users can seamlessly digest and cross-check multiple information sources without disturbing their natural reading flow. Our pilot study shows that NewsSense has the potential to help users identify key information, verify the credibility of news articles, explore different perspectives, and understand what content is supported, contradicted, or missing.