Wenjun Huang
2026
LUNE: Efficient LLM Unlearning via LoRA Fine-Tuning with Negative Examples
Yezi Liu | Hanning Chen | Wenjun Huang | Yang Ni | Mohsen Imani
Findings of the Association for Computational Linguistics: ACL 2026
Yezi Liu | Hanning Chen | Wenjun Huang | Yang Ni | Mohsen Imani
Findings of the Association for Computational Linguistics: ACL 2026
Large Language Models (LLMs) encode vast factual knowledge, yet their inability to selectively forget specific information hinders privacy protection, bias mitigation, and post-deployment correction. We present LoRA-based Unlearning with Negative Examples (LUNE), a lightweight framework that performs negative-only unlearning by updating only low-rank adapters while freezing the backbone, thereby localizing edits and avoiding disruptive global changes. Leveraging Low-Rank Adaptation (LoRA), LUNE targets intermediate representations to suppress (or replace) requested knowledge with an order-of-magnitude lower compute and memory than full fine-tuning or direct weight editing. Extensive experiments on multiple factual unlearning tasks show that LUNE: (I) achieves effectiveness comparable to full fine-tuning and memory-editing methods; and (II) reduces computational cost by about an order of magnitude.
DemMA: Dementia Multi-Turn Dialogue Agent with Expert-Guided Reasoning and Action Simulation
Yutong Song | Jiang Wu | Kazi Shaharair Sharif | Pengfei Zhang | Wenjun Huang | Honghui Xu | Nikil Dutt | Amir M. Rahmani
Findings of the Association for Computational Linguistics: ACL 2026
Yutong Song | Jiang Wu | Kazi Shaharair Sharif | Pengfei Zhang | Wenjun Huang | Honghui Xu | Nikil Dutt | Amir M. Rahmani
Findings of the Association for Computational Linguistics: ACL 2026
Simulating dementia patients with large language models (LLMs) is challenging due to the need to jointly model cognitive impairment, emotional dynamics, and nonverbal behaviors over long conversations. We present DemMA, an expert-guided dementia dialogue agent for high-fidelity multi-turn patient simulation. DemMA constructs clinically grounded dementia personas by integrating pathology information, personality traits, and subtype-specific memory-status personas informed by clinical experts. To move beyond text-only simulation, DemMA explicitly models nonverbal behaviors, including motion, facial expressions, and vocal cues. We further introduce a Chain-of-Thought distillation framework that trains a single LLM to jointly generate reasoning traces, patient utterances, and aligned behavioral actions within one forward pass, enabling efficient deployment without multi-agent inference.
Music Audio-Visual Question Answering Requires Specialized Multimodal Designs
Wenhao You | Xingjian Diao | Wenjun Huang | Chunhui Zhang | Keyi Kong | Weiyi Wu | Chiyu Ma | Zhongyu Ouyang | Tingxuan Wu | Ming Cheng | Soroush Vosoughi | Jiang Gui
Findings of the Association for Computational Linguistics: ACL 2026
Wenhao You | Xingjian Diao | Wenjun Huang | Chunhui Zhang | Keyi Kong | Weiyi Wu | Chiyu Ma | Zhongyu Ouyang | Tingxuan Wu | Ming Cheng | Soroush Vosoughi | Jiang Gui
Findings of the Association for Computational Linguistics: ACL 2026
While recent Multimodal Large Language Models exhibit impressive capabilities for general multimodal tasks, specialized domains like music necessitate tailored approaches. Music Audio-Visual Question Answering (Music AVQA) particularly underscores this, presenting unique challenges with its continuous, densely layered audio-visual content, intricate temporal dynamics, and the critical need for domain-specific knowledge. Through a systematic analysis of Music AVQA datasets and methods, this paper identifies that specialized input processing, architectures incorporating dedicated spatial-temporal designs, and music-specific modeling strategies are critical for success in this domain. Our study provides valuable insights for researchers by highlighting effective design patterns empirically linked to strong performance, proposing concrete future directions for incorporating musical priors, and aiming to establish a robust foundation for advancing multimodal musical understanding. We aim to encourage further research in this area and provide a GitHub repository of relevant works: https://github.com/WenhaoYou1/Survey4MusicAVQA.