LOTUS: Evolving Multimodal Unlearning via Hyperbolic Entailment and Lorentz Transport
Zekun Wang, Jingjie Zeng, Yingxu Li, Hongfei Lin, Liang Yang
Abstract
Multimodal Large Language Models (MLLMs) face critical privacy challenges due to the indiscriminate memorization of sensitive data. Existing unlearning methods, largely adapted from Euclidean paradigms, suffer from a geometric mismatch: they fail to disentangle specific instances from general concepts, causing catastrophic forgetting or unsafe substitution. We introduce LOTUS (Lorentz Transport for Unlearning Strategies), a framework for surgical semantic pruning within the Lorentz manifold. Leveraging hyperbolic geometry’s hierarchical nature, LOTUS employs an Inverted Entailment Cone Loss to sever the inheritance of sensitive concepts and a Lorentz Transport mechanism to align pruned features within the tangent space, ensuring compatibility with Euclidean backbones via a safety refusal prior. Experiments on MLLMU-Bench with LLaVA and Qwen show that LOTUS significantly outperforms baselines, effectively erasing targeted visual data while preserving general utility.- Anthology ID:
- 2026.acl-long.2195
- Volume:
- Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 47525–47538
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.acl-long.2195/
- DOI:
- Cite (ACL):
- Zekun Wang, Jingjie Zeng, Yingxu Li, Hongfei Lin, and Liang Yang. 2026. LOTUS: Evolving Multimodal Unlearning via Hyperbolic Entailment and Lorentz Transport. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 47525–47538, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- LOTUS: Evolving Multimodal Unlearning via Hyperbolic Entailment and Lorentz Transport (Wang et al., ACL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.acl-long.2195.pdf