I-GUARD: Interpretability-Guided Parameter Optimization for Adversarial Defense

Mamta Mamta, Oana Cocarascu


Abstract
Transformer-based models are highly vulnerable to adversarial attacks, where even small perturbations can cause significant misclassifications. This paper introduces *I-Guard*, a defense framework to increase the robustness of transformer-based models against adversarial perturbations. *I-Guard* leverages model interpretability to identify influential parameters responsible for adversarial misclassifications. By selectively fine-tuning a small fraction of model parameters, our approach effectively balances performance on both original and adversarial test sets. We conduct extensive experiments on English and code-mixed Hinglish datasets and demonstrate that *I-Guard* significantly improves model robustness. Furthermore, we demonstrate the transferability of *I-Guard* in handling other character-based perturbations.
Anthology ID:
2025.findings-emnlp.1208
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
22173–22188
Language:
URL:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.1208/
DOI:
10.18653/v1/2025.findings-emnlp.1208
Bibkey:
Cite (ACL):
Mamta Mamta and Oana Cocarascu. 2025. I-GUARD: Interpretability-Guided Parameter Optimization for Adversarial Defense. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 22173–22188, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
I-GUARD: Interpretability-Guided Parameter Optimization for Adversarial Defense (Mamta & Cocarascu, Findings 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.findings-emnlp.1208.pdf
Checklist:
 2025.findings-emnlp.1208.checklist.pdf