MemoPhishAgent: Memory-Augmented Multi-Modal LLM Agent for Phishing URL Detection
Xuan Chen, Hao Liu, Tao Yuan, Mehran Kafai, Piotr Habas, Xiangyu Zhang
Abstract
Traditional phishing website detection relies on static heuristics or reference lists, which lag behind rapidly evolving attacks. While recent systems incorporate large language models (LLMs), they are still prompt-based, deterministic pipelines that underutilize reasoning capability.We present MemoPhishAgent (MPA), a memory-augmented multi-modal LLM agent that dynamically orchestrates phishing-specific tools and leverages episodic memories of past reasoning trajectories to guide decisions on recurring and novel threats.On two public datasets, MPA outperforms three state-of-the-art (SOTA) baselines, improving recall by 13.6%.To better reflect realistic, user-facing phishing detection performance, we further evaluate MPA on a benchmark of real-world suspicious URLs actively crawled from five social media platforms, where it improves recall by 20%.Detailed analysis shows episodic memory contributes up to 27% recall gain without introducing additional computational overhead.The ablation study confirms the necessity of the agent-based approach compared to prompt-based baselines and validates the effectiveness of our tool design.Finally, MPA is deployed in production, processing ∼60K targeted high-risk URLs weekly, and achieving 91.44% recall, providing proactive protection for millions of customers.Together, our results show that combining multi-modal reasoning with episodic memory yields robust, adaptable phishing detection in realistic user-exposure settings.Our implementation is available at https://github.com/XuanChen-xc/MemoPhishAgent.git.- Anthology ID:
- 2026.acl-industry.84
- Volume:
- Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, USA
- Editors:
- Yunyao Li, Georg Rehm, Mei Tu
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1182–1196
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.acl-industry.84/
- DOI:
- Cite (ACL):
- Xuan Chen, Hao Liu, Tao Yuan, Mehran Kafai, Piotr Habas, and Xiangyu Zhang. 2026. MemoPhishAgent: Memory-Augmented Multi-Modal LLM Agent for Phishing URL Detection. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026), pages 1182–1196, San Diego, California, USA. Association for Computational Linguistics.
- Cite (Informal):
- MemoPhishAgent: Memory-Augmented Multi-Modal LLM Agent for Phishing URL Detection (Chen et al., ACL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.acl-industry.84.pdf