Semantic XPath: Structured Agentic Memory Access for Conversational AI
Yifan Simon Liu, Ruifan Wu, Liam Gallagher, Jiazhou Liang, Armin Toroghi, Scott Sanner
Abstract
Conversational AI (ConvAI) agents increasingly maintain structured memory to support long-term, task-oriented interactions. In-context memory approaches append the growing history to the model input, which scales poorly under context-window limits. RAG-based methods retrieve request-relevant information, but most assume flat memory collections and ignore structure. We propose **Semantic XPath**, a **tree-structured memory module** to access and update structured conversational memory. **Semantic XPath** improves performance over flat-RAG baselines by **176.7%** while using only **9.1%** of the tokens required by in-context memory. We also introduce **SemanticXPath Chat**, an end-to-end ConvAI demo system that visualizes the structured memory and query execution details. Overall, this paper demonstrates a candidate for the next generation of long-term, task-oriented ConvAI systems built on structured memory.- Anthology ID:
- 2026.acl-demo.28
- Volume:
- Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Greg Durrett, Ping Jian
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 286–296
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.acl-demo.28/
- DOI:
- Cite (ACL):
- Yifan Simon Liu, Ruifan Wu, Liam Gallagher, Jiazhou Liang, Armin Toroghi, and Scott Sanner. 2026. Semantic XPath: Structured Agentic Memory Access for Conversational AI. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations), pages 286–296, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- Semantic XPath: Structured Agentic Memory Access for Conversational AI (Liu et al., ACL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.acl-demo.28.pdf