PAKTON: A Multi-Agent Framework for Question Answering in Long Legal Agreements

Raptopoulos Petros, Giorgos Filandrianos, Maria Lymperaiou, Giorgos Stamou


Abstract
Contract review is a complex and time-intensive task that typically demands specialized legal expertise, rendering it largely inaccessible to non-experts. Moreover, legal interpretation is rarely straightforward—ambiguity is pervasive, and judgments often hinge on subjective assessments. Compounding these challenges, contracts are usually confidential, restricting their use with proprietary models and necessitating reliance on open-source alternatives. To address these challenges, we introduce PAKTON: a fully open-source, end-to-end, multi-agent framework with plug-and-play capabilities. PAKTON is designed to handle the complexities of contract analysis through collaborative agent workflows and a novel retrieval-augmented generation (RAG) component, enabling automated legal document review that is more accessible, adaptable, and privacy-preserving. Experiments demonstrate that PAKTON outperforms both general-purpose and pretrained models in predictive accuracy, retrieval performance, explainability, completeness, and grounded justifications as evaluated through a human study and validated with automated metrics.
Anthology ID:
2025.emnlp-main.403
Volume:
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7959–7995
Language:
URL:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.emnlp-main.403/
DOI:
10.18653/v1/2025.emnlp-main.403
Bibkey:
Cite (ACL):
Raptopoulos Petros, Giorgos Filandrianos, Maria Lymperaiou, and Giorgos Stamou. 2025. PAKTON: A Multi-Agent Framework for Question Answering in Long Legal Agreements. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 7959–7995, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
PAKTON: A Multi-Agent Framework for Question Answering in Long Legal Agreements (Petros et al., EMNLP 2025)
Copy Citation:
PDF:
https://preview.aclanthology.org/author-page-yu-wang-polytechnic/2025.emnlp-main.403.pdf
Checklist:
 2025.emnlp-main.403.checklist.pdf