PAC-BENCH: Evaluating Multi-Agent Collaboration under Privacy Constraints
Minjun Park, Donghyun Kim, Hyeonjong Ju, Seungwon Lim, Dongwook Choi, Taeyoon Kwon, Minju Kim, Jinyoung Yeo
Abstract
We are entering an era in which individuals and organizations increasingly deploy dedicated AI agents that interact and collaborate with other agents.However, the dynamics of multi-agent collaboration under privacy constraints remain poorly understood.In this work, we present PAC-Bench, a benchmark for systematic evaluation of multi-agent collaboration under privacy constraints.Experiments on PAC-Bench show that privacy constraints substantially degrade collaboration performance and make outcomes depend more on the initiating agent than the partner.Further analysis reveals that this degradation is driven by recurring coordination breakdowns, including early-stage privacy violations, overly conservative abstraction, and privacy-induced hallucinations.Together, our findings identify privacy-aware multi-agent collaboration as a distinct and unresolved challenge that requires new coordination mechanisms beyond existing agent capabilities.- Anthology ID:
- 2026.findings-acl.1552
- Volume:
- Findings of the Association for Computational Linguistics: ACL 2026
- Month:
- July
- Year:
- 2026
- Address:
- San Diego, California, United States
- Editors:
- Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 31030–31056
- Language:
- URL:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1552/
- DOI:
- Cite (ACL):
- Minjun Park, Donghyun Kim, Hyeonjong Ju, Seungwon Lim, Dongwook Choi, Taeyoon Kwon, Minju Kim, and Jinyoung Yeo. 2026. PAC-BENCH: Evaluating Multi-Agent Collaboration under Privacy Constraints. In Findings of the Association for Computational Linguistics: ACL 2026, pages 31030–31056, San Diego, California, United States. Association for Computational Linguistics.
- Cite (Informal):
- PAC-BENCH: Evaluating Multi-Agent Collaboration under Privacy Constraints (Park et al., Findings 2026)
- PDF:
- https://preview.aclanthology.org/ingest-acl/2026.findings-acl.1552.pdf