GBC: Gradient-Based Connections for Optimizing Multi-Agent Systems
Xiaocheng Yang, Abdulrahman Alrabah, Dilek Hakkani-Tür, Gokhan Tur
Abstract
Multi-agent systems (MAS) built on large language models (LLMs) provide a promising framework for solving complex tasks through role specialization and structured interaction. However, their performance is often limited by miscoordination and, more fundamentally, the lack of fine-grained credit assignment across agents. Existing approaches typically rely on coarse-grained feedback, making it difficult to identify which agents or interaction steps are responsible for errors. We propose Gradient-Based Connections (GBC), an approach for fine-grained attribution and optimization of multi-agent systems. GBC models a MAS as a computational graph and introduces gradient-based connection weights to quantify the influence of each agent’s output on downstream agents at the token level. By constructing an attribution graph and propagating task-specific loss signals backward, our method enables precise identification of error sources and targeted prompt optimization. We further develop AgentChord, an efficient implementation that leverages prefix-based gradient computation. Experiments on MultiWOZ and τ-bench show that GBC improves multi-agent performance and outperforms strong single-agent and multi-agent baselines, and higher attribution quality is associated with greater optimization effectiveness. Code is available at: https://github.com/yxc-cyber/AgentChord.- Anthology ID:
- 2026.sigdial-1.24
- Volume:
- Proceedings of the 27th Annual Meeting of the Special Interest Group on Discourse and Dialogue
- Month:
- August
- Year:
- 2026
- Address:
- Atlanta, Georgia, USA
- Editors:
- Jinho D. Choi, Yun-Nung Chen, Kotaro Funakoshi, Ali Emami
- Venue:
- SIGDIAL
- SIG:
- SIGDIAL
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 342–356
- Language:
- URL:
- https://preview.aclanthology.org/ingest-lrec/2026.sigdial-1.24/
- DOI:
- Cite (ACL):
- Xiaocheng Yang, Abdulrahman Alrabah, Dilek Hakkani-Tür, and Gokhan Tur. 2026. GBC: Gradient-Based Connections for Optimizing Multi-Agent Systems. In Proceedings of the 27th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 342–356, Atlanta, Georgia, USA. Association for Computational Linguistics.
- Cite (Informal):
- GBC: Gradient-Based Connections for Optimizing Multi-Agent Systems (Yang et al., SIGDIAL 2026)
- PDF:
- https://preview.aclanthology.org/ingest-lrec/2026.sigdial-1.24.pdf