arXiv:2605.03310cs.MAcs.LG2026-05被引 2

将协调设计为可配置的架构层,提升大模型多智能体系统的稳定性。

Coordination as an Architectural Layer for LLM-Based Multi-Agent Systems

论文配图:Coordination as an Architectural Layer for LLM-Based Multi-Agent Systems
图 1 · 摘自论文原文
  • 把协调机制作为独立架构层,与智能体逻辑分离
  • 在100个市场测试中识别出三种有效配置,达成成本-质量权衡最优
  • 提供可复现的评估方法,适合系统设计者和可靠性研究者

多智能体大模型系统在生产环境中的失败率高达41%至87%,主要源于协调缺陷而非基础模型能力。现有方法或仅描述故障模式,或提供声明式编排工具,均无法建立协调配置与可预测故障特征之间的原则性映射。本文主张将协调视为可配置的架构层,独立于智能体逻辑和信息访问,实现架构层面的推理。通过基于预测市场的信息控制设计,在固定模型(claude-opus-4-6)、固定工具、固定输出上限和固定提示模板下,测试五种协调配置。利用穆尔菲分解的布里尔分数,区分校准性与判别力,使配置即使在总分一致时仍具可区分签名。在100个训练截止后已结算的Polymarket二元市场中,报告了穆尔菲签名、成本-质量帕累托前沿、条件分类分析及自助法功率投影。五种预设预测中有三种方向成立;两种配置在该范围内主导帕累托前沿;探索性自助区间区分共识一致性与其他配置,但成对检验在n=100时不满足邦弗朗尼校正。同时在Foresight Arena部署相同配置,启用网络搜索,作为链上复现通道并行积累数据。代码、追踪数据集与生产代理均已发布。本工作定位为方法论验证的首次实例,非跨模型通用结论。

原文摘要 · Abstract (English)

Multi-agent LLM systems fail in production at rates between 41% and 87%, mostly due to coordination defects rather than base-model capability. Existing responses split between cataloguing failure modes empirically and shipping declarative orchestration frameworks as engineering tools; neither delivers a principled mapping from coordination configuration to predictable failure-mode signature. We argue that coordination should be treated as a configurable architectural layer, separable from agent logic and from information access, enabling architectural reasoning rather than only engineering productivity. We instantiate this with an information-controlled design on prediction markets: a single LLM, fixed tools, fixed per-call output cap, and fixed prompt template across five reference coordination configurations, with total compute per question treated as an endogenous architectural output. The Murphy decomposition of the Brier score separates calibration from discriminative power, so configurations leave distinguishable signatures even when aggregate scores coincide. On 100 Polymarket binary markets resolved after the model's training cutoff (claude-opus-4-6) we report Murphy signatures, a cost-quality Pareto frontier, category-conditioned analysis, and a bootstrap power-projection. Three of five pre-specified predictions are upheld in direction; two configurations dominate the Pareto frontier within this regime; exploratory bootstrap intervals separate consensus alignment from others, though pairwise tests do not survive Bonferroni correction at n=100. We also deploy the same configurations as live agents on Foresight Arena under web-search-enabled conditions, as an on-chain replication channel accumulating in parallel. Harness, trace dataset, and production agents are released. We position this as a methodology-validating first instantiation, not a general cross-model claim.

多智能体协调机制系统可靠性架构设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。