arXiv:2605.11453cs.MAcs.AI2026-05被引 1

用谱分析预测多智能体通信结构的稳定性,提前识别哪种拓扑易出错。

Predictive Maps of Multi-Agent Reasoning: A Successor-Representation Spectrum for LLM Communication Topologies

论文配图:Predictive Maps of Multi-Agent Reasoning: A Successor-Representation Spectrum for LLM Communication Topologies
图 1 · 摘自论文原文
  • 基于通信图的继承表示谱特性,构建可预判系统行为的诊断工具。
  • 条件数完美预测抗扰性排序,谱半径与累积误差呈反向关系。
  • 首次实现对大模型多智能体系统漂移问题的结构化预判,适合部署优化者。

当前部署多智能体大语言模型系统时,需在链式、星型、网状等通信拓扑间选择,但缺乏推理前的诊断手段来判断何种拓扑会加剧漂移、收敛共识或保持鲁棒性。现有评估仅事后进行,且局限于特定任务。本文提出基于继承表示 $M = (I - γP)^{-1}$ 的结构诊断方法,将矩阵的谱半径 $ρ(M)$、谱间隙 $Δ(M)$ 与条件数 $κ(M)$ 与三类失效模式关联。推导了链式、星型和网状拓扑在行随机归一化下的闭式谱,并在使用 Qwen2.5-7B-Instruct 的 12 步结构状态追踪任务上,通过 100 次独立实验验证。条件数对扰动鲁棒性排序预测准确率 $r_s = 1.0$;谱间隙部分预测共识动态,$r_s = 0.5$;谱半径与累积误差呈完全反向关系,$r_s = -1.0$。该反向现象源于线性谱对非压缩偏差漂移无感,因此提出仿射噪声扩展模型以恢复经验排序。本研究为多智能体大模型系统提供了首个可表征、关注漂移的结构性诊断框架,与经典谱理论和共识理论并列。

原文摘要 · Abstract (English)

Practitioners deploying multi-agent large language model (LLM) systems must currently choose between communication topologies such as chain, star, mesh, and richer variants without any pre-inference diagnostic for which topology will amplify drift, converge to consensus, or remain robust under perturbation. Existing evaluation answers these questions only post hoc and only for the task measured. We introduce a structural diagnostic for multi-agent LLM communication graphs based on the successor representation $M = (I - γP)^{-1}$ of the row-stochastic communication operator, and we connect three of its spectral quantities, the spectral radius $ρ(M)$, the spectral gap $Δ(M)$, and the condition number $κ(M)$, to three distinct failure modes. We derive closed-form spectra for the chain, star, and mesh under row-stochastic normalization, and validate the predictions on a 12-step structured state-tracking task with Qwen2.5-7B-Instruct over 100 independent trials. The condition number is a perfect rank-order predictor of empirical perturbation robustness ($r_s = 1.0$); the spectral gap partially predicts consensus dynamics ($r_s = 0.5$); and the spectral radius is perfectly \emph{inverted} with respect to cumulative error ($r_s = -1.0$). We trace this inversion to a regime in which linear spectra are blind to non-contracting bias drift, and we propose an affine-noise extension of the predictive map that recovers the empirical ordering. We read this as a first step toward representational, drift-aware structural diagnostics for multi-agent LLM systems, sitting alongside classical spectral and consensus theory.

多智能体谱分析大模型部署通信拓扑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。