arXiv:2609.02264cs.AIcs.LG2026-09

用编码簿设计智能体通信结构,提速降耗还更准。

Codebook Agent: Amortized Topology Design for LLM Multi-Agent Systems

论文配图:Codebook Agent: Amortized Topology Design for LLM Multi-Agent Systems
图 1 · 摘自论文原文
  • 用向量量化压缩常用拓扑,建立16项固定代码簿,避免重复搜索。
  • 根据查询动态选代码,单次前向传播生成最优拓扑,2.4毫秒完成。
  • 在6个基准上平均准确率84.6%,比之前方法高1.6%,节省超20%令牌。

将LLM多智能体系统的通信拓扑适配每个查询,可同时提升准确率与效率。现有方法将其视为条件图生成:通过变分、自回归或扩散解码器在$N \times N$邻接空间中搜索,并由图网络代理基于效用与结构成本(如边数)对候选方案排序。我们指出该范式与问题本质不符:实证发现,经奖励筛选后拓扑仅剩约六类,即使代码簿容量从8增至64;边数与实际令牌消耗呈负相关(皮尔逊相关系数 $r \approx -0.4$),即稀疏化反而增加推理开销;且消息传递评分器在智能体共享配置时对邻接关系不变——这正是公开基准默认设置——因此无法有效区分候选方案。为此提出Codebook Agent:向量量化自编码器将成功拓扑压缩为与查询无关的16项代码簿;奖励加权MLP将查询嵌入映射至代码分布;一个读取展平邻接矩阵的MLP代理,基于实测效用与归一化任务令牌成本回归,单批次前向传播重排前几个解码候选。无需迭代搜索,测试时无消息传递,是六个基准上最准确的方法(平均84.6%,优于最强先验83.0%),2.4毫秒生成拓扑,减少21.9–33.2%的LLM令牌使用。

原文摘要 · Abstract (English)

Adapting the communication topology of an LLM multi-agent system to each query improves both accuracy and efficiency, yet current designers treat this as conditional graph generation: a variational, autoregressive, or diffusion decoder searches the $N \times N$ adjacency space, and a graph-network proxy trained on utility and a structural cost such as edge count ranks the sampled candidates. We argue that this formulation is misaligned with the problem. Empirically, topologies that survive a reward filter collapse to about six distinct graphs even when the codebook capacity grows from 8 to 64; edge count is negatively correlated with measured token consumption (Pearson $r \approx -0.4$), so sparsifying the graph makes inference more expensive; and a message-passing scorer over agent-profile nodes is adjacency-invariant whenever agents share a profile---the default configuration of published benchmarks---so it cannot rank candidates at all in that regime. These three facts motivate Codebook Agent: a vector-quantized autoencoder compresses successful topologies into a query-independent 16-entry codebook; a reward-weighted MLP maps the query embedding to a distribution over codes; and an MLP proxy that reads the flattened adjacency, regressed on measured utility and per-task normalized token cost, reranks the top decoded candidates in a single batched forward pass. With no iterative search and no message passing at test time, Codebook Agent is the most accurate method on all six benchmarks we compare (84.6 average against 83.0 for the strongest prior designer), emits a topology in 2.4 ms, and uses 21.9--33.2% fewer LLM tokens.

多智能体拓扑优化代码簿推理加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。