arXiv:2605.30227cs.MAcs.AI2026-05被引 2

通过时间与结构分解,精准定位多智能体推理中的薄弱环节。

Unifying Temporal and Structural Credit Assignment in LLM-Based Multi-Agent Prompt Optimization

论文配图:Unifying Temporal and Structural Credit Assignment in LLM-Based Multi-Agent Prompt Optimization
图 1 · 摘自论文原文
  • 将失败信号按时间关键轮次和角色贡献拆解,实现定向优化。
  • 在多个推理基准上降低查询复杂度,性能显著提升。
  • 适合需要可解释性优化的自进化多智能体系统研究者。

尽管多智能体系统(MAS)通过协作交互使大语言模型能够处理复杂推理任务,但其动态优化因计算图的离散性和非可微性,以及全局监督信号稀疏而面临巨大挑战。现有黑箱优化器难以将轨迹级失败归因于具体局部组件,导致探索效率低且方差大。我们提出时间与结构信用分配机制,沿两个维度分解目标:(i) 时间信用,利用状态空间瓶颈识别关键回合;(ii) 结构信用,通过平稳角色策略分离各智能体贡献。基于这些分解信号,我们引入一种离散、语义化的块坐标下降算法进行迭代优化。该方法不进行盲目全局更新,而是交替优化角色提示与聚合协议,利用大语言模型生成的“代理梯度”仅针对识别出的薄弱环节进行修正。在多种推理基准上,本方法显著降低查询复杂度并提升性能,为自进化多智能体系统提供了原则性强且可解释的优化路径。

原文摘要 · Abstract (English)

While Multi-Agent Systems (MAS) empower Large Language Models to tackle complex reasoning tasks through collaborative interaction, optimizing their dynamics remains a formidable challenge due to the discrete, non-differentiable nature of the computation graph and the sparsity of global supervisory signals. Existing black-box optimizers struggle to attribute trajectory-level failure to specific local components, resulting in inefficient, high-variance exploration. We argue that tractable MAS optimization needs structural inductive biases to disentangle error signals. We propose temporal and structural credit assignment, which decomposes the objective along two axes: (i) temporal credit, using state-space bottlenecks to identify critical rounds, and (ii) structural credit, using stationary role policies to isolate agent contributions. Leveraging these decomposed signals, we introduce a discrete, verbalized block coordinate descent algorithm for iterative refinement. Rather than indiscriminate global updates, it alternates between optimizing role prompts and aggregation protocols, using LLM-generated "proxy gradients" to target only the identified weak links. Across diverse reasoning benchmarks, our approach substantially reduces query complexity while improving performance, providing a principled and interpretable path toward self-improving MAS.

多智能体大模型优化可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。