arXiv:2609.08572cs.AI2026-09

通过分步干预与语义梯度抽象,提升多智能体系统提示词优化效率与效果。

AgentGrad: Intervention-guided Prompt Optimization for Multi Agent Systems

论文配图:AgentGrad: Intervention-guided Prompt Optimization for Multi Agent Systems
图 1 · 摘自论文原文
  • 分步干预定位故障源头智能体,实现精细化梯度提取。
  • 语义聚类抽象梯度,避免无关错误混合,提升泛化能力。
  • 在5个基准上达到最优,优化速度比基线快2.5倍。

基于大语言模型的多智能体系统(MAS)通过多个专用智能体实现强大性能,但其表现高度依赖各智能体的提示设计。现有文本梯度方法虽能通过自然语言反馈指导提示更新,但在梯度提取与聚合阶段存在缺陷:梯度提取时未验证修改目标提示是否解决失败,且缺乏对智能体中间输出的层级监督;梯度聚合时随机分组拼接,常混合不同故障模式,导致生成提示泛化能力差。为此,我们提出 extbf{AgentGrad},一种基于序列干预与语义文本梯度抽象的多智能体系统提示优化框架。针对每项失败,序列干预逐个调整单个智能体行为,识别出能修复问题的目标智能体;利用该智能体的修改后输出作为层级监督,提取细粒度梯度。语义文本梯度抽象通过聚类相似梯度,防止不同故障模式混杂,并将每类抽象为捕捉共性修正模式的通用梯度。实验表明,AgentGrad在五个MAS基准上均达当前最优性能,平均优化耗时比最快速基线减少2.5倍。

原文摘要 · Abstract (English)

Large language model (LLM)-based multi-agent systems (MAS) achieve strong performance by employing specialized multiple agents, yet their performance depends on the prompt design of each agent. For MAS prompt optimization, textual gradient methods that guide prompt updates using natural-language feedback have emerged as a leading paradigm. In this paper, we identify limitations in two stages of existing textual gradient approaches: gradient extraction and gradient aggregation. In gradient extraction, previous works select a target prompt without verifying whether modifying it resolves the failure, and derive gradients without agent-level supervision over the corresponding agent's intermediate output. In gradient aggregation, individual gradients are randomly grouped and concatenated, often mixing unrelated failure modes and producing prompts that fail to generalize. To address these limitations, we propose \textbf{AgentGrad}, a prompt optimization framework for multi-agent systems based on sequential intervention and semantic textual gradient abstraction. For each failure, sequential intervention modifies the behavior of one agent at a time to identify the target agent whose modification resolves the failure. The modified output of the target agent then serves as agent-level supervision for extracting a fine-grained gradient. Semantic textual gradient abstraction clusters semantically similar gradients to prevent mixing unrelated failure modes, and abstracts each cluster into a generalized gradient that captures the shared corrective pattern. Experimental results show that AgentGrad achieves state-of-the-art performance across five MAS benchmarks and reduces wall-clock optimization time by $2.5\times$ on average compared to the next-fastest baseline.

多智能体提示优化梯度抽象

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。