arXiv:2605.13295cs.CLcs.AI2026-05

通过对比不同配置,让大模型协作系统自动优化各智能体提示词。

CANTANTE: Optimizing Agentic Systems via Contrastive Credit Attribution

论文配图:CANTANTE: Optimizing Agentic Systems via Contrastive Credit Attribution
图 1 · 摘自论文原文
  • 用对比不同配置的推演来分解系统奖励,给每个智能体分配更新信号。
  • 在编程和数学推理任务上分别提升18.9%和12.5%,且推理成本更低。
  • 适合需要自动调优多智能体系统的开发者或研究者使用。

基于大语言模型的多智能体系统在软件工程、预测建模和检索增强生成等复杂任务中表现优异,但其配置自动化仍面临结构性挑战:系统层面的评分仅能提供整体反馈,而影响智能体行为的参数是局部的。我们提出,优化这类系统本质上是一个信用分配问题。为此,我们引入CANTANTE框架,通过在同一查询上对比多种联合配置的推演过程,将系统级奖励分解为每个智能体的更新信号。我们在提示词优化场景中实现该框架,将智能体提示词视为可学习的系统参数。在MBPP(编程)、GSM8K(数学推理)和HotpotQA(多跳问答)三个基准上评估CANTANTE,结果表明其在所有评估优化器中平均排名最佳,且始终优于未优化的提示词。在MBPP上相比最强基线提升18.9个百分点,在GSM8K上提升12.5个百分点,同时推理开销更低;在HotpotQA上保持在最强基线一个标准差内。关键的是,信用相关性分析证实,该方法生成的个体信号具有意义,而非简单重复全局得分。

原文摘要 · Abstract (English)

LLM-based multi-agent systems have demonstrated strong performance across complex real-world tasks, such as software engineering, predictive modeling, and retrieval-augmented generation. Yet automating their configuration remains a structural challenge, as scores are available only at the system level, whereas the parameters governing agent behavior are local. We argue that optimizing these systems is fundamentally a credit-assignment problem. We therefore introduce CANTANTE, a framework that decomposes system-level rewards into per-agent update signals by contrasting rollouts of multiple joint configurations on the same query. We instantiate it for prompt optimization, treating agent prompts as learnable system parameters. We evaluate CANTANTE against GEPA and MIPROv2 on programming (MBPP), mathematical reasoning (GSM8K), and multi-hop question answering (HotpotQA). Across these benchmarks, CANTANTE achieves the best average rank among all evaluated optimizers and consistently outperforms unoptimized prompts. It improves over the strongest baseline by +18.9 percentage points on MBPP and +12.5 percentage points on GSM8K, while incurring a lower inference cost. It remains within one standard deviation of the strongest baseline on HotpotQA. Crucially, our credit correlation analysis confirms that the attributer produces meaningful per-agent signals rather than echoing the global system score.

多智能体提示优化信用分配强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。