用蒙特卡洛树搜索自动修复多智能体系统错误,提升效率与准确率。
Autonomous Repair for Multi-Agent Systems via Monte-Carlo Tree Search

- 将修复过程建模为树搜索,通过诊断引导扩展和分类评估缩小搜索空间。
- 在1310条故障轨迹上测试,性能较现有方法提升3.0%至12.1%,耗token相当。
- 适合研究多智能体系统容错、自动化调试或大模型协作优化的开发者。
多智能体系统(MAS)正被广泛用于解决复杂任务。当输出错误或不理想时,用户需手动分析智能体轨迹以定位问题(失败归因),并提供反馈进行修复。尽管已有部分工作关注失败归因,但自动修复机制仍处于空白。为此,我们提出MARS,一个基于搜索的修复框架,将MAS修复建模为蒙特卡洛树搜索(MCTS)过程,并通过诊断引导扩展与分类增强评估来导航庞大的修复空间。不同于标准MCTS的全回滚评估,MARS采用部分回滚以降低令牌消耗。此外,我们构建了StateMAS,一个包含1,310条可重放多智能体故障轨迹的大规模基准数据集,涵盖四种智能体架构和四种LLM主干。在StateMAS上的实验表明,MARS在所有设置下均显著优于现有方法,绝对性能提升3.0%至12.1%,同时保持相近的令牌消耗成本。消融实验进一步验证了分类增强评估与诊断引导扩展对性能提升的关键作用。
原文摘要 · Abstract (English)
Multi-agent systems (MAS) are increasingly deployed to solve complex tasks. In case of incorrect or unsatisfactory outputs, users have to manually locate agent mistakes by inspecting agent trajectories (i.e., {\em failure attribution}) and provide feedback to refine the outputs (i.e., {\em repair}). Despite some recent work in MAS failure attribution, automated mechanisms to recover from such mistakes remain largely unexplored. To bridge this gap, we propose MARS, a search-based framework that formulates MAS repair as a Monte Carlo Tree Search (MCTS) process and navigates the vast space of potential repairs via diagnosis-guided expansion with taxonomy-augmented evaluation. Unlike standard MCTS, which evaluates a complete simulation via full rollout, MARS evaluates the agent trajectory using partial rollout to reduce token consumption. Furthermore, we introduce StateMAS, a large-scale MAS repair benchmark with 1,310 replayable multi-agent failure trajectories spanning four types of agent architectures and four LLM backbones. Experiments on StateMAS demonstrate that MARS consistently outperforms state-of-the-art methods, achieving an absolute improvement from 3.0\% to 12.1\% across all settings, while maintaining a comparable token consumption cost. The ablation study further confirms that taxonomy-augmented evaluation and diagnosis-guided expansion are critical to achieving these performance gains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。