只让犯错的智能体反思,提升多智能体协作成功率
Finding Where the Buck Stops: An Automated Failure Attribution-Based Reflection Framework for Multi-Agent Collaboration

- 先自动定位导致失败的关键错误步骤和责任人
- 仅让关键错误智能体重写错误步骤,成功率达22%以上提升
- 适合资源有限或需高效纠错的多智能体系统
基于大语言模型的多智能体系统在复杂任务中表现出潜力,但失败率较高。现有自省方法要求所有智能体共同反思,忽略了关键事实:失败通常源于某个主导性错误智能体,其他智能体仅按常规执行。强制正常智能体反思会污染其记忆。为此,我们提出DoCtOR(诊断-修正增强型反射框架),先通过自动化故障归因识别关键错误步骤与关键错误智能体,再利用反事实推理生成修正后的关键错误步骤,最后仅让该智能体进行针对性反思。实验表明,DoCtOR在HotPotQA、ChartQAPro和Mind2Web数据集上分别较初始成功率提升22%、26%和27%,优于Reflexion、Retroformer和COPPER。进一步验证了诊断-修正范式的通用性,并证明在低资源条件下,仅反思关键错误之后的推理步骤即可达到与完整失败轨迹反思相当的效果。
原文摘要 · Abstract (English)
Multi-agent systems (MAS) powered by large language models have shown promise for complex tasks but suffer from high failure rates. Current self-reflection methods for MAS require all agents to reflect upon failure, overlooking a critical reality: failures typically stem from a specific agent leading the task astray, namely the decisive error agent, while others merely fulfill their regular duties. Forcing regular-behaving agents to reflect contaminates their memory with wrong insights. Hence, we propose DoCtOR (Diagnose-then-Correct PPO-enhanced Reflection), a novel reflection framework that enhances multi-agent collaboration. DoCtOR first identifies the decisive error step and decisive error agent through automated failure attribution, then employs counterfactual reasoning to generate a corrected decisive error step, and finally engages only the decisive error agent to produce targeted reflections. Experimental results show DoCtOR achieves 22%, 26%, and 27% improvements over initial success rates on HotPotQA, ChartQAPro, and Mind2Web datasets, outperforming Reflexion, Retroformer, and COPPER. We further establish the generalizability of our diagnose-then-correct paradigm and demonstrate that in low-resource settings, focusing reflection on reasoning steps after the decisive error step achieves comparable quality to reflecting on the complete failure trajectory.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。