让AI在执行前自我反思,提前纠错,提升工具使用能力。
MIRROR: Multi-agent Intra- and Inter-Reflection for Optimized Reasoning in Tool Learning
- 引入事前反思(内省)与事后反思(交互),双轨纠错。
- 在两个基准测试中达到当前最优性能,显著减少错误路径。
- 适合需要高可靠性的自动化决策系统开发者参考。
复杂任务中的工具集成对大语言模型(LLMs)构成挑战,多智能体工作流成为有前景的解决方案。反思机制已被证明能有效修正智能体工作流中的错误轨迹,但现有方法仅在动作执行后利用该能力,即通过观察执行结果进行修正。我们提出MIRROR框架,包含内反射(事前评估拟执行动作)和外反射(基于观察调整轨迹),系统性地利用大语言模型的反思能力,在更广泛范围内消除和纠正错误行为。在StableToolBench和TravelPlanner两个基准上的评估显示,MIRROR性能优于现有方法,达到当前最佳水平。
原文摘要 · Abstract (English)
Complex tasks involving tool integration pose significant challenges for Large Language Models (LLMs), leading to the emergence of multi-agent workflows as a promising solution. Reflection has emerged as an effective strategy for correcting erroneous trajectories in agentic workflows. However, existing approaches only exploit such capability in the post-action stage, where the agent observes the execution outcomes. We argue that, like humans, LLMs can also engage in reflection before action execution: the agent can anticipate undesirable outcomes from its own decisions, which not only provides a necessarily complementary perspective to evaluate the decision but also prevents the propagation of errors throughout the trajectory. In this paper, we propose MIRROR, a framework that consists of both intra-reflection, which critically assesses intended actions before execution, and inter-reflection, which further adjusts the trajectory based on observations. This design systematically leverages LLM reflection capabilities to eliminate and rectify erroneous actions on a more comprehensive scope. Evaluations on both the StableToolBench and TravelPlanner benchmarks demonstrate MIRROR's superior performance, achieving state-of-the-art results compared to existing approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。