arXiv:2603.14465cs.AI2026-03KDD被引 22

首个评估工具使用型智能体步骤质量的基准,助力提升长程任务可靠性。

AgentProcessBench: Diagnosing Step-Level Process Quality in Tool-Using Agents

论文配图:AgentProcessBench: Diagnosing Step-Level Process Quality in Tool-Using Agents
图 1 · 摘自论文原文
  • 构建包含1000条真实轨迹的评测基准,支持细粒度步骤标注与错误传播分析。
  • 发现弱模型因提前终止导致正确步骤比例虚高,且难区分中性与错误操作。
  • 过程信号可补充结果监督,显著提升测试阶段性能扩展能力,适合强化学习研究者。

尽管大语言模型已演变为具备工具使用能力的智能体,但在长周期交互中仍显脆弱。与数学推理中可通过回溯修正错误不同,工具使用失败常引发不可逆副作用,因此准确的步骤级验证至关重要。然而,现有过程级评测基准多局限于封闭世界的数学领域,难以反映工具执行的动态开放特性。为此,我们提出AgentProcessBench,首个专注于评估真实场景下工具增强轨迹中步骤有效性的一阶基准。该基准包含1,000条多样化轨迹和8,509条人工标注步骤,标注间一致性达89.1%。其采用三元标注体系以捕捉探索行为,并引入错误传播规则降低标注歧义。大量实验揭示关键洞见:(1) 弱策略模型因早期终止导致正确步骤比例被高估;(2) 当前模型仍难以区分中性与错误动作;(3) 过程衍生信号可补充结果监督,在测试时缩放中显著提升性能。我们期望该基准能推动奖励模型研究,迈向通用智能体。代码与数据已开源于https://github.com/RUCBM/AgentProcessBench。

原文摘要 · Abstract (English)

While Large Language Models (LLMs) have evolved into tool-using agents, they remain brittle in long-horizon interactions. Unlike mathematical reasoning where errors are often rectifiable via backtracking, tool-use failures frequently induce irreversible side effects, making accurate step-level verification critical. However, existing process-level benchmarks are predominantly confined to closed-world mathematical domains, failing to capture the dynamic and open-ended nature of tool execution. To bridge this gap, we introduce AgentProcessBench, the first benchmark dedicated to evaluating step-level effectiveness in realistic, tool-augmented trajectories. The benchmark comprises 1,000 diverse trajectories and 8,509 human-labeled step annotations with 89.1% inter-annotator agreement. It features a ternary labeling scheme to capture exploration and an error propagation rule to reduce labeling ambiguity. Extensive experiments reveal key insights: (1) weaker policy models exhibit inflated ratios of correct steps due to early termination; (2) distinguishing neutral and erroneous actions remains a significant challenge for current models; and (3) process-derived signals provide complementary value to outcome supervision, significantly enhancing test-time scaling. We hope AgentProcessBench can foster future research in reward models and pave the way toward general agents. The code and data are available at https://github.com/RUCBM/AgentProcessBench.

智能体评估工具使用过程验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。