arXiv:2602.12276cs.AIcs.CL2026-02被引 7

动态分配计算资源,让AI网页代理更聪明地决策。

Agentic Test-Time Scaling for WebAgents

  • 根据投票不确定性动态分配计算量,只在关键步骤加算力。
  • 在多个数据集上提升最高达11.8%,且用更少的令牌完成。
  • 适合需要高效可靠多步决策的智能体应用开发。

测试时扩展已成为提升神经网络模型性能与可靠性的重要方法。然而,其在代理型、多步骤任务中的表现仍不明确:单步小误差在长序列中会累积;我们发现均匀增加每步采样量会迅速达到收益递减。本文通过实证研究推理时扩展在网页代理中的应用,发现均匀提升每步计算量在长周期环境中快速饱和。我们进一步探索更强聚合策略,包括基于大模型的仲裁者,虽能超越简单投票,但可能否决高共识决策。研究发现,由代理自身投票分布(熵值与前一/前二名差距)得出的不确定性统计量与下游成功高度相关,可作为动态计算分配的实用信号。基于此,我们提出自信感知测试时扩展(CATTS),仅在决策真正存在分歧时分配额外计算。CATTS在WebArena-Lite、Online-Mind2Web和GoBrowse上相比多数投票提升最多11.8%,且使用的令牌数少于均匀扩展,兼具效率优势与可解释性决策规则。

原文摘要 · Abstract (English)

Test-time scaling has become a standard way to improve performance and boost reliability of neural network models. However, its behavior on agentic, multi-step tasks remains less well-understood: small per-step errors can compound over long horizons; and we find that naive policies that uniformly increase sampling show diminishing returns. In this work, we present CATTS, a simple technique for dynamically allocating compute for multi-step agents. We first conduct an empirical study of inference-time scaling for web agents. We find that uniformly increasing per-step compute quickly saturates in long-horizon environments. We then investigate stronger aggregation strategies, including an LLM-based Arbiter that can outperform naive voting, but that can overrule high-consensus decisions. We show that uncertainty statistics derived from the agent's own vote distribution (entropy and top-1/top-2 margin) correlate with downstream success and provide a practical signal for dynamic compute allocation. Based on these findings, we introduce Confidence-Aware Test-Time Scaling (CATTS), which uses vote-derived uncertainty to allocate compute only when decisions are genuinely contentious. CATTS improves performance on WebArena-Lite, Online-Mind2Web, and GoBrowse by up to 11.8% over majority voting while using fewer tokens than uniform scaling, providing both efficiency gains and an interpretable decision rule.

智能体测试时扩展网页代理动态调度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。