arXiv:2510.06135cs.AI2025-10被引 10

利用验证比生成更简单的特性,显著提升AI推理能力

Pushing Test-Time Scaling Limits of Deep Search with Asymmetric Verification

  • 通过不对称验证机制,在少量计算下实现高效测试时扩展
  • 模型在BrowseComp上最高提升27个百分点,达到69%准确率
  • 开源模型性能媲美甚至超越闭源顶尖系统,适合需要高精度推理的场景

测试时计算可串行和并行扩展。串行扩展通过延长生成过程实现,而并行扩展则通过验证和筛选多个候选输出完成。结合两者已催生如Grok 4 Heavy和GPT-5 Pro等最强AI系统。在某些任务(如解数独)中,验证答案远比生成答案容易,这一现象称为‘不对称验证’,凸显了测试时扩展(TTS)的巨大潜力。本文研究深度搜索智能体的串行与并行TTS,基于验证远比生成容易的直觉。实验表明,尽管预算强制等串行方法初期有效,但性能很快下降。而借助不对称验证,仅用少量计算即可带来显著提升。我们在主流开源模型上进行实验,并通过TTS扩展至其‘Heavy’版本。这些深度研究智能体在BrowseComp等基准上提升高达27个绝对百分点。值得注意的是,开源模型GLM-4.5 Heavy在BrowseComp上达54.0%,在GAIA上达66.0%,接近最优闭源模型如OpenAI Deep Research。Tongyi-DeepResearch Heavy更在BrowseComp上达到69.0%,大幅超越最佳闭源结果。

原文摘要 · Abstract (English)

Test-time compute can be scaled both sequentially and in parallel. Sequential scaling involves lengthening the generation process, while parallel scaling involves verifying and selecting among multiple candidate outputs. Combining these two strategies has led to the most powerful AI systems, such as Grok 4 Heavy and GPT-5 Pro. In certain contexts (e.g., solving Sudoku puzzles), verifying responses can be substantially easier than generating them. This property, referred to as \emph{asymmetric verification}, highlights the strong potential of test-time scaling (TTS). In this work, we study both sequential and parallel TTS of deep search agents, motivated by the intuition that verification in this setting is often much easier than generation. In experiments, we first show that sequential scaling methods, such as budget forcing, can be effective initially but soon degrade performance. Leveraging asymmetric verification, however, we are able to achieve substantial improvements by allocating only a modest amount of compute to the verifier. We conduct experiments with flagship open-source models and extend them to their ``Heavy'' variants through TTS. These deep research agents achieve gains of up to 27 absolute points on benchmarks such as BrowseComp. Remarkably, as an open-source alternative, GLM-4.5 Heavy reaches accuracy of {\bf 54.0\%} on BrowseComp and {\bf 66.0\%} on GAIA, placing it comparable to the best proprietary choices such as OpenAI Deep Research. Tongyi-DeepResearch Heavy further achieves {\bf 69.0\%} accuracy on BrowseComp, greatly surpassing the best proprietary results.

测试时扩展推理优化开源模型不对称验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。