arXiv:2607.05391cs.AIcs.CL2026-07被引 11

用大模型当裁判,让AI自我验证更精准。

LLM-as-a-Verifier: A General-Purpose Verification Framework

论文配图:LLM-as-a-Verifier: A General-Purpose Verification Framework
图 1 · 摘自论文原文
  • 让大模型以连续分数评估解法,比打分更精细。
  • 在多个基准上达领先水平,最高准确率达87.4%。
  • 适合想提升AI系统可靠性与训练效率的研究者。

扩展预训练、后训练和测试时计算已成为提升大模型能力的核心范式。本文提出将验证——判断解法正确性——作为新的扩展维度。为此,我们引入了无需额外训练的通用验证框架LLM-as-a-Verifier。不同于传统模型裁判仅输出离散评分,该框架通过计算评分词元逻辑值分布的期望,生成连续分数。这种概率化方法使验证可沿三个维度扩展:(1)评分粒度,(2)重复评估,(3)标准分解。实验表明,提升评分粒度可更好区分正负解,使比较更校准;重复评估与标准分解则通过降低方差和复杂度持续提升验证准确率。我们还设计了一种低成本排序算法,利用连续分数筛选最优解。该框架在Terminal-Bench V2(86.5%)、SWE-Bench Verified(78.2%)、RoboRewardBench(87.4%)和MedAgentBench(73.3%)上均达到当前最佳性能。此外,其细粒度信号还可作为任务进展代理指标,已用于Claude Code系统辅助开发者监控与优化自研智能体。最后,该框架在强化学习中提供密集反馈,显著提升SAC与GRPO在机器人与数学推理任务上的样本效率。

原文摘要 · Abstract (English)

Scaling pre-training, post-training, and test-time compute have become the central paradigms for improving the capabilities of LLMs. In this work, we identify verification, the ability to determine the correctness of a solution, as a new scaling axis. To unlock this and demonstrate its effectiveness, we introduce LLM-as-a-Verifier, a general-purpose verification framework that provides fine-grained feedback for agentic tasks without requiring additional training. Unlike standard LM judges that prompt LLMs to produce discrete scores for candidate solutions, LLM-as-a-Verifier computes the expectation over the distribution of scoring token logits to generate continuous scores. This probabilistic formulation enables verification to scale along multiple dimensions: (1) score granularity, (2) repeated evaluation, and (3) criteria decomposition. In particular, we show that scaling the scoring granularity leads to better separation between positive and negative solutions, resulting in more calibrated comparisons. Moreover, scaling repeated evaluation and criteria decomposition consistently lead to additional gains in verification accuracy through variance and complexity reduction. We further introduce a cost-efficient ranking algorithm for selecting the best solution among candidates using the verifier's continuous scores. LLM-as-a-Verifier achieves state-of-the-art performance on Terminal-Bench V2 (86.5%), SWE-Bench Verified (78.2%), RoboRewardBench (87.4%), and MedAgentBench (73.3%). Beyond verification, the fine-grained signals from LLM-as-a-Verifier can also serve as a proxy for estimating task progress. We build an extension for Claude Code, enabling developers to monitor and improve their own agentic systems. Finally, we show that LLM-as-a-Verifier can provide dense feedback for RL, improving the sample efficiency of SAC and GRPO on robotics and mathematical reasoning benchmarks.

大模型验证智能体系统强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。