arXiv:2606.19808cs.AIcs.CL2026-06

智能决定何时验证推理结果,省钱又提准率。

Think Again or Think Longer? Selective Verification for Budget-Aware Reasoning

论文配图:Think Again or Think Longer? Selective Verification for Budget-Aware Reasoning
图 1 · 摘自论文原文
  • 根据初始推理状态动态决定是否验证,避免无效计算。
  • 在Math数据集上准确率76.3%,节省26.8%生成词数,错误翻转减半。
  • 适合对成本敏感、需可控验证或防止模型误改答案的场景。

测试时推理作为部署控制手段日益重要,但额外推理并非均有益:可能修复失败,浪费算力于已正确答案,或引入有害更改。本文将其视为部署资源分配问题,而非新验证器问题。提出 extit{SEVRA}(Selective Verification for Reasoning Allocation),一种服务层控制器,决定保留冻结求解器的初始答案,或触发主动验证。基于冻结的 Qwen3-4B 求解器,在 extit{MathQA} 上记录干预结果,并从可见的推理状态训练可恢复性感知门控。在 extit{MathQA} 上,选择性验证达到 76.3\\

原文摘要 · Abstract (English)

Test-time reasoning is increasingly used as a serving-time control knob, but extra reasoning is not uniformly valuable: it can repair failed attempts, waste compute on already-correct answers, or introduce harmful answer changes. We study this as a deployment allocation problem rather than a new-verifier problem. We introduce \sevra, Selective Verification for Reasoning Allocation, a serving-layer controller that decides whether to preserve a frozen solver's initial answer or invoke active verification. Using a frozen Qwen3-4B solver, we log intervention outcomes and train recoverability-aware gates from serving-visible attempt state. On \mathfive, selective verification reaches 76.3\% accuracy, compared with 75.5\% for always verifying, while reducing post-generation tokens by 26.8\% and harmful flips from 2.2\% to 1.0\%. However, an 8,192-token initial solve reaches 76.0\% accuracy with 28\% fewer total model tokens, showing that selective recovery is useful but not the best tested cost frontier. In frozen transfer to \gsm, the selective policy verifies only 3.0\% of examples, improves accuracy from 93.4\% to 94.5\%, and reduces verification tokens by 91.2\% relative to always verifying; again, a longer initial solve matches its accuracy with fewer realized tokens. On CommonsenseQA, always-on verification hurts, while Self-Consistency@5 improves accuracy at about five times the realized token cost. The resulting deployment rule is: tune the initial budget first, then use selective recovery when explicit checks, bounded retries, auditability, or regression-risk control matter.

推理优化预算控制验证策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。