arXiv:2608.11994cs.AIcs.CL2026-08

通过聚焦关键命题验证,用更少算力提升大模型推理可靠性。

Claim-Level Reliability Assessment for Efficient Test-Time Reasoning

  • 不增加采样,转而重点验证每个推理中的核心命题
  • 在相同算力下,准确率提升最高达27.15个百分点
  • 适合追求高可靠推理但资源受限的场景

我们提出以命题级假说检验为原则的测试时扩展方法,并通过无训练框架CLR实现。由于完整推理过程常因常规词元干扰而掩盖关键错误,CLR将每个推理轨迹浓缩为一组决策关键命题,从而定位逻辑锚点。考虑到在固定模型能力下生成完全正确解极为困难,CLR转而关注语义层面的证伪。该方法利用解构建与命题反驳之间的根本不对称性:构建有效解需完美推理路径,而反驳错误命题只需发现单一决定性缺陷。这种针对负面证据的定向搜索系统性压缩了高置信度错误轨迹的存活空间,通过非线性可靠性评分有效抑制错误共识。在四个大语言模型和四个推理基准上,匹配预算条件下CLR普遍优于pass@1和自洽性方法。例如在GPT-OSS-20B/CMIMC25上,其pass@1高出27.15个百分点,自洽性准确率从77.50%提升至82.19%,且仅使用37.0%的令牌数。

原文摘要 · Abstract (English)

We propose claim-level falsification as a principle for test-time scaling and instantiate it through Claim-Level Reliability Assessment (CLR), a training-free framework that reallocates test-time compute from additional solution sampling to targeted verification. Since whole-trace evaluation often obscures decisive errors due to signal dilution from routine tokens, CLR condenses each reasoning trace into a compact set of decision-critical claims, thereby isolating its logical anchors. Furthermore, recognizing the inherent difficulty of generating entirely correct solutions under fixed model capabilities, CLR shifts the focus to semantic falsification. This approach exploits a fundamental asymmetry between solution construction and claim refutation. Constructing a valid solution requires a flawless reasoning path, whereas refuting an incorrect claim requires identifying only a single decisive flaw. This targeted search for negative evidence systematically compresses the survival space of high-confidence incorrect traces, effectively suppressing erroneous consensus via nonlinear reliability scoring. Across four LLMs and four reasoning benchmarks under matched budgets, CLR generally improves upon pass@1 and self-consistency. On GPT-OSS-20B/CMIMC25, for instance, CLR exceeds pass@1 by 27.15 percentage-points and raises self-consistency accuracy from 77.50\% to 82.19\% with 37.0\% fewer tokens.

大模型推理可靠性评估测试时扩展

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。