arXiv:2605.15513cs.AI2026-05被引 1

CAPS通过动态选择验证内容和对比策略,让大模型推理更省算力且更准。

CAPS: Cascaded Adaptive Pairwise Selection for Efficient Parallel Reasoning

  • 分阶段自适应选择每个解题方案的验证内容和对比对象,减少冗余计算。
  • 在代码与数学任务上,仅用25.4%的验证算力就超越了现有最强方法。
  • 适合追求高效推理的部署场景,尤其适用于资源受限环境下的模型优化。

并行推理通过生成多个候选解并由聚合器筛选最优解,是大型语言模型测试时扩展的有效方式,其中成对自我验证已成为最强的聚合机制。然而,成对验证成本高昂:每次判断需完整读取两个解,且现有方法每道题执行数十次此类判断,无论比较是否有效。本文提出CAPS(级联自适应成对选择),一种纯推理框架,沿证据和分布两个正交维度非均匀分配验证计算:前者动态调整每个候选解被查看的部分,后者调节比较在候选池中的分布。CAPS采用四阶段级联结构,含可选救援子程序,并导出闭式验证令牌开销公式,使每个候选的边际成本约为均匀全证据调度的一半。在四个自验证模型(Qwen3-14B、GPT-OSS-20B、Qwen3-4B-Instruct/Thinking)和五个推理基准(代码类:LiveCodeBench-v5/v6、CodeContests;数学类:AIME 2025、HMMT 2025)上,CAPS在20个测试套件中优于领先成对验证器14个,代码任务仅使用其25.4%的验证令牌预算;同时在所有20个套件上优于点对点自我验证。该权衡套件提供基于部分与全证据下验证准确率的可解释诊断,为级联适用性提供了明确的部署前检查。

原文摘要 · Abstract (English)

Parallel reasoning, where a generator samples many candidate solutions and an aggregator selects the best, is one of the most effective forms of test-time scaling in large language models, and pairwise self-verification has become its strongest aggregation primitive. Yet pairwise verification carries a heavy cost: each judgment reads two complete solutions in full, and existing methods perform tens of such judgments per problem regardless of whether the comparison is informative. We introduce CAPS (Cascaded Adaptive Pairwise Selection), an inference-only framework that allocates verifier compute non-uniformly along two orthogonal axes: an evidence axis that adapts how much of each candidate the judge sees, and a distribution axis that adapts how comparisons are spread across the pool. CAPS instantiates these into a four-stage cascade with an optional rescue subroutine, and admits a closed-form verifier-token cost in which the per-candidate marginal cost is roughly halved relative to uniform full-evidence schedules. On four self-verifying models (Qwen3-14B, GPT-OSS-20B, Qwen3-4B-Instruct/Thinking) and five reasoning benchmarks spanning code (LiveCodeBench-v5/v6, CodeContests) and math (AIME 2025, HMMT 2025), CAPS outperforms the leading pairwise verifier on 14 of 20 suites while using 25.4% of its verifier-token budget on code, and outperforms pointwise self-verification on all 20. The trade-off suites admit an interpretable diagnostic in terms of the verifier's accuracy at partial versus full evidence, providing a concrete pre-deployment check for cascade suitability.

推理优化自验证算力节省大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。