arXiv:2606.12935cs.AI2026-06

通过提前停止冗余推理路径,显著降低大模型推理成本而不损失精度。

MARS: Margin-Adversarial Risk-controlled Stopping for Parallel LLM Test-time Scaling

论文配图:MARS: Margin-Adversarial Risk-controlled Stopping for Parallel LLM Test-time Scaling
图 1 · 摘自论文原文
  • 基于中间检查点的投票趋势预测,动态决定何时停止推理
  • 在不牺牲准确率前提下,节省25%-47%的推理计算量
  • 适合追求高效推理的工业级大模型应用

并行测试时缩放通过采样多条推理轨迹并多数投票提升大模型准确性,但需运行至完成,导致巨大计算开销。我们发现,在中间检查点探测部分轨迹可提取当前答案而不干扰生成,揭示了投票的演化过程。基于此,提出MARS:一种边际对抗性风险控制的停止规则,通过估计可能改变答案的活跃轨迹,当领先答案在保守未来投票变动范围内保持安全时停止。该规则分离两种不确定性:学习轨迹级切换概率以预测当前差距保留程度,通过对抗性边界处理切换轨迹落点问题,该边界由预热轨迹校准。在真实切换概率下,MARS高概率保证提前停止的答案与全预算投票一致。实际中,五特征逻辑回归模型能近似最优切换行为。在三个推理模型和三个竞赛数学基准上,MARS节省25%-47%自一致性令牌,比DeepConf Online(强基线)再减少14%-29%,且匹配全预算基线准确率。

原文摘要 · Abstract (English)

Parallel test-time scaling samples many reasoning traces and majority-votes their answers, improving LLM accuracy but requiring traces to run to completion, incurring substantial computational overhead. We observe that probing partial traces at intermediate checkpoints can extract current answers without disrupting generation, revealing an evolving aggregate vote. Based on this observation, we introduce MARS, a margin-adversarial stopping rule that estimates which active traces are likely to change their answers and stops once the leader remains safe under a conservative bound on future vote movement. The rule separates two sources of uncertainty. It learns the trace-level switch probabilities that determine how much of the current margin is likely to be retained, while handling the harder question of where switching traces land through an adversarial bound calibrated from warmup traces. With true switch probabilities, MARS guarantees with high probability that the early-stopped answer matches the full-budget vote. In practice, a five-feature logistic model closely matches oracle switching behavior. Across three reasoning models and three competition-math benchmarks, MARS saves 25-47% of self-consistency tokens and 14-29% on top of DeepConf Online, a strong confidence-weighted baseline that already filters and truncates weak traces, while matching the accuracy of the corresponding full-budget baselines.

大模型推理加速策略自一致性在线停止

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。