arXiv:2602.10273stat.MLcs.LG2026-02被引 11

提出低延迟的序列级功率采样方法,让大模型推理更快更准。

Power-SMC: Low-Latency Sequence-Level Power Sampling for Training-Free LLM Reasoning

  • 用粒子滤波并行推进小样本,实时修正权重,保持批量解码效率
  • 在MATH500上将延迟从16-28倍降至1.4-3.3倍,性能媲美或超越传统方法
  • 无需训练,适合追求高效推理的部署场景

近年来大语言模型推理能力的提升可归因于分布锐化:引导生成偏向预训练模型已支持的高概率路径,而非修改权重。序列级功率分布 $π_α(yackslash x)/propto p_θ(yackslash x)^α$($α>1$)是这一现象的自然形式化,其质量集中于完整序列而非逐标记调整温度。已有研究显示,从该分布进行梅特罗波利斯-哈斯金斯(MH)采样可恢复强推理性能,但推理延迟增加一个数量级。本文提出 Power-SMC,一种无需训练的序列蒙特卡洛方法,在保持接近标准解码延迟的同时实现相同目标。Power-SMC 并行推进少量粒子,逐标记校正重要性权重,并在必要时重采样,整个过程可在单次 GPU 批量解码中完成。我们证明温度 $τ=1/α$ 是唯一最小化增量权重方差的前缀提议;通过前缀条件下的 Rényi 熵解释残余不稳定性,并引入指数桥接调度以提升粒子稳定性而不改变目标分布。在 MATH500 上,Power-SMC 的性能达到或超过 MH 功率采样,同时将延迟从 16–28 倍降至 1.4–3.3 倍。代码已开源。

原文摘要 · Abstract (English)

Many recent reasoning gains in large language models can be explained as distribution sharpening: biasing generation toward high-likelihood trajectories already supported by the pretrained model, rather than modifying its weights. A natural formalization is the sequence-level power distribution $π_α(y\mid x)\propto p_θ(y\mid x)^α$ ($α>1$), which concentrates mass on whole sequences instead of adjusting token-level temperature. Prior work shows that Metropolis--Hastings (MH) sampling from this distribution recovers strong reasoning performance, but at order-of-magnitude inference slowdowns. We introduce Power-SMC, a training-free Sequential Monte Carlo scheme that targets the same objective while remaining close to standard decoding latency. Power-SMC advances a small particle set in parallel, corrects importance weights token-by-token, and resamples when necessary, all within a single GPU-friendly batched decode. We prove that temperature $τ=1/α$ is the unique prefix-only proposal minimizing incremental weight variance, interpret residual instability via prefix-conditioned Rényi entropies, and introduce an exponent-bridging schedule that improves particle stability without altering the target. On MATH500, Power-SMC matches or exceeds MH power sampling while reducing latency from $16$--$28\times$ to $1.4$--$3.3\times$ over baseline decoding. The code is available at https://github.com/ArminAzizi98/Power-SMC.

大模型推理采样优化序列建模低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。