arXiv:2605.17850stat.MLcs.CV2026-05中稿 · ICML被引 1

无需梯度的扩散模型推理加速方法,提升生成质量且实现简单

Simple Approximation and Derivative Free Inference-Time Scaling for Diffusion Models via Sequential Monte Carlo on Path Measures

论文配图:Simple Approximation and Derivative Free Inference-Time Scaling for Diffusion Models via Sequential Monte Carlo on Path Measures
图 1 · 摘自论文原文
  • 通过路径重要性重加权实现无梯度采样,避免计算得分和海森矩阵
  • 在合成测试与基准上优于现有方法,生成质量更优且运行更高效
  • 适合追求低复杂度、高稳定性的生成模型应用者

基于扩散的生成模型越来越多地依赖推理时引导技术,如添加漂移项或重新加权专家混合,以提升任务特定目标下的样本质量。然而,大多数现有方法需要重复评估得分或梯度,引入偏差或高计算开销。本文提出 exttt{URGE}(Unbiased Resampling via Girsanov Estimation),一种无梯度的推理时缩放算法,通过戈尔桑夫测度变换对路径进行重要性重加权。与以往需计算梯度的粒子权重不同, exttt{URGE} 仅对每条模拟轨迹附加一个简单的乘法权重,并定期重采样。无需得分、海森矩阵或偏微分方程求解。我们建立了路径级与粒子级序列蒙特卡洛(SMC)的等价性:戈尔桑夫路径权重可表示为后向条件期望,恢复出之前的粒子级权重,确保两种方案产生相同的无偏终态分布。实验表明, exttt{URGE} 在合成测试和扩散模型基准上均优于现有推理时引导基线,生成质量更好,同时实现更简单、完全无梯度。

原文摘要 · Abstract (English)

iffusion-based generative models increasingly rely on inference-time guidance, adding a drift term or reweighting mixture of experts, to improve sample quality on task-specific objectives. However, most existing techniques require repeated score or gradient evaluations, introducing bias, high computational overhead, or both. We introduce \texttt{URGE}, Unbiased Resampling via Girsanov Estimation, a derivative-free inference-time scaling algorithm that performs path-wise importance reweighting via a Girsanov change of measure. Instead of computing gradient-based particle weights in previous work, \texttt{URGE} attaches a simple multiplicative weight to each simulated trajectory and periodically resamples. No score, no Hessian, and no PDE evaluation is required. We establish an equivalence between path-wise and particle-wise SMC: the Girsanov path weight admits a backward conditional expectation that recovers the previous particle-level weights, guaranteeing that both schemes produce the same unbiased terminal law. Empirically, \texttt{URGE} outperforms existing inference-time guidance baselines on synthetic tests and diffusion-model benchmarks, achieving better generation quality, while being significantly simpler to implement and fully gradient-free.

扩散模型无梯度采样优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。