用预训练模型加速加权采样,速度提升1.2到4.7倍。
Efficient Weighted Sampling via Score-based Generative Models
- 通过轻量引导项修正基分数模型,无需训练即可实现加权采样。
- 在Stable Diffusion XL上提速1.2至4.7倍,性能持平或超越现有方法。
- 动态调节引导强度,避免高阶导数计算,适合实时生成任务。
加权采样——从与基础概率密度函数和权重函数乘积成比例的分布中采样——是方差缩减、偏差采样、数据增强等领域的基础技术。借助日益普及的预训练分数生成模型(SGMs),我们提出一种无需训练的加权采样框架,通过在预训练基分数函数中加入辅助引导项,以合理且高效的方式近似目标分布的逆向扩散过程。该方法基于两大核心组件:一种避免计算分数和权重函数高阶导数的轻量级引导近似,以及一种基于时序误差分析动态调整引导强度的不确定性感知调度器。两者结合使采样更准确稳定,无需依赖粒子重采样或海森矩阵计算。我们在从合成场景到Stable Diffusion XL等大规模设置中验证了该方法的有效性,在任务性能保持一致或更优的同时,实现了1.2×至4.7×的速度提升。该方法为生成应用中的任务自适应、时间敏感采样提供了可扩展且推理高效的解决方案。
原文摘要 · Abstract (English)
Weighted sampling -- sampling from a probability density function (PDF) proportional to the product of a base PDF and a weight function -- is a fundamental technique with wide-ranging applications in variance reduction, biased sampling, data augmentation, and more. Leveraging the increasing availability of pretrained score-based generative models (SGMs), we propose a training-free weighted sampling framework that approximates the backward diffusion process of the target distribution by augmenting the pretrained base score function with an auxiliary guidance term, in a principled and computationally efficient manner. Our approach builds on two key components: a lightweight approximation of the guidance that avoids costly higher-order derivatives of both the score and weight functions, and an uncertainty-aware scheduler that dynamically adjusts the guidance strength based on a temporal analysis of approximation error. Together, these components enable accurate and stable sampling without relying on particle-based resampling or Hessian evaluations commonly required by existing methods. We validate the effectiveness of our method from synthetic to large-scale settings such as Stable Diffusion XL, where our framework achieves $1.2\times$ to $4.7\times$ speedups while consistently matching or outperforming state-of-the-art baselines in task performance. These results position our method as a scalable and inference-efficient solution for task-adaptive, time-sensitive sampling in generative applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。