提出统一框架,实现无需数据的一步采样,提升多峰分布采样效率。
A Unified Framework for Data-Free One-Step Sampling via Wasserstein Gradient Flows

- 基于Wasserstein梯度流,统一不同散度下的采样速度场结构
- 理论揭示散度选择影响质量重分配效率,与区域覆盖不足有关
- 适用于无数据训练,可快速生成样本,适合多峰分布场景
我们构建了一个针对未归一化目标分布的、无需数据的一步采样的统一理论框架,基于Wasserstein梯度流。对于一大类标准f散度目标,我们证明其诱导的速度场具有通用形式 $ abla extbf{V}(x)=w(r(x))eta(x)$,其中 $eta(x)= abla ext{log}(p(x)/q(x))$ 在所有目标间共享,而函数 $w$ 仅由散度选择决定。该分解表明,标准f散度的漂移共享相同的渐近目标分布 $p$,主要差异在于对欠覆盖区域的瞬时修复努力的重新分配方式。为刻画此差异,我们推导出针对软欠覆盖泛函的一步区域响应理论,并获得压缩-弹性恒等式,将散度选择与质量传输至欠覆盖区域的几何特性联系起来。我们还将框架扩展至f散度族之外的对数方差(LV)散度,分析参考分布如何改变漂移结构,并提出一种实用的LV启发式替代方案用于无数据训练。基于该理论,我们实现了一种基于KDE的版本,并描述了互补的归一化流路径,支持训练后一步推断。在多峰高斯混合基准上的实验与理论预测一致,验证了该方法在这些目标上实现有效一步采样。
原文摘要 · Abstract (English)
We develop a unified theoretical framework for data-free one-step sampling from unnormalized target distributions based on Wasserstein gradient flows. For a broad class of standard f-divergence objectives, we show that the induced velocity field admits the universal form $\mathbf{V}(x)=w(r(x))\,β(x)$, where $β(x)=\nabla \log (p(x)/q(x))$ is shared across objectives and $w$ is determined solely by the choice of divergence. This decomposition shows that standard f-divergence drifts share the same asymptotic target distribution $p$ and differ primarily in how they redistribute transient repair effort across under-covered regions. To formalize this distinction, we derive a one-step regional-response theory for a soft under-coverage functional and obtain a compression--elasticity identity that links divergence choice to the geometry of mass transport into under-covered regions. We further extend the framework beyond the f-divergence family to the Log-Variance (LV) divergence, analyze how the reference distribution alters the resulting drift structure, and motivate a practical LV-inspired surrogate for data-free training. Based on this theory, we instantiate the framework with a KDE-based implementation and describe a complementary normalizing-flow route, enabling one-step inference after training. Experiments on multimodal Gaussian-mixture benchmarks are consistent with the theoretical predictions and demonstrate effective one-step sampling on these targets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。