提出一种新型生成模型速度场,提升收敛速度并解决非保守问题。
Finite-Particle Convergence Rates for Conservative and Non-Conservative Drifting Models

- 用核密度估计梯度替代原位移速度,构造保守型速度场。
- 在d维空间中实现粒子数为N时的收敛率$N^{-1/(d+4)}$。
- 适用于需要高精度生成和严格物理守恒的场景。
本文提出并分析了一种用于单步生成建模的保守型漂移方法。该方法将原始基于位移的漂移速度替换为核密度估计(KDE)梯度速度,即核平滑数据得分与核平滑模型得分之差。该速度为梯度场,解决了普遍位移型漂移场的非保守性问题。我们证明了在$ ^d$上连续时间有限粒子收敛界:联合熵恒等式导出经验Stein漂移、KDE平滑后费舍尔差异及平方中心速度的界。主要的有限粒子修正项为反核自相互作用项,并给出了确定性和高概率局部占据条件以控制该项。我们保持求积常数显式,并追踪其可能的带宽依赖性:在额外的$h$-均匀求积正则条件下,根残差速度率为$N^{-1/(d+4)}$;更一般的增长条件给出最优根速率$N^{-(2-β)/(2(d+4-β))}$,其中$0\le β<2$。此外,我们分析了使用拉普拉斯核的非保守漂移方法,对应于Deng等(2026)提出的原始位移型速度。对于该方法,一个尖锐伴随核将速度分解为正标量预条件的尖锐得分差异加上拉普拉斯尺度不匹配残差,产生类似有限粒子率,但包含不可避免的残差项。最后,我们解释了连续时间残差速度界如何通过显式漂移大小$η$转化为单步生成保证。
原文摘要 · Abstract (English)
We propose and analyze a conservative drifting method for one-step generative modeling. The method replaces the original displacement-based drifting velocity by a kernel density estimator (KDE)-gradient velocity, namely the difference of the kernel-smoothed data score and the kernel-smoothed model score. This velocity is a gradient field, addressing the non-conservatism issue identified for general displacement-based drifting fields. We prove continuous-time finite-particle convergence bounds for the conservative method on $\R^d$: a joint-entropy identity yields bounds for the empirical Stein drift, the smoothed Fisher discrepancy of the KDE, and the squared center velocity. The main finite-particle correction is a reciprocal-KDE self-interaction term, and we give deterministic and high-probability local-occupancy conditions under which this term is controlled. We keep the quadrature constants explicit and track their possible bandwidth dependence: the root residual-velocity rate $N^{-1/(d+4)}$ holds under an additional $h$-uniform quadrature regularity condition, while a more general growth condition yields the optimized root rate $N^{-(2-β)/(2(d+4-β))}$, where $0\le β<2$. We also analyze the non-conservative drifting method with Laplace kernel, corresponding to the original displacement-based velocity proposed in Deng et al., 2026 (arxiv:2602.04770). For this method, a sharp companion kernel decomposes the velocity into a positive scalar preconditioning of a sharp-score mismatch plus a Laplace scale-mismatch residual, producing an analogous finite-particle rate with an unavoidable residual term. Finally, we explain how the continuous-time residual-velocity bounds translate into one-step generation guarantees through the explicit drift size $η$.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。