arXiv:2605.10727cs.LGmath.DG2026-05被引 4

用核函数梯度替代固定方向,实现无需蒸馏的一步生成新方法

Kernel-Gradient Drifting Models

论文配图:Kernel-Gradient Drifting Models
图 1 · 摘自论文原文
  • 以核函数梯度作为生成方向,突破传统欧氏空间限制
  • 在地球科学、基因序列和分子生成任务中达到顶尖性能
  • 适用于流形与离散数据,理论可解释性更强

我们提出核梯度漂移(kernel-gradient drifting),一种一步生成框架,将漂移模型中固定的欧氏位移方向替换为由核函数自身诱导的方向。标准漂移方法因无需蒸馏大型预训练扩散模型即可实现快速高质量生成而具有吸引力,但其理论目前主要局限于高斯核情形,此时漂移等价于平滑得分匹配且可识别。我们的基于梯度的重构揭示了通用核函数下的得分结构:所得漂移为核平滑数据分布与模型分布之间的得分差,对特征核具有可识别性,并可解释为平滑KL散度的下降过程。由于核梯度是内在切向量,该构造自然扩展至黎曼流形及通过概率单纯形的Fisher-Rao几何处理离散数据。在球面地理空间数据、启动子DNA与分子生成任务中,核梯度漂移实现了超越欧氏设置的最新水平一步生成,且无需蒸馏。

原文摘要 · Abstract (English)

We propose kernel-gradient drifting, a one-step generative modeling framework that replaces the fixed Euclidean displacement direction in drifting models with directions induced by the kernel itself. Standard drifting is attractive because it enables fast, high-quality generation without distilling a large pretrained diffusion model, but its theory is currently understood mainly for Gaussian kernels, where the drift coincides with smoothed score matching and is identifiable. Our gradient-based reformulation exposes this score-based structure for general kernels: the resulting drift is the score difference between kernel-smoothed data and model distributions, yielding identifiability for characteristic kernels and a smoothed-KL descent interpretation of the drifting dynamics. Since kernel gradients are intrinsic tangent vectors, the same construction extends naturally to Riemannian manifolds and to discrete data via the Fisher-Rao geometry of the probability simplex. Across spherical geospatial data, promoter DNA and molecule generation, kernel-gradient drifting enables state-of-the-art one-step generation beyond the Euclidean setting without distillation.

生成模型核方法一步生成流形学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。