arXiv:2608.07924cs.LGcs.AI2026-08

通过引入速度变量,让生成模型更快恢复细节结构。

Second Order Drifting Models

论文配图:Second Order Drifting Models
图 1 · 摘自论文原文
  • 在生成样本中加入虚拟速度变量,实现二阶动态演化
  • 在频域中实现加速收敛,提升细粒度结构重建能力
  • 适合需要快速生成高质量结果的场景,如机器人控制

漂移模型是一类新型的一步生成模型,通过预定义的基于样本的漂移场在训练中演变模型分布。尽管避免了迭代推断,其核函数驱动的漂移场会导致频率相关的训练动态:在线性化情况下,密度残差的每个傅里叶分量以由核谱决定的速率衰减,导致精细结构恢复缓慢。本文提出二阶漂移模型,通过将生成样本扩展至相空间(引入人工速度变量)来提升漂移动力学。我们证明,由此产生的密度扰动在傅里叶空间中遵循加速的二阶动力学,与优化中的著名Nesterov加速法建立联系。该方法提供了一种有理论依据的手段,缓解一阶漂移模型的频谱刚性,同时保持一步推理优势。我们推导出一种实用的半隐式训练算法,并在合成分布匹配、序列数据生成和机器人控制任务上进行评估。在各项任务中,二阶漂移模型均改善收敛行为,并达到或优于一阶漂移基线的性能。

原文摘要 · Abstract (English)

Drifting models are a recent class of one-step generative models that evolve the model distribution during training using a predefined sample-based drift field. Although they avoid iterative inference, their kernel-based drift fields induce frequency-dependent training dynamics: In the linearized regime, each Fourier mode of the density residual decays at a rate determined by the kernel spectrum, leading to slow recovery of fine-scale structure. We propose Second-Order Drifting Models, which lift drifting dynamics into phase space by augmenting generated samples with artificial velocity variables. We show that the resulting density perturbations obey accelerated second-order dynamics in Fourier space, connecting drifting models to the celebrated Nesterov acceleration from optimization theory. This provides a principled mechanism for mitigating the spectral stiffness of first-order drifting while preserving one-step inference. We derive a practical semi-implicit training algorithm and evaluate it on synthetic distribution matching, sequential data generation, and robotic control. Across these settings, the second-order drifting model improves convergence behavior and achieves competitive or superior performance over first-order drifting baselines.

生成模型加速训练相空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。