arXiv:2606.09816cs.CVcs.AI2026-06

用周期性终端分布提升扩散模型对流形数据的建模能力

PTL-Diffusion: Manifold-Aware Diffusion with Periodic Terminal Laws

论文配图:PTL-Diffusion: Manifold-Aware Diffusion with Periodic Terminal Laws
图 1 · 摘自论文原文
  • 前向过程引入周期性高斯终端分布,显式编码数据局部相位结构
  • 在环面、圆柱点云和人脸数据上,相位误差和流形距离显著降低
  • 适合需要精确建模周期性或流形结构的数据生成任务

标准扩散模型通常采用单一时间齐性高斯终端分布作为生成参考。尽管该选择在理论上简洁且实践有效,但对集中在低维流形上的数据缺乏显式结构支持,导致逆向模型需从无结构的终端分布中几乎完全恢复流形特征。本文提出PTL-Diffusion,一个概念验证型扩散框架,其前向加噪过程收敛至非恒定的周期性高斯终端分布族,而非单一不变分布。与仅在去噪网络中引入相位信息的相位条件DDPM不同,PTL-Diffusion将相位结构直接嵌入前向加噪动态中。所提构造保持与标准去噪扩散模型相近:针对周期性驱动的Ornstein–Uhlenbeck型前向过程,推导出闭合形式的前向边缘分布、极限周期性高斯终端族及显式高斯逆后验,支持标准噪声预测训练。同时引入基于平均周期性参考律的不变平均正则化项,耦合相位条件下的逆向动态。在环面、圆柱点云基准及Olivetti人脸数据集上的实验表明,相比匹配的DDPM基线,PTL-Diffusion在流形级分布匹配方面表现更优,显著降低相位条件误差、特征空间协方差误差及最近邻流形距离。结果表明,结构化终端参考律是富有前景的方向,也激励更丰富的相位构造与更大规模评估。

原文摘要 · Abstract (English)

Standard diffusion models typically use a single time-homogeneous Gaussian terminal distribution as the reference law for generation. While this choice is analytically convenient and empirically powerful, it provides little explicit structure for data concentrated near low-dimensional manifolds, where different regions of the data distribution may correspond to distinct local geometric or semantic factors. As a result, the reverse model must recover manifold-level structure almost entirely from an unstructured terminal reference distribution. We propose PTL-Diffusion, a proof-of-concept diffusion framework whose forward noising process converges to a nonconstant periodic family of Gaussian terminal laws rather than to a single invariant law. Unlike a phase-conditioned DDPM, where phase information only enters the denoising network while the forward process remains unchanged, PTL-Diffusion embeds phase structure directly into the forward noising dynamics. The proposed construction remains close to standard denoising diffusion models: for a periodically forced Ornstein--Uhlenbeck-type forward process, we derive closed-form forward marginals, the limiting periodic Gaussian terminal family, and explicit Gaussian reverse posteriors, enabling standard noise-prediction training. We also introduce an invariant-average regularization term coupling the phase-conditioned reverse dynamics through the averaged periodic reference law. Experiments on torus and cylinder point-cloud benchmarks and the Olivetti face dataset show that PTL-Diffusion improves manifold-level distributional matching over matched DDPM baselines, reducing phase-conditioned errors, feature-space covariance errors, and nearest-neighbour manifold distances. These results suggest structured terminal reference laws as a promising direction, while motivating more expressive phase constructions and larger-scale evaluations.

扩散模型流形学习周期性建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。