在不依赖几何信息的情况下,让扩散过程在数据流形上自然演化。
Diffusion Processes on Implicit Manifolds

- 基于点云构建邻近图,用生成器逼近流形上的扩散过程。
- 理论证明采样增多时离散过程收敛到连续流形解。
- 适合需要流形感知生成与探索的模型开发者。
高维数据通常被认为位于低维流形上。本文研究如何仅通过点云样本,在无图表、投影或其他几何工具的情况下,构建定义在该数据流形上的扩散过程。为此,提出隐式流形扩散(IMD),一种数据驱动的数学形式,可在原始高维空间中定义描述粒子沿流形内在演化的随机微分方程。其核心是利用数据上的邻近图近似扩散过程的无穷小生成器,并通过生成器的carré-du-champ算子编码流形局部切空间,将内在过程映射回环境坐标。我们证明,随着样本数增加,离散扩散过程在概率路径空间上依分布收敛至光滑流形对应解。进一步提出了IMD的Euler-Maruyama数值积分方案。在合成流形和MNIST数据流形上的实验验证表明,IMD能保持在流形内部,并支持流形引导探索。本工作为数据流形上的扩散过程提供了数学基础与实际实现,开辟了流形感知采样、探索与生成建模的新路径。
原文摘要 · Abstract (English)
High-dimensional data are often assumed to lie on lower-dimensional manifolds. We study how to construct diffusion processes on this data manifold using only point cloud samples and without access to charts, projections, or other geometric primitives. Here, we introduce Implicit Manifold-valued Diffusions (IMDs), a data-driven mathematical formalism for defining stochastic differential equations in the original high-dimensional space that describe drifting Brownian particles evolving intrinsically on the underlying manifold. Our construction hinges on approximating the corresponding infinitesimal generator of the diffusion process using a proximity graph over the data and using the carré-du-champ of the generator, which encodes the local tangent spaces of the manifold and lifts the intrinsic process into ambient coordinates. We show that as the number of samples grows, our discrete diffusion process converges in law on the space of probability paths to its smooth manifold counterpart. We further present an Euler-Maruyama scheme for the numerical integration of IMDs. We validate our framework using numerical experiments on synthetic manifolds and the MNIST data manifold, showing that IMDs remain confined over the manifold and enable its guided exploration. Our work provides the mathematical foundation and practical implementations of diffusion processes on data manifolds, opening new avenues for manifold-aware sampling, exploration, and generative modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。