arXiv:2608.04827stat.MLcs.LG2026-08

ILDM在未知流形上融合几何与概率,提升低数据场景生成质量。

Intrinsic-Hybrid Latent Diffusion Models for Generative Modeling on Unknown Manifolds

论文配图:Intrinsic-Hybrid Latent Diffusion Models for Generative Modeling on Unknown Manifolds
图 1 · 摘自论文原文
  • 将隐空间视为未知黎曼流形的局部坐标,用概率解码器建模几何与不确定性。
  • 前向过程根据局部不确定性切换黎曼与欧氏扩散,后向过程采用混合朗之万动态。
  • 在少量数据下仍优于传统扩散模型,适合医学图像等小样本生成任务。

我们提出内在混合隐空间扩散模型(ILDM),将概率降维与几何感知扩散结合,用于未知流形上的生成建模。尽管扩散模型在高维数据合成中表现优异,但依赖大规模训练数据且忽略内在几何结构;隐空间扩散模型虽降低维度,却通常假设欧氏结构,难以捕捉底层流形特征,尤其在数据稀疏时表现不佳。ILDM将隐空间视作未知黎曼流形的局部坐标,通过概率解码器量化几何与不确定性。前向过程为混合扩散,在局部不确定性高时切换至黎曼动力学,其由解码器推导的概率度量张量决定。为学习生成动态,提出适用于混合扩散的近似去噪得分匹配方法,实现由混合朗之万动力学定义的反向过程。在COIL-100、MNIST和心脏磁共振数据集上的实验表明,相较于标准扩散模型与隐空间扩散模型,ILDM显著提升生成质量,获得更低的FID与LPIPS分数。

原文摘要 · Abstract (English)

We introduce the Intrinsic Hybrid Latent Diffusion Model (ILDM), a generative framework that integrates probabilistic dimensionality reduction with geometry-aware diffusion on unknown manifolds. While diffusion models (DMs) have achieved state-of-the-art results in high-dimensional data synthesis, they rely on large training datasets and ignore intrinsic geometric structure. Latent diffusion models (LDMs) address the high dimensionality by learning a latent space, but they typically impose a Euclidean structure, failing to capture the underlying manifold geometry, especially problematic in data-sparse regimes. ILDM addresses these limitations by interpreting the latent space as a chart of an unknown Riemannian manifold, with geometry and uncertainty quantified through a probabilistic decoder. The forward process is a hybrid diffusion that switches between Riemannian and Euclidean dynamics based on local uncertainty, where the Riemannian component is governed by a probabilistic metric tensor derived from the decoder. To learn the generative dynamics, we introduce an approximate denoising score matching method tailored to the hybrid diffusion setting, enabling a backward process defined by hybrid Langevin dynamics. Experiments on COIL-100, MNIST, and cardiac MRI datasets demonstrate that ILDM significantly improves generation quality, achieving lower FID and LPIPS scores compared to standard diffusion and latent diffusion models.

生成模型流形学习扩散模型小样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。