用扩散模型的得分函数构建数据流形的几何度量,实现自然图像间的平滑变换。
What's Inside Your Diffusion Model? A Score-Based Riemannian Metric to Explore the Data Manifold
- 基于扩散模型的得分函数构造黎曼度量,无需显式参数化即可刻画数据流形几何。
- 在旋转MNIST和Stable Diffusion生成图上,生成路径更平滑,感知质量提升(LPIPS↓,FID/KID↓)。
- 适合研究生成模型内在结构或需要可控图像插值的科研与应用开发者。
扩散模型虽能捕捉复杂图像分布,但其学习到的数据流形几何特性仍不明确。本文提出一种基于得分的黎曼度量,利用扩散模型中的Stein得分函数,在不需显式参数化的情况下刻画数据流形的内在几何。该方法在环境空间中定义了一个度量张量,使垂直于流形的方向距离被拉伸,而切向方向保持不变,从而形成一条使测地线自然沿流形轮廓行进的几何结构。我们设计了高效算法计算这些测地线,并证明其在数据点间插值和超出观测分布外推方面的实用性。在具有已知几何的合成数据、旋转MNIST及通过Stable Diffusion生成的复杂自然图像上进行实验,结果表明,该得分测地线能捕捉符合底层数据分布的有意义变换。相比基线方法,本方法在感知指标(LPIPS)和分布级指标(FID、KID)上均有显著提升,生成图像过渡更平滑、更真实。这揭示了扩散模型所隐含的几何结构,并为通过黎曼几何视角导航自然图像流形提供了理论依据。
原文摘要 · Abstract (English)
Recent advances in diffusion models have demonstrated their remarkable ability to capture complex image distributions, but the geometric properties of the learned data manifold remain poorly understood. We address this gap by introducing a score-based Riemannian metric that leverages the Stein score function from diffusion models to characterize the intrinsic geometry of the data manifold without requiring explicit parameterization. Our approach defines a metric tensor in the ambient space that stretches distances perpendicular to the manifold while preserving them along tangential directions, effectively creating a geometry where geodesics naturally follow the manifold's contours. We develop efficient algorithms for computing these geodesics and demonstrate their utility for both interpolation between data points and extrapolation beyond the observed data distribution. Through experiments on synthetic data with known geometry, Rotated MNIST, and complex natural images via Stable Diffusion, we show that our score-based geodesics capture meaningful transformations that respect the underlying data distribution. Our method consistently outperforms baseline approaches on perceptual metrics (LPIPS) and distribution-level metrics (FID, KID), producing smoother, more realistic image transitions. These results reveal the implicit geometric structure learned by diffusion models and provide a principled way to navigate the manifold of natural images through the lens of Riemannian geometry.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。