从能量模型中推导出数据流形的度量,让路径更贴近真实数据分布。
Follow the Energy, Find the Path: Riemannian Metrics from Energy-Based Models
- 利用预训练能量模型直接生成随空间变化的度量
- 在高维数据上生成更贴近真实轨迹、曲率更小的测地线
- 适用于生成建模与模拟中的几何驱动学习
高维空间中两点间的最短路径是什么?在欧几里得几何中答案显而易见,但当数据位于弯曲流形上时,需借助黎曼度量描述局部曲率。然而,在高维下估计该度量仍是重大挑战。本文提出一种从预训练能量模型(EBM)直接推导黎曼度量的方法——这类生成模型为高密度区域分配低能量。所导出的度量定义了随空间变化的距离,可计算测地线,即遵循数据流形内在几何的最短路径。我们引入两种基于EBM的新度量,并证明其生成的测地线更贴近数据流形,曲率失真更低,与真实轨迹对齐度更高。我们在逐步复杂的数据集上评估:具有已知密度的合成数据、几何可解释的旋转字符图像,以及嵌入在预训练VAE潜空间中的高分辨率自然图像。结果表明,基于EBM的度量在高维场景下持续优于现有基线。这是首个从EBM推导黎曼度量的工作,使数据感知的测地线成为可能,为生成建模与模拟提供了可扩展的几何驱动学习新范式。
原文摘要 · Abstract (English)
What is the shortest path between two data points lying in a high-dimensional space? While the answer is trivial in Euclidean geometry, it becomes significantly more complex when the data lies on a curved manifold -- requiring a Riemannian metric to describe the space's local curvature. Estimating such a metric, however, remains a major challenge in high dimensions. In this work, we propose a method for deriving Riemannian metrics directly from pretrained Energy-Based Models (EBMs) -- a class of generative models that assign low energy to high-density regions. These metrics define spatially varying distances, enabling the computation of geodesics -- shortest paths that follow the data manifold's intrinsic geometry. We introduce two novel metrics derived from EBMs and show that they produce geodesics that remain closer to the data manifold and exhibit lower curvature distortion, as measured by alignment with ground-truth trajectories. We evaluate our approach on increasingly complex datasets: synthetic datasets with known data density, rotated character images with interpretable geometry, and high-resolution natural images embedded in a pretrained VAE latent space. Our results show that EBM-derived metrics consistently outperform established baselines, especially in high-dimensional settings. Our work is the first to derive Riemannian metrics from EBMs, enabling data-aware geodesics and unlocking scalable, geometry-driven learning for generative modeling and simulation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。