arXiv:2504.15736cs.LGstat.ML2025-04

在流形上实现概率分布的高效生成,解决传统方法在非欧空间的误差问题。

Riemannian Neural Geodesic Interpolant

  • 基于黎曼几何测地线设计神经网络插值模型,支持流形上的概率分布转换。
  • 新采样算法E-SDE显著降低离散误差,提升生成质量,实验显示在S2和SO(3)上有效。
  • 适合需要在旋转、球面等非欧空间进行生成建模的研究者使用。

随机插值模型能在有限时间内高效连接任意两个概率密度函数,实现从源分布到目标分布的灵活生成。现有方法主要基于欧氏空间,难以应用于真实场景中定义于黎曼流形上的分布学习问题。本文提出黎曼神经测地插值模型(RNGI),沿随机测地线在黎曼流形上插值两个概率密度,并通过另一端点出发的连续流采样最终状态。我们证明RNGI的时变边缘密度满足黎曼流形上的传输方程。训练神经速度场与得分场后,提出嵌入型随机微分方程(E-SDE)算法用于RNGI的随机采样。E-SDE通过减少经典测地随机游走(GRW)算法中黎曼布朗运动过度离散带来的累积误差,显著提升采样质量。同时提供了以KL散度衡量生成偏差的理论边界。实验在S2和SO(3)上的真实与合成数据集上验证了RNGI与E-SDE的有效性。

原文摘要 · Abstract (English)

Stochastic interpolants are efficient generative models that bridge two arbitrary probability density functions in finite time, enabling flexible generation from the source to the target distribution or vice versa. These models are primarily developed in Euclidean space, and are therefore limited in their application to many distribution learning problems defined on Riemannian manifolds in real-world scenarios. In this work, we introduce the Riemannian Neural Geodesic Interpolant (RNGI) model, which interpolates between two probability densities on a Riemannian manifold along the stochastic geodesics, and then samples from one endpoint as the final state using the continuous flow originating from the other endpoint. We prove that the temporal marginal density of RNGI solves a transport equation on the Riemannian manifold. After training the model's the neural velocity and score fields, we propose the Embedding Stochastic Differential Equation (E-SDE) algorithm for stochastic sampling of RNGI. E-SDE significantly improves the sampling quality by reducing the accumulated error caused by the excessive intrinsic discretization of Riemannian Brownian motion in the classical Geodesic Random Walk (GRW) algorithm. We also provide theoretical bounds on the generative bias measured in terms of KL-divergence. Finally, we demonstrate the effectiveness of the proposed RNGI and E-SDE through experiments conducted on both collected and synthetic distributions on S2 and SO(3).

生成模型黎曼几何测地线

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。