用分数驱动方法提取数据流形几何,可高效估算内在维度并生成高质量测地线。
Score-based Pullback Riemannian Geometry: Extracting the Data Manifold Geometry using Anisotropic Flows
- 结合得分模型与拉回黎曼几何,构建可扩展的流形学习框架
- 在图像等数据上实现高精度测地线生成和内在维数估计
- 适合需要理解数据结构的机器学习研究者使用
数据驱动的黎曼几何已成为可解释表征学习的强大工具,能提升下游任务效率。本文提出一种可扩展的分数驱动拉回黎曼几何框架,融合拉回几何与生成模型思想。针对单峰分布,提出具有闭式测地线的得分型黎曼结构,测地线穿过数据概率密度。基于此构造了带误差界的数据流形自动编码器(RAE),可发现正确数据流形维度。该框架可自然结合各向异性归一化流,训练时引入等距正则化。在多种数据集(包括图像)上的数值实验表明,该方法能生成通过数据支撑集的高质量测地线,可靠估计数据流形的内在维度,并提供流形的全局坐标图。据我们所知,这是首个可扩展的完整数据流形几何提取框架。
原文摘要 · Abstract (English)
Data-driven Riemannian geometry has emerged as a powerful tool for interpretable representation learning, offering improved efficiency in downstream tasks. Moving forward, it is crucial to balance cheap manifold mappings with efficient training algorithms. In this work, we integrate concepts from pullback Riemannian geometry and generative models to propose a framework for data-driven Riemannian geometry that is scalable in both geometry and learning: score-based pullback Riemannian geometry. Focusing on unimodal distributions as a first step, we propose a score-based Riemannian structure with closed-form geodesics that pass through the data probability density. With this structure, we construct a Riemannian autoencoder (RAE) with error bounds for discovering the correct data manifold dimension. This framework can naturally be used with anisotropic normalizing flows by adopting isometry regularization during training. Through numerical experiments on diverse datasets, including image data, we demonstrate that the proposed framework produces high-quality geodesics passing through the data support, reliably estimates the intrinsic dimension of the data manifold, and provides a global chart of the manifold. To the best of our knowledge, this is the first scalable framework for extracting the complete geometry of the data manifold.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。