提出新方法保持非欧数据几何结构,显著提升下游任务精度。
IIKL: Isometric Immersion Kernel Learning with Riemannian Manifold for Geometric Preservation
- 通过黎曼流形实现等距嵌入,保留数据内蕴几何特性。
- 相比顶尖方法,内积不变性损失降低超90%,重建准确率平均提升40%。
- 适合需要精确几何建模的科学计算与高维数据分析场景。
在科学应用中,保持离散非欧数据的内在几何与拓扑性质对于几何表示学习至关重要。以往研究通常将非欧离散数据映射到欧氏空间进行表示学习,可能导致关键几何信息丢失。本文提出一种新的等距嵌入核学习(IIKL)方法,构建黎曼流形并从离散非欧数据中等距诱导黎曼度量。我们证明等距嵌入等价于流形切丛上的核函数,显式保证任意切空间中向量内积在学习过程中保持不变,从而维持原始数据的几何结构。此外,引入基于IIKL的参数化学习模型,并使用最大似然估计推导出交替训练方法,确保高效收敛。实验结果表明,利用所学黎曼流形及其度量,该模型成功在三维和高维数据集中保持了数据的内在几何表示,显著提升了下游任务性能,如数据重构与分类。结果显示,相较当前最优方法,内积不变性损失减少超过90%,下游重构准确率平均提升40%,涉及等距与共形的几何度量误差降低90%。
原文摘要 · Abstract (English)
Geometric representation learning in preserving the intrinsic geometric and topological properties for discrete non-Euclidean data is crucial in scientific applications. Previous research generally mapped non-Euclidean discrete data into Euclidean space during representation learning, which may lead to the loss of some critical geometric information. In this paper, we propose a novel Isometric Immersion Kernel Learning (IIKL) method to build Riemannian manifold and isometrically induce Riemannian metric from discrete non-Euclidean data. We prove that Isometric immersion is equivalent to the kernel function in the tangent bundle on the manifold, which explicitly guarantees the invariance of the inner product between vectors in the arbitrary tangent space throughout the learning process, thus maintaining the geometric structure of the original data. Moreover, a novel parameterized learning model based on IIKL is introduced, and an alternating training method for this model is derived using Maximum Likelihood Estimation (MLE), ensuring efficient convergence. Experimental results proved that using the learned Riemannian manifold and its metric, our model preserved the intrinsic geometric representation of data in both 3D and high-dimensional datasets successfully, and significantly improved the accuracy of downstream tasks, such as data reconstruction and classification. It is showed that our method could reduce the inner product invariant loss by more than 90% compared to state-of-the-art (SOTA) methods, also achieved an average 40% improvement in downstream reconstruction accuracy and a 90% reduction in error for geometric metrics involving isometric and conformal.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。