arXiv:2605.04406cs.LG2026-05

提出可学习的流形度量,让矩阵表示更灵活、更稳定。

Beyond Rigid Geometries: The Spline-Pullback Metric for Universal Diffeomorphic SPD Representation Learning

论文配图:Beyond Rigid Geometries: The Spline-Pullback Metric for Universal Diffeomorphic SPD Representation Learning
图 1 · 摘自论文原文
  • 用B样条参数化几何变换,实现通用流形逼近。
  • 在3个数据集上超越现有方法,提升模型表达力。
  • 适合做矩阵型数据的深度学习,如医学图像分析。

将对称正定(SPD)矩阵融入深度学习长期依赖于固定的代数黎曼度量,这类静态结构如同传统机器学习中的手工特征,限制了网络的表达能力和适应性。近期尝试参数化度量的方法常因不受约束的幂次或秩相关缩放而违反矩阵函数的基本公理,导致空间折叠、全局满射性丧失及谱奇异点处梯度崩溃。本文提出样条拉回度量(SPM),包括谱式SPM与分解式SPM,实现了从固定度量选择到通用几何逼近的范式转变。通过秩无关且单调约束的B样条参数化全局微分同胚,SPM作为严格递增C¹微分同胚的稠密通用逼近器,理论上涵盖已有拉回度量,并支持局部非线性谱建模。拓扑上,SPM提供全局双射的拉回几何,避免秩交换不连续性和梯度不稳定性。实验表明,使用线性探测、SPDNets和深层黎曼残差网络,在3个数据集上均达到当前最优性能。

原文摘要 · Abstract (English)

The integration of Symmetric Positive Definite (SPD) matrices into deep learning has historically relied on fixed algebraic Riemannian metrics. Analogous to hand-crafted features in classical machine learning, these static formulations impose rigid geometries limiting network expressivity and adaptability. Recent attempts to parameterize these geometries often violate the axioms of primary matrix functions through unconstrained powers or rank-dependent scaling, inviting spatial folding, loss of global surjectivity, and gradient collapse at spectral singularities. In this paper, we introduce the Spline-Pullback Metric (SPM), instantiated as Spectral-SPM and Cholesky-SPM, marking a paradigm shift from static metric selection to universal geometric approximation. By parameterizing the global diffeomorphism via a rank-invariant, monotonically constrained B-spline, SPM acts as a dense universal approximator for strictly increasing $C^1$ diffeomorphisms and theoretically subsumes existing pullback metrics while enabling localized non-linear spectral modelling. Topologically, SPM provides a globally bijective pullback geometry precluding rank-swapping discontinuities and gradient instabilities. Empirically, SPM achieves a state-of-the-art performance across 3 datasets utilizing Linear Probes, SPDNets, and deep Riemannian ResNets.

SPD矩阵流形学习深度学习度量学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。