提出新框架,让矩阵数据学习更符合真实关系结构。
Nested Inductive Bias Framework for SPD Manifold Learning
- 用双阶段微分映射将非欧几何迁移到对称正定流形上
- 实验证明:度量曲率不匹配会显著降低分类效果
- 适合做流形学习、信号处理中需建模内在关系的场景
在几何深度学习中,归纳偏置兼具约束流形结构与嵌入关系先验的功能。当前对称正定(SPD)流形上的表示学习多依赖对数-欧氏度量以满足前者,虽计算高效且避免域边界越界,但导致平坦几何,难以捕捉数据内在关系先验。尽管庞加莱度量广泛用于构建域对齐的关系先验,但将其从标准向量表示推广至SPD流形仍具挑战。为此,我们提出嵌套归纳偏置框架,通过两阶段微分同胚组合,将非欧目标几何正式拉回到SPD流形上。该框架支持构建同时满足矩阵约束与数据潜在关系几何的曲率对齐黎曼分类器。在运动学与信号处理基准及合成实验中,实证表明:除非度量曲率与数据内在分布一致,否则深度流形网络的类别可分性会显著退化。此外,针对标准向量化架构,我们提出有理共形度量(RCM),通过约束表示空间实现对异常值的最先进几何鲁棒性。
原文摘要 · Abstract (English)
In Geometric Deep Learning, inductive biases serve two primary functions: enforcing manifold constraints and embedding relational priors. Currently, representation learning on SPD manifolds frequently relies on pullback Euclidean metrics, such as the Log-Euclidean Metric, to satisfy the former. While computationally efficient in avoiding domain boundary violations, these metrics induce a flat geometry that may fail to capture the intrinsic relational priors of datasets. While metrics such as the Poincar\'e metric are widely utilized to induce domain-aligned relational priors, generalizing them from standard vector representations to the SPD manifold has remained a challenge. To bridge this gap, we introduce a Nested Inductive Bias framework that utilizes a two-stage diffeomorphic composition to formally pull back non-Euclidean target geometries onto the SPD manifold. This framework enables the construction of curvature-aligned Riemannian classifiers that simultaneously respect matrix constraints and the latent relational geometry of the data. Empirical evaluations on kinematic and signal processing benchmarks, together with synthetic experiments, demonstrate that deep manifold networks experience degradation in class separability unless the metric curvature aligns with the intrinsic data distribution. Furthermore, for standard vectorized architectures, we propose the Rational Conformal Metric (RCM), designed to establish state-of-the-art geometric robustness against outliers by bounding the representation space.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。