arXiv:2601.01097stat.MLcs.LG2026-01ICLR被引 7

提出在非紧对称空间上构建神经网络的新方法,统一了点到超平面的距离计算。

Neural Networks on Symmetric Spaces of Noncompact Type

  • 基于统一的点到超平面距离公式,构建适用于非紧对称空间的神经网络
  • 推导出高阶非紧对称空间中点到超平面的闭式距离表达式
  • 在图像分类、脑电分类等任务中验证有效性,适合几何结构复杂的任务

近期研究显示神经网络在双曲空间和对称正定(SPD)流形上表现优异。这些空间属于一类称为非紧型对称空间的黎曼流形。本文提出一种在该类空间上构建神经网络的新方法,其核心是统一的点到超平面距离公式。我们证明,某些已有距离公式的特殊情形可由本方法恢复。进一步地,我们推导出在配备 G-不变黎曼度量的高阶非紧型对称空间中,点到超平面距离的闭式表达式。该距离公式被用于设计全连接层与注意力机制。所提方法在图像分类、脑电图(EEG)信号分类、图像生成及自然语言推理等挑战性基准上得到验证。

原文摘要 · Abstract (English)

Recent works have demonstrated promising performances of neural networks on hyperbolic spaces and symmetric positive definite (SPD) manifolds. These spaces belong to a family of Riemannian manifolds referred to as symmetric spaces of noncompact type. In this paper, we propose a novel approach for developing neural networks on such spaces. Our approach relies on a unified formulation of the distance from a point to a hyperplane on the considered spaces. We show that some existing formulations of the point-to-hyperplane distance can be recovered by our approach under specific settings. Furthermore, we derive a closed-form expression for the point-to-hyperplane distance in higher-rank symmetric spaces of noncompact type equipped with G-invariant Riemannian metrics. The derived distance then serves as a tool to design fully-connected (FC) layers and an attention mechanism for neural networks on the considered spaces. Our approach is validated on challenging benchmarks for image classification, electroencephalogram (EEG) signal classification, image generation, and natural language inference.

神经网络流形学习对称空间几何深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。