arXiv:2607.08783cs.LGcs.AI2026-07

提出基于李群的批量归一化方法,有效处理流形数据分布

LieBN: Batch Normalization over Lie Groups

论文配图:LieBN: Batch Normalization over Lie Groups
图 1 · 摘自论文原文
  • 利用李群的左右不变度量设计归一化框架
  • 在9种几何结构上验证有效性,涵盖对称正定等流形
  • 适合处理旋转矩阵、相关性矩阵等流形数据的任务

流形值测量广泛存在于各类机器学习任务中。近期研究已将深度神经网络扩展至流形空间,伴随而来的归一化技术统称为黎曼归一化。然而,现有方法多针对特定流形,或难以有效归一化流形上的样本分布。为此,我们提出LieBN,一种面向李群的黎曼批量归一化(RBN)框架。该方法利用李群固有的左右不变度量,理论上保证对黎曼均值与方差的控制。我们在九种不同几何结构上实例化LieBN:四种作用于对称正定(SPD)流形,一种作用于旋转矩阵群,四种作用于满秩相关性矩阵流形。其中,在SPD流形中引入一种新的右不变度量,并通过矩阵幂变形扩展三种现有李群结构。在多种流形上的实验验证了该框架的有效性。代码已开源。

原文摘要 · Abstract (English)

Manifold-valued measurements are prevalent in various machine learning tasks. Recent advances have extended Deep Neural Networks (DNNs) to operate on manifolds. These extensions have been accompanied by normalization techniques tailored to different geometries, collectively referred to as Riemannian normalization. However, most existing Riemannian normalization methods are either designed for specific manifolds or fail to effectively normalize manifold-valued sample distributions. To address these limitations, we propose LieBN, a framework for Riemannian Batch Normalization (RBN) over Lie groups. Our approach leverages the theoretically convenient left- and right-invariant metrics, which naturally exist in every Lie group, and provides theoretical guarantees for controlling the Riemannian mean and variance. We instantiate LieBN across nine distinct geometries: four on the Symmetric Positive Definite (SPD) manifold, one on the group of rotation matrices, and four on the manifold of full-rank correlation matrices. Notably, among the SPD metrics, we introduce a novel right-invariant metric and extend three existing Lie group structures via matrix power deformation. Experiments on different manifolds validate the effectiveness of our framework. The code is available at https://github.com/GitZH-Chen/LieBN.git.

流形学习李群归一化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。