让谱嵌入自动识别数据对称性,提升降维与聚类精度
Group Invariant Spectral Embedding

- 在相似性核中直接融入对称性约束,使相关点被正确关联
- 在无限数据下仍能恢复真实几何结构,标准方法则失败
- 适合处理旋转对称数据,如图像、3D点云等场景
谱嵌入广泛用于具有内在低维结构的高维数据降维与聚类。然而,许多实际数据集具有旋转等对称性,而标准谱嵌入方法未考虑此特性,将对称相关的数据点视为无关。本文通过将对称性直接纳入谱嵌入所用的相似性核中来解决该问题。针对带有紧李群 $G$ 对称性的黎曼数据流形 $M$,我们证明:在适当条件下,基于三种不变核构建的图拉普拉斯算子在点态上收敛到商空间 $M/G$ 上的显式二阶微分算子。分析表明,有效维度随群维数降低,从而实现更优的收敛速度。我们在具有 $ m{SO}(2)$ 或 $ m{SO}(3)$ 对称性的数据集上验证了该方法,结果表明 $G$-不变谱嵌入能准确恢复数据的内在几何结构,而标准方法即使在数据无限时也无法做到。
原文摘要 · Abstract (English)
Spectral embedding methods are widely used for dimensionality reduction and clustering of high-dimensional datasets with intrinsic low-dimensional structures. Although many datasets of practical interest exhibit invariance under symmetries such as rotations, standard spectral embedding methods do not account for this, treating symmetry-related data points as unrelated. Our approach to this problem is to incorporate the symmetries directly into the affinity kernels used for spectral embedding. We analyze the case of a Riemannian data manifold $M$ with symmetries given by a compact Lie group~$G$ and prove that, under suitable conditions, graph Laplacians constructed from three types of invariant kernels converge pointwise to explicit second-order differential operators on the quotient space $M/G$. Our analysis implies improved convergence rates, as the effective dimension drops according to the dimension of the group. We validate our approach on datasets with $\mathrm{SO}(2)$ or $\mathrm{SO}(3)$ symmetry, and show that $G$-invariant spectral embedding recovers the intrinsic geometry of the data, in contrast to standard spectral embedding, which fails to do so even in the limit of infinite data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。