新方法让主成分分析更懂数据曲率,提升小样本下的降维效果。
Curvature-Aware PCA with Geodesic Tangent Space Aggregation for Semi-Supervised Learning

- 用局部曲率加权替代全局协方差,自适应数据流形结构。
- 在低样本、高曲率场景下优于传统PCA和UMAP等方法。
- 适合需要几何感知降维的科研与工业应用。
主成分分析(PCA)是表示学习的基础工具,但其全局线性形式难以捕捉定义在弯曲流形上的数据结构。相比之下,流形学习虽能建模非线性,却常牺牲PCA的谱结构与稳定性。本文提出 extit{测地切空间聚合主成分分析}(GTSA-PCA),一种在统一谱框架内融合曲率感知与测地一致性几何扩展的PCA方法。该方法将全局协方差算子替换为基于$k$-近邻图的曲率加权局部协方差算子,生成适应流形且抑制高曲率失真的局部切空间;进而引入测地对齐算子,结合图内距离与子空间亲和度,全局同步局部表示。所得算子可进行谱分解,其前导分量构成几何感知嵌入。进一步融入半监督信息引导对齐,以最小监督提升判别结构。真实数据集实验显示,在小样本和高曲率条件下,本方法持续优于标准PCA、核主成分分析(Kernel PCA)、有监督PCA及强图基基准如UMAP。
原文摘要 · Abstract (English)
Principal Component Analysis (PCA) is a fundamental tool for representation learning, but its global linear formulation fails to capture the structure of data supported on curved manifolds. In contrast, manifold learning methods model nonlinearity but often sacrifice the spectral structure and stability of PCA. We propose \emph{Geodesic Tangent Space Aggregation PCA (GTSA-PCA)}, a geometric extension of PCA that integrates curvature awareness and geodesic consistency within a unified spectral framework. Our approach replaces the global covariance operator with curvature-weighted local covariance operators defined over a $k$-nearest neighbor graph, yielding local tangent subspaces that adapt to the manifold while suppressing high-curvature distortions. We then introduce a geodesic alignment operator that combines intrinsic graph distances with subspace affinities to globally synchronize these local representations. The resulting operator admits a spectral decomposition whose leading components define a geometry-aware embedding. We further incorporate semi-supervised information to guide the alignment, improving discriminative structure with minimal supervision. Experiments on real datasets show consistent improvements over PCA, Kernel PCA, Supervised PCA and strong graph-based baselines such as UMAP, particularly in small sample size and high-curvature regimes. Our results position GTSA-PCA as a principled bridge between statistical and geometric approaches to dimensionality reduction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。