通过图正则化让PCA更懂数据结构,提升主成分可解释性。
Graph Regularized PCA
- 用图结构约束主成分方向,抑制高频噪声,保留图内相关信号。
- 在高频率信号与图结构相关时,重构精度更高且更符合真实结构。
- 方法简单易实现,适合需要结构感知降维的科研与工程场景。
多变量数据常表现出复杂依赖关系,违背了残差噪声各向同性的假设。为此,本文提出图正则化PCA(GR-PCA),一种基于图结构的PCA正则化方法。它通过学习稀疏精度图,并将载荷向量偏向对应图拉普拉斯矩阵的低频傅里叶模式,从而抑制高频信号,保留图一致的低频成分,使主成分更具可解释性。我们在涵盖多种图拓扑、信噪比和稀疏度的合成数据上评估了该方法。相比主流方法,GR-PCA能将方差集中于预期支持区域,生成的载荷具有更低的图拉普拉斯能量,在样本外重建上仍具竞争力。当存在高频信号且其与图结构相关时,图拉普拉斯惩罚可防止过拟合,虽降低重构精度,但显著提升结构保真度。该优势在高频信号与图相关时最明显,而当信号近似旋转不变时,传统PCA仍具竞争力。该方法实现简单、与精度估计器解耦、可扩展,为结构感知降维提供实用路径,兼顾结构保真与预测性能。
原文摘要 · Abstract (English)
Multivariate data often exhibit complex dependencies that violate the assumption of isotropic residual noise. For such cases, we introduce Graph Regularized PCA (GR-PCA). It is a graph-based regularization of PCA that incorporates the dependency structure of the data features by learning a sparse precision graph and biasing loadings toward the low-frequency Fourier modes of the corresponding graph Laplacian. Consequently, high-frequency signals are suppressed, while graph-coherent low-frequency ones are preserved, yielding interpretable principal components aligned with conditional relationships. We evaluate GR-PCA on synthetic data spanning diverse graph topologies, signal-to-noise ratios, and sparsity levels. Compared to mainstream alternatives, it concentrates variance on the intended support, produces loadings with lower graph-Laplacian energy, and remains competitive in out-of-sample reconstruction. When high-frequency signals are present, the graph Laplacian penalty prevents overfitting, reducing the reconstruction accuracy but improving structural fidelity. The advantage over PCA is most pronounced when high-frequency signals are graph-correlated, whereas PCA remains competitive when such signals are nearly rotationally invariant. The procedure is simple to implement, modular with respect to the precision estimator, and scalable, providing a practical route to structure-aware dimensionality reduction that improves structural fidelity without sacrificing predictive performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。