arXiv:2607.21039cs.LG2026-07

提出新方法提升噪声下图数据的聚类精度

Regularized Optimization on Grassmann Manifold: Theory, Algorithm and Applications

论文配图:Regularized Optimization on Grassmann Manifold: Theory, Algorithm and Applications
图 1 · 摘自论文原文
  • 在流形上优化投影矩阵,加入正则项增强鲁棒性
  • 实验显示在噪声环境下聚类准确率显著提升
  • 适合做图聚类、社区发现且对噪声敏感的任务

谱方法广泛用于社区检测、聚类和图学习,但其性能严重依赖于底层谱子空间的精确估计,在噪声、异常值或模型扰动下会明显下降。为此,本文提出正则化投影矩阵近似(RPMA)框架,用于鲁棒估计秩为K的投影矩阵。该方法通过在经典谱投影中引入正则项,使估计结果更具鲁棒性、稀疏性和可解释性。将模型定义为在秩-K投影矩阵流形上的优化问题,并利用其与Grassmann流形的几何等价性,推导出一阶和二阶最优性条件,证明了正则化主特征空间的局部稳定性,并刻画了在小正则化条件下临界点景观的稳定性。为高效求解非凸优化问题,提出了带回溯线搜索的黎曼梯度投影算法,以及避免重复特征分解的更高效Cayley-SMW梯度方法。在合成与真实数据集上的大量实验表明,RPMA显著提升了投影矩阵恢复精度,在噪声环境中始终优于传统谱投影方法。

原文摘要 · Abstract (English)

Spectral methods are among the most widely used techniques for community detection, clustering, and graph learning. Their performance, however, critically depends on the accurate estimation of the underlying spectral subspace and can deteriorate substantially in the presence of noise, outliers, or model perturbations. To address this limitation, we propose a Regularized Projection Matrix Approximation (RPMA) framework for robust estimation of rank-$K$ projection matrices. RPMA extends classical spectral projection by incorporating a regularization term, producing projection estimates that are more robust, sparse, and interpretable. We formulate the proposed model as an optimization problem on the manifold of rank-$K$ projection matrices and exploit its geometric equivalence to the Grassmann manifold. Based on this manifold characterization, we derive the first- and second-order optimality conditions, establish the local stability of the regularized leading eigenspace, and characterize the stability of the critical-point landscape under sufficiently small regularization. To efficiently solve the resulting nonconvex optimization problem, we develop a Riemannian gradient projection algorithm with backtracking line search, together with a more efficient Cayley--Sherman--Morrison--Woodbury (Cayley--SMW) gradient method that avoids repeated eigendecompositions. Extensive experiments on both synthetic and real-world datasets demonstrate that RPMA substantially improves the recovery accuracy of projection matrices and consistently outperforms conventional spectral projection methods for community detection and clustering under noisy environments.

谱方法图聚类流形优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。